2024-09-21T17:28:44.612 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T17:28:44.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T17:28:44.710 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/adking-2024-09-21_16:57:11-orch:cephadm-wip-adk-testing-2024-09-21-1014-distro-default-smithi/7914066 branch: wip-adk-testing-2024-09-21-1014 description: orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} email: adking@redhat.com first_in_suite: false job_id: '7914066' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: adking-2024-09-21_16:57:11-orch:cephadm-wip-adk-testing-2024-09-21-1014-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-adk-testing-2024-09-21-1014 ceph: conf: client: debug ms: 1 global: mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - CEPHADM_STRAY_DAEMON log-only-match: - CEPHADM_ sha1: 0ecbb435437226bc091a0c2d4549ba25bf724efe ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: cephadm-package install: ceph: flavor: default sha1: 0ecbb435437226bc091a0c2d4549ba25bf724efe extra_packages: - cephadm selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-adk-testing-2024-09-21-1014 sha1: 0ecbb435437226bc091a0c2d4549ba25bf724efe owner: scheduled_adking@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 9557 sha1: 0ecbb435437226bc091a0c2d4549ba25bf724efe sleep_before_teardown: 0 subset: 1/20 suite: orch:cephadm suite_branch: wip-adk-testing-2024-09-21-1014 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_0ecbb435437226bc091a0c2d4549ba25bf724efe/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 0ecbb435437226bc091a0c2d4549ba25bf724efe targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPoStkWYg9hCgHEEepcun7suOXM5FX+dmiLsVQ7fJdbtL6z7kPwq19z3g4Uy155D98G9d3rVtxkAZ9YOLIAzbAg= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+4KgBYofuFy+sNW/Wj8+22T64uMz5JEXxQ5LcKwwErk3VY74D+fGFQ3N2ps0DtFRFv+hfVnOJWUp3lxsgylFU= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_16:57:11 tube: smithi user: adking verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T17:28:44.710 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_0ecbb435437226bc091a0c2d4549ba25bf724efe/qa; will attempt to use it 2024-09-21T17:28:44.711 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_0ecbb435437226bc091a0c2d4549ba25bf724efe/qa/tasks 2024-09-21T17:28:44.711 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T17:28:44.712 INFO:teuthology.task.internal:Checking packages... 2024-09-21T17:28:44.732 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0ecbb435437226bc091a0c2d4549ba25bf724efe' 2024-09-21T17:28:44.732 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T17:28:44.733 INFO:teuthology.packaging:ref: None 2024-09-21T17:28:44.733 INFO:teuthology.packaging:tag: None 2024-09-21T17:28:44.733 INFO:teuthology.packaging:branch: wip-adk-testing-2024-09-21-1014 2024-09-21T17:28:44.733 INFO:teuthology.packaging:sha1: 0ecbb435437226bc091a0c2d4549ba25bf724efe 2024-09-21T17:28:44.733 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-adk-testing-2024-09-21-1014 2024-09-21T17:28:44.878 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5129.g0ecbb435 2024-09-21T17:28:44.879 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T17:28:44.886 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T17:28:44.886 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T17:28:44.892 INFO:teuthology.task.internal:Saving configuration 2024-09-21T17:28:44.904 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T17:28:44.917 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T17:28:44.941 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-09-21_16:57:11-orch:cephadm-wip-adk-testing-2024-09-21-1014-distro-default-smithi/7914066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 17:23:31.992712', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPoStkWYg9hCgHEEepcun7suOXM5FX+dmiLsVQ7fJdbtL6z7kPwq19z3g4Uy155D98G9d3rVtxkAZ9YOLIAzbAg='} 2024-09-21T17:28:44.964 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-09-21_16:57:11-orch:cephadm-wip-adk-testing-2024-09-21-1014-distro-default-smithi/7914066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 17:23:31.991185', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+4KgBYofuFy+sNW/Wj8+22T64uMz5JEXxQ5LcKwwErk3VY74D+fGFQ3N2ps0DtFRFv+hfVnOJWUp3lxsgylFU='} 2024-09-21T17:28:44.964 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T17:28:44.970 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-09-21T17:28:44.970 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-09-21T17:28:44.970 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T17:28:45.062 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff7d716c280>, signals=[15]) 2024-09-21T17:28:45.062 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T17:28:45.069 INFO:teuthology.task.internal:Opening connections... 2024-09-21T17:28:45.069 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-09-21T17:28:45.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T17:28:45.146 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T17:28:45.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T17:28:45.218 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T17:28:45.224 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-09-21T17:28:45.242 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-09-21T17:28:45.242 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-09-21T17:28:45.299 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-09-21T17:28:45.299 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-09-21T17:28:45.299 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-09-21T17:28:45.300 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-09-21T17:28:45.300 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-09-21T17:28:45.300 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-09-21T17:28:45.300 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T17:28:45.300 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-09-21T17:28:45.300 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-09-21T17:28:45.300 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T17:28:45.300 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-09-21T17:28:45.300 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T17:28:45.300 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T17:28:45.300 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T17:28:45.301 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-09-21T17:28:45.321 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-21T17:28:45.339 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-21T17:28:45.339 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-21T17:28:45.397 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-21T17:28:45.397 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-21T17:28:45.397 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-21T17:28:45.397 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-21T17:28:45.397 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-21T17:28:45.397 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-21T17:28:45.397 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T17:28:45.397 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-21T17:28:45.397 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-21T17:28:45.397 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T17:28:45.398 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-21T17:28:45.398 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T17:28:45.398 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T17:28:45.398 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T17:28:45.398 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-21T17:28:45.421 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T17:28:45.430 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T17:28:45.435 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T17:28:45.435 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-09-21T17:28:45.438 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-21T17:28:45.454 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T17:28:45.459 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T17:28:45.459 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-09-21T17:28:45.494 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-21T17:28:45.596 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T17:28:45.655 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T17:28:45.668 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T17:28:45.668 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T17:28:45.669 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T17:28:45.669 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T17:28:45.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T17:28:45.686 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-21T17:28:45.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T17:28:45.687 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-21T17:28:45.743 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-503.el9.x86_64 2024-09-21T17:28:45.744 INFO:teuthology.task.kernel:Running kernel on smithi042: 5.14.0-503.el9.x86_64 2024-09-21T17:28:45.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum install -y kernel 2024-09-21T17:28:45.746 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-503.el9.x86_64 2024-09-21T17:28:45.746 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.14.0-503.el9.x86_64 2024-09-21T17:28:45.746 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum install -y kernel 2024-09-21T17:28:48.010 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-21T17:28:52.352 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.3 MB 00:04 2024-09-21T17:28:53.519 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-09-21T17:28:57.904 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-21T17:28:59.413 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-21T17:29:00.225 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T17:29:00.419 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 2.9 MB/s | 20 MB 00:06 2024-09-21T17:29:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-21T17:29:06.969 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-21T17:29:07.771 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T17:29:07.771 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T17:29:07.866 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:29:07.877 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:29:07.877 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-09-21T17:29:07.877 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:29:07.877 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:29:07.877 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T17:29:07.877 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-21T17:29:07.877 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T17:29:07.878 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T17:29:07.878 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T17:29:07.878 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:29:07.878 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:29:07.878 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:29:07.878 INFO:teuthology.orchestra.run.smithi042.stdout:Install 4 Packages 2024-09-21T17:29:07.878 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:29:07.879 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 79 M 2024-09-21T17:29:07.879 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 126 M 2024-09-21T17:29:07.879 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:29:08.241 INFO:teuthology.orchestra.run.smithi042.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 420 kB/s | 36 kB 00:00 2024-09-21T17:29:08.702 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 19 kB 00:00 2024-09-21T17:29:08.783 INFO:teuthology.orchestra.run.smithi042.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-21T17:29:09.358 INFO:teuthology.orchestra.run.smithi042.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-21T17:29:09.582 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T17:29:09.658 INFO:teuthology.orchestra.run.smithi042.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-21T17:29:09.659 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:29:09.659 INFO:teuthology.orchestra.run.smithi042.stdout:Total 44 MB/s | 79 MB 00:01 2024-09-21T17:29:10.364 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:29:10.737 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:29:10.737 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:29:11.748 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:29:11.748 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:29:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:29:14.995 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T17:29:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T17:29:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T17:29:16.976 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T17:29:16.976 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T17:29:17.062 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:29:17.074 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:29:17.074 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-21T17:29:17.074 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:29:17.074 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:29:17.074 INFO:teuthology.orchestra.run.smithi162.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T17:29:17.074 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T17:29:17.074 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T17:29:17.074 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T17:29:17.074 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T17:29:17.074 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:29:17.075 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:29:17.075 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:29:17.075 INFO:teuthology.orchestra.run.smithi162.stdout:Install 4 Packages 2024-09-21T17:29:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:29:17.075 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 79 M 2024-09-21T17:29:17.075 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 126 M 2024-09-21T17:29:17.075 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:29:17.354 INFO:teuthology.orchestra.run.smithi162.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 350 kB/s | 36 kB 00:00 2024-09-21T17:29:17.780 INFO:teuthology.orchestra.run.smithi162.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-21T17:29:17.950 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T17:29:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T17:29:18.138 INFO:teuthology.orchestra.run.smithi162.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-21T17:29:18.455 INFO:teuthology.orchestra.run.smithi162.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-21T17:29:18.455 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:29:18.456 INFO:teuthology.orchestra.run.smithi162.stdout:Total 57 MB/s | 79 MB 00:01 2024-09-21T17:29:19.136 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:29:19.496 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:29:19.496 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:29:20.451 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:29:20.451 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:29:22.896 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:29:23.214 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T17:29:23.257 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:29:23.627 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T17:29:23.738 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T17:29:26.501 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T17:29:26.655 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T17:29:28.400 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:29:31.464 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T17:29:31.593 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:29:36.431 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:30:07.885 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:30:07.927 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:30:08.289 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:30:08.289 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T17:30:08.289 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T17:30:08.289 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T17:30:09.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:30:09.149 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:30:09.149 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:30:09.149 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T17:30:09.149 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T17:30:09.149 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T17:30:09.149 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T17:30:09.149 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:30:09.149 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:30:09.467 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T17:30:09.562 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T17:30:09.562 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T17:30:09.562 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T17:30:09.562 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T17:30:09.562 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T17:30:09.562 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T17:30:09.563 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T17:30:09.563 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T17:30:09.620 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T17:30:09.621 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T17:30:09.621 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-09-21T17:30:09.652 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-09-21T17:30:09.652 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-09-21T17:30:09.652 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-09-21T17:30:09.652 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 82.el9 2024-09-21T17:30:09.652 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-09-21T17:30:09.652 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T17:30:09.652 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-09-21T17:30:09.652 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8274670 2024-09-21T17:30:09.652 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-09-21T17:30:09.653 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:30:09.654 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T17:30:09.654 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T17:30:09.655 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 5.14.0-508.el9.x86_64 2024-09-21T17:30:09.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T17:30:10.383 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-09-21T17:30:11.721 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T17:30:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-09-21T17:30:11.756 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-09-21T17:30:11.771 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.UcCQceCqBl 2024-09-21T17:30:11.771 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UcCQceCqBl 2024-09-21T17:30:11.837 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.UcCQceCqBl 2024-09-21T17:30:11.988 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.UcCQceCqBl is 6KB 2024-09-21T17:30:12.035 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.UcCQceCqBl 2024-09-21T17:30:12.050 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T17:30:12.113 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T17:30:12.113 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T17:30:12.113 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T17:30:12.113 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T17:30:12.114 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T17:30:12.268 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-09-21T17:30:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:30:14.506 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:30:14.849 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:30:14.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T17:30:14.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T17:30:14.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T17:30:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T17:30:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:30:15.719 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:30:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T17:30:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T17:30:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T17:30:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T17:30:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:30:15.719 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:30:16.083 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T17:30:16.174 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T17:30:16.174 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T17:30:16.174 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T17:30:16.174 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T17:30:16.174 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T17:30:16.175 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T17:30:16.175 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T17:30:16.175 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T17:30:16.233 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T17:30:16.234 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T17:30:16.234 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 82.el9 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8274670 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T17:30:16.269 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-09-21T17:30:16.270 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-09-21T17:30:16.270 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T17:30:16.270 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-09-21T17:30:16.270 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-09-21T17:30:16.270 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:30:16.270 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T17:30:16.270 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T17:30:16.270 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T17:30:16.270 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-09-21T17:30:16.270 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:30:16.270 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T17:30:16.271 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T17:30:16.271 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 5.14.0-508.el9.x86_64 2024-09-21T17:30:16.271 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T17:30:16.934 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-09-21T17:30:18.267 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T17:30:18.303 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-09-21T17:30:18.305 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-21T17:30:18.321 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.IUC8UxxFqF 2024-09-21T17:30:18.321 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IUC8UxxFqF 2024-09-21T17:30:18.392 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.IUC8UxxFqF 2024-09-21T17:30:18.530 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.IUC8UxxFqF is 6KB 2024-09-21T17:30:18.578 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.IUC8UxxFqF 2024-09-21T17:30:18.593 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T17:30:18.656 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T17:30:18.656 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T17:30:18.657 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T17:30:18.657 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T17:30:18.658 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T17:30:18.797 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-09-21T17:30:42.291 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T17:30:42.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-21T17:30:42.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T17:30:48.806 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T17:30:48.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T17:30:48.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T17:31:00.719 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-09-21T17:31:07.375 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-21T17:31:09.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-21T17:31:09.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T17:31:16.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T17:31:16.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T17:31:19.439 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-21T17:31:31.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T17:31:31.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T17:32:09.758 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T17:32:21.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-21T17:32:21.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T17:32:22.174 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-21T17:32:22.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-21T17:32:22.514 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T17:32:22.514 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-21T17:32:22.530 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-508.el9.x86_64 2024-09-21T17:32:22.531 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T17:32:22.531 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T17:32:22.531 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T17:32:23.531 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T17:32:23.531 DEBUG:teuthology.orchestra.run.smithi042:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T17:32:23.604 INFO:teuthology.orchestra.run.smithi042.stdout:ttyS1 2024-09-21T17:32:23.639 DEBUG:teuthology.parallel:result is None 2024-09-21T17:32:31.453 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T17:32:46.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T17:32:46.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T17:32:46.801 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-21T17:32:47.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T17:32:47.173 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T17:32:47.173 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-21T17:32:47.190 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-508.el9.x86_64 2024-09-21T17:32:47.190 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T17:32:47.190 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T17:32:47.190 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T17:32:48.191 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T17:32:48.191 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T17:32:48.282 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2024-09-21T17:32:48.308 DEBUG:teuthology.parallel:result is None 2024-09-21T17:32:48.308 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T17:32:48.315 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T17:32:48.315 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T17:32:48.317 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T17:32:48.335 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T17:32:48.342 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T17:32:48.349 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T17:32:48.349 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T17:32:48.377 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T17:32:48.408 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T17:32:48.415 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T17:32:48.415 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T17:32:48.446 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T17:32:48.480 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T17:32:48.481 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T17:32:48.492 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T17:32:48.492 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T17:32:48.494 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T17:32:48.507 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T17:32:48.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T17:32:48.536 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T17:32:48.564 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T17:32:48.573 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T17:32:48.573 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T17:32:48.606 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T17:32:48.622 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T17:32:48.704 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T17:32:48.759 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T17:32:48.838 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T17:32:48.890 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:32:48.891 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T17:32:48.958 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T17:32:49.001 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T17:32:49.066 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T17:32:49.108 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T17:32:49.152 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:32:49.152 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T17:32:49.219 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-09-21T17:32:49.221 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-21T17:32:49.278 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T17:32:49.314 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T17:32:49.704 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T17:32:49.718 INFO:teuthology.task.internal:Starting timer... 2024-09-21T17:32:49.719 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T17:32:49.756 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T17:32:49.765 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-21T17:32:49.765 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-09-21T17:32:49.820 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-09-21T17:32:49.822 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-21T17:32:49.877 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-21T17:32:49.879 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T17:32:49.879 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-09-21T17:32:49.903 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-09-21T17:32:49.903 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-21T17:32:49.935 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-21T17:32:49.935 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-09-21T17:32:49.936 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T17:32:49.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T17:32:49.972 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T17:32:50.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T17:32:50.003 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T17:32:50.003 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-09-21T17:32:50.059 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-21T17:32:50.099 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T17:32:50.108 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T17:32:50.118 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T17:32:50.119 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T17:36:35.083 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-09-21T17:36:35.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-21T17:36:35.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T17:36:35.163 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-21T17:36:35.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-21T17:36:35.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T17:36:35.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T17:36:35.318 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-21T17:36:35.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T17:36:35.398 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T17:36:35.407 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T17:36:35.407 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T17:36:35.408 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T17:36:35.410 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T17:36:35.410 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T17:36:35.439 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T17:36:35.454 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T17:36:35.467 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T17:36:35.480 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-09-21T17:36:35.482 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T17:36:35.491 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-09-21T17:36:35.506 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-21T17:36:35.506 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T17:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-21T17:36:35.521 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T17:36:35.531 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T17:36:35.545 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T17:36:35.578 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-21T17:36:35.581 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T17:36:35.582 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-21T17:36:35.582 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T17:36:35.582 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T17:36:35.582 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T17:36:35.582 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T17:36:35.600 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-21T17:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T17:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-21T17:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T17:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T17:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T17:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T17:36:35.605 INFO:teuthology.run_tasks:Running task pexec... 2024-09-21T17:36:35.615 INFO:teuthology.task.pexec:Executing custom commands... 2024-09-21T17:36:35.615 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi042.front.sepia.ceph.com 2024-09-21T17:36:35.615 DEBUG:teuthology.orchestra.run.smithi042:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-21T17:36:35.615 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T17:36:35.615 DEBUG:teuthology.orchestra.run.smithi162:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-21T17:36:35.990 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:36:35.997 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:36:36.004 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:36:36.004 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-09-21T17:36:36.004 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:36:36.004 INFO:teuthology.orchestra.run.smithi042.stdout:Removing: 2024-09-21T17:36:36.004 INFO:teuthology.orchestra.run.smithi042.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-21T17:36:36.005 INFO:teuthology.orchestra.run.smithi042.stdout:Removing unused dependencies: 2024-09-21T17:36:36.005 INFO:teuthology.orchestra.run.smithi042.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-21T17:36:36.005 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:36:36.005 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:36:36.005 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:36:36.005 INFO:teuthology.orchestra.run.smithi042.stdout:Remove 2 Packages 2024-09-21T17:36:36.005 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:36:36.005 INFO:teuthology.orchestra.run.smithi042.stdout:Freed space: 5.5 M 2024-09-21T17:36:36.005 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:36:36.008 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:36:36.008 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-21T17:36:36.008 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:36:36.008 INFO:teuthology.orchestra.run.smithi162.stdout:Removing: 2024-09-21T17:36:36.008 INFO:teuthology.orchestra.run.smithi162.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-21T17:36:36.009 INFO:teuthology.orchestra.run.smithi162.stdout:Removing unused dependencies: 2024-09-21T17:36:36.009 INFO:teuthology.orchestra.run.smithi162.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-21T17:36:36.009 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:36:36.009 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:36:36.009 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:36:36.009 INFO:teuthology.orchestra.run.smithi162.stdout:Remove 2 Packages 2024-09-21T17:36:36.009 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:36:36.009 INFO:teuthology.orchestra.run.smithi162.stdout:Freed space: 5.5 M 2024-09-21T17:36:36.009 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:36:36.009 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:36:36.010 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:36:36.013 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:36:36.013 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:36:36.067 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:36:36.067 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:36:36.089 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:36:36.089 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:36:36.223 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:36:36.226 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:36:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-21T17:36:36.310 INFO:teuthology.orchestra.run.smithi162.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-21T17:36:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-21T17:36:36.371 INFO:teuthology.orchestra.run.smithi162.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-21T17:36:36.847 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-21T17:36:36.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-21T17:36:36.852 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-21T17:36:36.852 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-21T17:36:37.080 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-21T17:36:37.081 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:36:37.081 INFO:teuthology.orchestra.run.smithi162.stdout:Removed: 2024-09-21T17:36:37.081 INFO:teuthology.orchestra.run.smithi162.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-21T17:36:37.081 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:36:37.081 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:36:37.116 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-21T17:36:37.117 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:36:37.117 INFO:teuthology.orchestra.run.smithi042.stdout:Removed: 2024-09-21T17:36:37.117 INFO:teuthology.orchestra.run.smithi042.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-21T17:36:37.117 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:36:37.117 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:36:37.925 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Sep 2024 05:35:45 PM UTC. 2024-09-21T17:36:37.972 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:46 ago on Sat 21 Sep 2024 05:35:51 PM UTC. 2024-09-21T17:36:38.075 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:36:38.076 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:36:38.076 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-21T17:36:38.076 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:36:38.076 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:36:38.076 INFO:teuthology.orchestra.run.smithi162.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-21T17:36:38.076 INFO:teuthology.orchestra.run.smithi162.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-21T17:36:38.076 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T17:36:38.076 INFO:teuthology.orchestra.run.smithi162.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-21T17:36:38.077 INFO:teuthology.orchestra.run.smithi162.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-21T17:36:38.077 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-21T17:36:38.077 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-21T17:36:38.077 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:36:38.077 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:36:38.077 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:36:38.077 INFO:teuthology.orchestra.run.smithi162.stdout:Install 6 Packages 2024-09-21T17:36:38.077 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:36:38.095 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 2.0 M 2024-09-21T17:36:38.095 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 9.2 M 2024-09-21T17:36:38.095 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:36:38.107 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:36:38.108 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:36:38.108 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-09-21T17:36:38.108 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:36:38.108 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:36:38.108 INFO:teuthology.orchestra.run.smithi042.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-21T17:36:38.108 INFO:teuthology.orchestra.run.smithi042.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-21T17:36:38.109 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-21T17:36:38.109 INFO:teuthology.orchestra.run.smithi042.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-21T17:36:38.109 INFO:teuthology.orchestra.run.smithi042.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-21T17:36:38.109 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-21T17:36:38.109 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-21T17:36:38.109 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:36:38.109 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:36:38.109 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:36:38.109 INFO:teuthology.orchestra.run.smithi042.stdout:Install 6 Packages 2024-09-21T17:36:38.109 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:36:38.120 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 2.0 M 2024-09-21T17:36:38.120 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 9.2 M 2024-09-21T17:36:38.120 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:36:38.263 INFO:teuthology.orchestra.run.smithi042.stdout:(1/6): nvmetcli-0.7-3.el9.noarch.rpm 474 kB/s | 44 kB 00:00 2024-09-21T17:36:38.288 INFO:teuthology.orchestra.run.smithi042.stdout:(2/6): libnvme-1.9-3.el9.x86_64.rpm 890 kB/s | 106 kB 00:00 2024-09-21T17:36:38.322 INFO:teuthology.orchestra.run.smithi042.stdout:(3/6): python3-configshell-1.1.30-1.el9.noarch. 1.2 MB/s | 72 kB 00:00 2024-09-21T17:36:38.347 INFO:teuthology.orchestra.run.smithi042.stdout:(4/6): python3-kmod-0.9-32.el9.x86_64.rpm 1.4 MB/s | 84 kB 00:00 2024-09-21T17:36:38.372 INFO:teuthology.orchestra.run.smithi042.stdout:(5/6): nvme-cli-2.9.1-6.el9.x86_64.rpm 4.4 MB/s | 906 kB 00:00 2024-09-21T17:36:38.431 INFO:teuthology.orchestra.run.smithi042.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 7.5 MB/s | 837 kB 00:00 2024-09-21T17:36:38.431 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:36:38.431 INFO:teuthology.orchestra.run.smithi042.stdout:Total 6.4 MB/s | 2.0 MB 00:00 2024-09-21T17:36:38.507 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:36:38.518 INFO:teuthology.orchestra.run.smithi162.stdout:(1/6): nvmetcli-0.7-3.el9.noarch.rpm 119 kB/s | 44 kB 00:00 2024-09-21T17:36:38.521 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:36:38.521 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:36:38.644 INFO:teuthology.orchestra.run.smithi162.stdout:(2/6): libnvme-1.9-3.el9.x86_64.rpm 213 kB/s | 106 kB 00:00 2024-09-21T17:36:38.711 INFO:teuthology.orchestra.run.smithi162.stdout:(3/6): python3-configshell-1.1.30-1.el9.noarch. 373 kB/s | 72 kB 00:00 2024-09-21T17:36:38.753 INFO:teuthology.orchestra.run.smithi162.stdout:(4/6): python3-kmod-0.9-32.el9.x86_64.rpm 775 kB/s | 84 kB 00:00 2024-09-21T17:36:38.839 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:36:38.839 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:36:39.046 INFO:teuthology.orchestra.run.smithi162.stdout:(5/6): nvme-cli-2.9.1-6.el9.x86_64.rpm 1.0 MB/s | 906 kB 00:00 2024-09-21T17:36:39.187 INFO:teuthology.orchestra.run.smithi162.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 1.7 MB/s | 837 kB 00:00 2024-09-21T17:36:39.187 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:36:39.187 INFO:teuthology.orchestra.run.smithi162.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2024-09-21T17:36:39.266 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:36:39.272 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:36:39.280 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:36:39.281 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:36:39.360 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2024-09-21T17:36:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/6 2024-09-21T17:36:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/6 2024-09-21T17:36:39.567 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:36:39.567 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:36:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/6 2024-09-21T17:36:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-21T17:36:39.993 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:36:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2024-09-21T17:36:40.116 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/6 2024-09-21T17:36:40.144 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/6 2024-09-21T17:36:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-21T17:36:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/6 2024-09-21T17:36:40.351 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/6 2024-09-21T17:36:40.408 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-21T17:36:40.844 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-21T17:36:40.878 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/6 2024-09-21T17:36:41.231 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/6 2024-09-21T17:36:41.277 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/6 2024-09-21T17:36:41.277 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/6 2024-09-21T17:36:41.277 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/6 2024-09-21T17:36:41.277 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/6 2024-09-21T17:36:41.277 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/6 2024-09-21T17:36:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2024-09-21T17:36:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:36:41.566 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:36:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-21T17:36:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-21T17:36:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-21T17:36:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:36:41.566 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:36:41.856 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/6 2024-09-21T17:36:41.856 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/6 2024-09-21T17:36:41.856 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/6 2024-09-21T17:36:41.856 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/6 2024-09-21T17:36:41.856 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/6 2024-09-21T17:36:41.856 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/6 2024-09-21T17:36:41.870 DEBUG:teuthology.parallel:result is None 2024-09-21T17:36:42.222 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2024-09-21T17:36:42.222 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:36:42.222 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:36:42.222 INFO:teuthology.orchestra.run.smithi162.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-21T17:36:42.222 INFO:teuthology.orchestra.run.smithi162.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-21T17:36:42.222 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-21T17:36:42.222 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:36:42.222 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:36:42.568 DEBUG:teuthology.parallel:result is None 2024-09-21T17:36:42.568 INFO:teuthology.run_tasks:Running task install... 2024-09-21T17:36:42.578 DEBUG:teuthology.task.install:project ceph 2024-09-21T17:36:42.578 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0ecbb435437226bc091a0c2d4549ba25bf724efe'}, 'extra_packages': ['cephadm']} 2024-09-21T17:36:42.578 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '0ecbb435437226bc091a0c2d4549ba25bf724efe'} 2024-09-21T17:36:42.578 INFO:teuthology.task.install:Using flavor: default 2024-09-21T17:36:42.583 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T17:36:42.583 INFO:teuthology.task.install:extra packages: [] 2024-09-21T17:36:42.583 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0ecbb435437226bc091a0c2d4549ba25bf724efe', 'tag': None, 'wait_for_package': False} 2024-09-21T17:36:42.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0ecbb435437226bc091a0c2d4549ba25bf724efe 2024-09-21T17:36:42.585 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0ecbb435437226bc091a0c2d4549ba25bf724efe', 'tag': None, 'wait_for_package': False} 2024-09-21T17:36:42.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0ecbb435437226bc091a0c2d4549ba25bf724efe 2024-09-21T17:36:42.730 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-adk-testing-2024-09-21-1014/0ecbb435437226bc091a0c2d4549ba25bf724efe/centos/9/flavors/default/ 2024-09-21T17:36:42.730 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5129.g0ecbb435 2024-09-21T17:36:42.734 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-adk-testing-2024-09-21-1014/0ecbb435437226bc091a0c2d4549ba25bf724efe/centos/9/flavors/default/ 2024-09-21T17:36:42.734 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5129.g0ecbb435 2024-09-21T17:36:42.849 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-adk-testing-2024-09-21-1014/0ecbb435437226bc091a0c2d4549ba25bf724efe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-adk-testing-2024-09-21-1014/0ecbb435437226bc091a0c2d4549ba25bf724efe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-adk-testing-2024-09-21-1014/0ecbb435437226bc091a0c2d4549ba25bf724efe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T17:36:42.849 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:36:42.849 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T17:36:42.852 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-adk-testing-2024-09-21-1014/0ecbb435437226bc091a0c2d4549ba25bf724efe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-adk-testing-2024-09-21-1014/0ecbb435437226bc091a0c2d4549ba25bf724efe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-adk-testing-2024-09-21-1014/0ecbb435437226bc091a0c2d4549ba25bf724efe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T17:36:42.852 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:36:42.852 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T17:36:42.878 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T17:36:42.879 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0ecbb435437226bc091a0c2d4549ba25bf724efe/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T17:36:42.887 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T17:36:42.887 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0ecbb435437226bc091a0c2d4549ba25bf724efe/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T17:36:42.945 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T17:36:42.959 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T17:36:43.021 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T17:36:43.040 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T17:36:43.085 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-21T17:36:43.086 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-21T17:36:43.108 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-09-21T17:36:43.110 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-09-21T17:36:43.315 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-21T17:36:43.343 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw 2024-09-21T17:36:43.352 INFO:teuthology.orchestra.run.smithi042.stdout:45 files removed 2024-09-21T17:36:43.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw 2024-09-21T17:36:43.903 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-21T17:36:43.947 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-21T17:36:44.204 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T17:36:44.238 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 99 kB/s | 24 kB 00:00 2024-09-21T17:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-21T17:36:44.513 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T17:36:45.305 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T17:36:47.130 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.3 MB 00:02 2024-09-21T17:36:49.298 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 20 MB 00:02 2024-09-21T17:36:54.624 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 5.9 MB/s | 6.5 MB 00:01 2024-09-21T17:36:56.342 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-21T17:36:56.696 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 2.4 MB/s | 20 MB 00:08 2024-09-21T17:36:57.446 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T17:37:01.721 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.5 MB 00:01 2024-09-21T17:37:03.060 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T17:37:03.389 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-21T17:37:04.210 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-21T17:37:05.399 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:37:05.401 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:05.401 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-21T17:37:05.401 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:05.402 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:37:05.402 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 11 M 2024-09-21T17:37:05.402 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-09-21T17:37:05.402 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 3.5 M 2024-09-21T17:37:05.402 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 3.2 M 2024-09-21T17:37:05.402 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-21T17:37:05.402 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T17:37:05.402 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 5.5 M 2024-09-21T17:37:05.402 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 22 M 2024-09-21T17:37:05.402 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 25 k 2024-09-21T17:37:05.402 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 754 k 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 508 k 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 5.5 M 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T17:37:05.403 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 45 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 150 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 162 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 321 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 307 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 100 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:05.404 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:37:05.405 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:05.405 INFO:teuthology.orchestra.run.smithi042.stdout:Install 31 Packages 2024-09-21T17:37:05.405 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 2 Packages 2024-09-21T17:37:05.405 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:05.405 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 62 M 2024-09-21T17:37:05.405 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:37:06.362 INFO:teuthology.orchestra.run.smithi042.stdout:(1/33): ceph-base-19.3.0-5129.g0ecbb435.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-21T17:37:06.411 INFO:teuthology.orchestra.run.smithi042.stdout:(2/33): ceph-selinux-19.3.0-5129.g0ecbb435.el9. 507 kB/s | 25 kB 00:00 2024-09-21T17:37:06.512 INFO:teuthology.orchestra.run.smithi042.stdout:(3/33): libcephfs2-19.3.0-5129.g0ecbb435.el9.x8 7.4 MB/s | 754 kB 00:00 2024-09-21T17:37:06.612 INFO:teuthology.orchestra.run.smithi042.stdout:(4/33): libradosstriper1-19.3.0-5129.g0ecbb435. 5.0 MB/s | 508 kB 00:00 2024-09-21T17:37:07.021 INFO:teuthology.orchestra.run.smithi042.stdout:(5/33): ceph-common-19.3.0-5129.g0ecbb435.el9.x 19 MB/s | 22 MB 00:01 2024-09-21T17:37:07.138 INFO:teuthology.orchestra.run.smithi042.stdout:(6/33): ceph-radosgw-19.3.0-5129.g0ecbb435.el9. 8.6 MB/s | 11 MB 00:01 2024-09-21T17:37:07.163 INFO:teuthology.orchestra.run.smithi042.stdout:(7/33): python3-ceph-argparse-19.3.0-5129.g0ecb 319 kB/s | 45 kB 00:00 2024-09-21T17:37:07.188 INFO:teuthology.orchestra.run.smithi042.stdout:(8/33): python3-ceph-common-19.3.0-5129.g0ecbb4 2.9 MB/s | 150 kB 00:00 2024-09-21T17:37:07.214 INFO:teuthology.orchestra.run.smithi042.stdout:(9/33): python3-cephfs-19.3.0-5129.g0ecbb435.el 3.2 MB/s | 162 kB 00:00 2024-09-21T17:37:07.247 INFO:teuthology.orchestra.run.smithi042.stdout:(10/33): python3-rados-19.3.0-5129.g0ecbb435.el 5.4 MB/s | 321 kB 00:00 2024-09-21T17:37:07.272 INFO:teuthology.orchestra.run.smithi042.stdout:(11/33): python3-rbd-19.3.0-5129.g0ecbb435.el9. 5.1 MB/s | 307 kB 00:00 2024-09-21T17:37:07.306 INFO:teuthology.orchestra.run.smithi042.stdout:(12/33): python3-rgw-19.3.0-5129.g0ecbb435.el9. 1.7 MB/s | 100 kB 00:00 2024-09-21T17:37:07.390 INFO:teuthology.orchestra.run.smithi042.stdout:(13/33): librgw2-19.3.0-5129.g0ecbb435.el9.x86_ 7.1 MB/s | 5.5 MB 00:00 2024-09-21T17:37:07.440 INFO:teuthology.orchestra.run.smithi042.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 639 kB/s | 107 kB 00:00 2024-09-21T17:37:07.499 INFO:teuthology.orchestra.run.smithi042.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 778 kB/s | 45 kB 00:00 2024-09-21T17:37:07.532 INFO:teuthology.orchestra.run.smithi042.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 756 kB/s | 171 kB 00:00 2024-09-21T17:37:07.566 INFO:teuthology.orchestra.run.smithi042.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 912 kB/s | 160 kB 00:00 2024-09-21T17:37:07.616 INFO:teuthology.orchestra.run.smithi042.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 845 kB/s | 42 kB 00:00 2024-09-21T17:37:07.641 INFO:teuthology.orchestra.run.smithi042.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-21T17:37:07.667 INFO:teuthology.orchestra.run.smithi042.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-21T17:37:07.692 INFO:teuthology.orchestra.run.smithi042.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 715 kB/s | 36 kB 00:00 2024-09-21T17:37:07.717 INFO:teuthology.orchestra.run.smithi042.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-21T17:37:07.743 INFO:teuthology.orchestra.run.smithi042.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-21T17:37:07.801 INFO:teuthology.orchestra.run.smithi042.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-21T17:37:07.826 INFO:teuthology.orchestra.run.smithi042.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T17:37:07.852 INFO:teuthology.orchestra.run.smithi042.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 279 kB/s | 26 kB 00:00 2024-09-21T17:37:07.877 INFO:teuthology.orchestra.run.smithi042.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T17:37:07.920 INFO:teuthology.orchestra.run.smithi042.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 4.4 MB/s | 191 kB 00:00 2024-09-21T17:37:07.987 INFO:teuthology.orchestra.run.smithi042.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-21T17:37:08.037 INFO:teuthology.orchestra.run.smithi042.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-21T17:37:08.129 INFO:teuthology.orchestra.run.smithi042.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-21T17:37:08.237 INFO:teuthology.orchestra.run.smithi042.stdout:(32/33): librados2-19.3.0-5129.g0ecbb435.el9.x8 14 MB/s | 3.5 MB 00:00 2024-09-21T17:37:08.296 INFO:teuthology.orchestra.run.smithi042.stdout:(33/33): librbd1-19.3.0-5129.g0ecbb435.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-21T17:37:08.302 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:37:08.302 INFO:teuthology.orchestra.run.smithi042.stdout:Total 21 MB/s | 62 MB 00:02 2024-09-21T17:37:08.418 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:37:08.460 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:37:08.460 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:37:08.997 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:37:08.997 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:37:09.649 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-21T17:37:10.505 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:37:10.591 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-21T17:37:10.623 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-21T17:37:10.660 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-21T17:37:10.691 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-21T17:37:10.716 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-21T17:37:10.861 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-21T17:37:10.914 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-21T17:37:11.273 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-21T17:37:11.411 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.3.0-5129.g0ecbb435.el9.x86_64 7/35 2024-09-21T17:37:11.488 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.3.0-5129.g0ecbb435.el9.x86_64 7/35 2024-09-21T17:37:11.578 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.3.0-5129.g0ecbb435.el9.x86_64 8/35 2024-09-21T17:37:11.605 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.3.0-5129.g0ecbb435.el9.x86_64 9/35 2024-09-21T17:37:11.667 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.3.0-5129.g0ecbb435.el9.x86_64 9/35 2024-09-21T17:37:11.705 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-21T17:37:11.749 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.3.0-5129.g0ecbb435.el9. 11/35 2024-09-21T17:37:11.820 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.3.0-5129.g0ecbb435.el9.x86_64 12/35 2024-09-21T17:37:11.849 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.3.0-5129.g0ecbb435.el9.x86_6 13/35 2024-09-21T17:37:11.895 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:37:11.898 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:37:11.898 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T17:37:11.898 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:37:11.898 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:37:11.898 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 11 M 2024-09-21T17:37:11.898 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-21T17:37:11.898 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 3.5 M 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 3.2 M 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 5.5 M 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 22 M 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 25 k 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 754 k 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T17:37:11.899 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 508 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 5.5 M 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 45 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 150 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 162 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 321 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 307 k 2024-09-21T17:37:11.900 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 100 k 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout:Install 31 Packages 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 2 Packages 2024-09-21T17:37:11.901 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:11.902 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 62 M 2024-09-21T17:37:11.902 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:37:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5129.g0ecbb435.el9.x86_6 13/35 2024-09-21T17:37:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-21T17:37:12.084 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-21T17:37:12.116 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-21T17:37:12.156 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-21T17:37:12.197 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-21T17:37:12.227 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-21T17:37:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-21T17:37:12.297 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-21T17:37:12.635 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-21T17:37:12.681 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.3.0-5129.g0ecbb435.el9.x86_64 23/35 2024-09-21T17:37:12.773 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.3.0-5129.g0ecbb435.el9.x86_64 23/35 2024-09-21T17:37:12.803 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 24/35 2024-09-21T17:37:12.840 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-21T17:37:12.892 INFO:teuthology.orchestra.run.smithi162.stdout:(1/33): ceph-base-19.3.0-5129.g0ecbb435.el9.x86 10 MB/s | 5.5 MB 00:00 2024-09-21T17:37:12.950 INFO:teuthology.orchestra.run.smithi162.stdout:(2/33): ceph-selinux-19.3.0-5129.g0ecbb435.el9. 432 kB/s | 25 kB 00:00 2024-09-21T17:37:13.034 INFO:teuthology.orchestra.run.smithi162.stdout:(3/33): libcephfs2-19.3.0-5129.g0ecbb435.el9.x8 8.9 MB/s | 754 kB 00:00 2024-09-21T17:37:13.168 INFO:teuthology.orchestra.run.smithi162.stdout:(4/33): ceph-radosgw-19.3.0-5129.g0ecbb435.el9. 13 MB/s | 11 MB 00:00 2024-09-21T17:37:13.201 INFO:teuthology.orchestra.run.smithi162.stdout:(5/33): libradosstriper1-19.3.0-5129.g0ecbb435. 3.0 MB/s | 508 kB 00:00 2024-09-21T17:37:13.277 INFO:teuthology.orchestra.run.smithi162.stdout:(6/33): python3-ceph-argparse-19.3.0-5129.g0ecb 602 kB/s | 45 kB 00:00 2024-09-21T17:37:13.351 INFO:teuthology.orchestra.run.smithi162.stdout:(7/33): python3-ceph-common-19.3.0-5129.g0ecbb4 2.0 MB/s | 150 kB 00:00 2024-09-21T17:37:13.359 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-21T17:37:13.384 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.3.0-5129.g0ecbb435.el9.x86_64 27/35 2024-09-21T17:37:13.452 INFO:teuthology.orchestra.run.smithi162.stdout:(8/33): librgw2-19.3.0-5129.g0ecbb435.el9.x86_6 19 MB/s | 5.5 MB 00:00 2024-09-21T17:37:13.464 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.3.0-5129.g0ecbb435.el9.x86_64 27/35 2024-09-21T17:37:13.477 INFO:teuthology.orchestra.run.smithi162.stdout:(9/33): python3-cephfs-19.3.0-5129.g0ecbb435.el 1.3 MB/s | 162 kB 00:00 2024-09-21T17:37:13.502 INFO:teuthology.orchestra.run.smithi162.stdout:(10/33): python3-rados-19.3.0-5129.g0ecbb435.el 6.2 MB/s | 321 kB 00:00 2024-09-21T17:37:13.528 INFO:teuthology.orchestra.run.smithi162.stdout:(11/33): python3-rbd-19.3.0-5129.g0ecbb435.el9. 6.0 MB/s | 307 kB 00:00 2024-09-21T17:37:13.553 INFO:teuthology.orchestra.run.smithi162.stdout:(12/33): python3-rgw-19.3.0-5129.g0ecbb435.el9. 1.9 MB/s | 100 kB 00:00 2024-09-21T17:37:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 28/35 2024-09-21T17:37:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.3.0-5129.g0ecbb435.el9.x8 29/35 2024-09-21T17:37:13.779 INFO:teuthology.orchestra.run.smithi162.stdout:(13/33): ceph-common-19.3.0-5129.g0ecbb435.el9. 15 MB/s | 22 MB 00:01 2024-09-21T17:37:13.837 INFO:teuthology.orchestra.run.smithi162.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 346 kB/s | 107 kB 00:00 2024-09-21T17:37:13.887 INFO:teuthology.orchestra.run.smithi162.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-09-21T17:37:13.913 INFO:teuthology.orchestra.run.smithi162.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 475 kB/s | 171 kB 00:00 2024-09-21T17:37:13.938 INFO:teuthology.orchestra.run.smithi162.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-21T17:37:13.980 INFO:teuthology.orchestra.run.smithi162.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-21T17:37:14.014 INFO:teuthology.orchestra.run.smithi162.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2024-09-21T17:37:14.039 INFO:teuthology.orchestra.run.smithi162.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 421 kB/s | 42 kB 00:00 2024-09-21T17:37:14.064 INFO:teuthology.orchestra.run.smithi162.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 713 kB/s | 36 kB 00:00 2024-09-21T17:37:14.089 INFO:teuthology.orchestra.run.smithi162.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-09-21T17:37:14.115 INFO:teuthology.orchestra.run.smithi162.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-21T17:37:14.174 INFO:teuthology.orchestra.run.smithi162.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-21T17:37:14.191 INFO:teuthology.orchestra.run.smithi162.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 3.2 MB/s | 49 kB 00:00 2024-09-21T17:37:14.207 INFO:teuthology.orchestra.run.smithi162.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 335 kB/s | 26 kB 00:00 2024-09-21T17:37:14.233 INFO:teuthology.orchestra.run.smithi162.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-21T17:37:14.258 INFO:teuthology.orchestra.run.smithi162.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.6 MB/s | 191 kB 00:00 2024-09-21T17:37:14.325 INFO:teuthology.orchestra.run.smithi162.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-21T17:37:14.367 INFO:teuthology.orchestra.run.smithi162.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T17:37:14.451 INFO:teuthology.orchestra.run.smithi162.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T17:37:14.610 INFO:teuthology.orchestra.run.smithi162.stdout:(32/33): librados2-19.3.0-5129.g0ecbb435.el9.x8 12 MB/s | 3.5 MB 00:00 2024-09-21T17:37:14.659 INFO:teuthology.orchestra.run.smithi162.stdout:(33/33): librbd1-19.3.0-5129.g0ecbb435.el9.x86_ 11 MB/s | 3.2 MB 00:00 2024-09-21T17:37:14.664 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:37:14.664 INFO:teuthology.orchestra.run.smithi162.stdout:Total 22 MB/s | 62 MB 00:02 2024-09-21T17:37:14.778 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:37:14.815 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:37:14.815 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:37:15.306 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:37:15.306 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:37:16.024 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 30/35 2024-09-21T17:37:16.058 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 30/35 2024-09-21T17:37:16.660 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 30/35 2024-09-21T17:37:16.703 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.3.0-5129.g0ecbb435.el9.x86_64 31/35 2024-09-21T17:37:16.795 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:37:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.3.0-5129.g0ecbb435.el9.x86_64 31/35 2024-09-21T17:37:16.805 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T17:37:16.805 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T17:37:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.3.0-5129.g0ecbb435.el9.x86_64 32/35 2024-09-21T17:37:16.885 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-21T17:37:16.923 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-21T17:37:16.957 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-21T17:37:16.988 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-21T17:37:17.013 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-21T17:37:17.204 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-21T17:37:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-21T17:37:17.608 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-21T17:37:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.3.0-5129.g0ecbb435.el9.x86_64 7/35 2024-09-21T17:37:17.823 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.3.0-5129.g0ecbb435.el9.x86_64 7/35 2024-09-21T17:37:17.922 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.3.0-5129.g0ecbb435.el9.x86_64 8/35 2024-09-21T17:37:17.958 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.3.0-5129.g0ecbb435.el9.x86_64 9/35 2024-09-21T17:37:18.004 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.3.0-5129.g0ecbb435.el9.x86_64 9/35 2024-09-21T17:37:18.043 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-21T17:37:18.094 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.3.0-5129.g0ecbb435.el9. 11/35 2024-09-21T17:37:18.163 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.3.0-5129.g0ecbb435.el9.x86_64 12/35 2024-09-21T17:37:18.185 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.3.0-5129.g0ecbb435.el9.x86_6 13/35 2024-09-21T17:37:18.250 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5129.g0ecbb435.el9.x86_6 13/35 2024-09-21T17:37:18.292 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-21T17:37:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-21T17:37:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-21T17:37:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-21T17:37:18.517 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-21T17:37:18.546 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-21T17:37:18.579 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-21T17:37:18.617 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-21T17:37:18.942 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-21T17:37:18.985 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.3.0-5129.g0ecbb435.el9.x86_64 23/35 2024-09-21T17:37:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.3.0-5129.g0ecbb435.el9.x86_64 23/35 2024-09-21T17:37:19.106 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 24/35 2024-09-21T17:37:19.151 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-21T17:37:19.656 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-21T17:37:19.687 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.3.0-5129.g0ecbb435.el9.x86_64 27/35 2024-09-21T17:37:19.759 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.3.0-5129.g0ecbb435.el9.x86_64 27/35 2024-09-21T17:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 28/35 2024-09-21T17:37:20.064 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.3.0-5129.g0ecbb435.el9.x8 29/35 2024-09-21T17:37:22.404 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 30/35 2024-09-21T17:37:22.445 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 30/35 2024-09-21T17:37:23.025 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 30/35 2024-09-21T17:37:23.073 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.3.0-5129.g0ecbb435.el9.x86_64 31/35 2024-09-21T17:37:23.172 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.3.0-5129.g0ecbb435.el9.x86_64 31/35 2024-09-21T17:37:23.173 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T17:37:23.173 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T17:37:23.173 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:23.208 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.3.0-5129.g0ecbb435.el9.x86_64 32/35 2024-09-21T17:37:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5129.g0ecbb435.el9.x86_64 32/35 2024-09-21T17:37:27.371 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-09-21T17:37:27.371 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-09-21T17:37:27.371 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-09-21T17:37:27.371 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-09-21T17:37:27.371 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-09-21T17:37:27.371 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-09-21T17:37:27.371 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-09-21T17:37:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:28.433 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 33/35 2024-09-21T17:37:28.460 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 33/35 2024-09-21T17:37:28.460 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:37:28.460 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T17:37:28.460 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T17:37:28.460 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T17:37:28.460 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:28.462 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T17:37:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T17:37:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T17:37:29.885 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T17:37:29.885 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/35 2024-09-21T17:37:29.885 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 2/35 2024-09-21T17:37:29.885 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 3/35 2024-09-21T17:37:29.885 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.3.0-5129.g0ecbb435.el9.x86_64 4/35 2024-09-21T17:37:29.885 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.3.0-5129.g0ecbb435.el9.x86_64 5/35 2024-09-21T17:37:29.885 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.3.0-5129.g0ecbb435.el9.x86_6 6/35 2024-09-21T17:37:29.885 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.3.0-5129.g0ecbb435.el9.x86_64 7/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5129.g0ecbb435.el9. 8/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.3.0-5129.g0ecbb435.el9.x8 9/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.3.0-5129.g0ecbb435.el9.x86_64 10/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.3.0-5129.g0ecbb435.el9.x86_64 11/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 12/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 13/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-21T17:37:29.886 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.3.0-5129.g0ecbb435.el9.x86_64 32/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-21T17:37:29.887 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.3.0-5129.g0ecbb435.el9.x86_64 34/35 2024-09-21T17:37:30.749 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T17:37:30.749 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:30.749 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-09-21T17:37:30.749 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.749 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.749 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:37:30.749 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T17:37:30.749 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.749 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.749 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T17:37:30.750 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T17:37:30.751 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T17:37:30.752 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T17:37:30.752 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:37:31.104 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-test 2024-09-21T17:37:31.713 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:28 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:37:31.850 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:37:31.851 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:31.851 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-21T17:37:31.851 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:31.851 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:37:31.851 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 46 M 2024-09-21T17:37:31.851 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-21T17:37:31.851 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 161 k 2024-09-21T17:37:31.851 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T17:37:31.851 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T17:37:31.851 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:31.852 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:37:31.852 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:31.852 INFO:teuthology.orchestra.run.smithi042.stdout:Install 4 Packages 2024-09-21T17:37:31.852 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:31.852 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 46 M 2024-09-21T17:37:31.852 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 201 M 2024-09-21T17:37:31.852 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:37:32.189 INFO:teuthology.orchestra.run.smithi042.stdout:(1/4): libcephsqlite-19.3.0-5129.g0ecbb435.el9. 760 kB/s | 161 kB 00:00 2024-09-21T17:37:32.764 INFO:teuthology.orchestra.run.smithi042.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 386 kB/s | 304 kB 00:00 2024-09-21T17:37:32.856 INFO:teuthology.orchestra.run.smithi042.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 96 kB/s | 64 kB 00:00 2024-09-21T17:37:33.162 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5129.g0ecbb435.el9.x86_64 32/35 2024-09-21T17:37:33.162 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-21T17:37:33.162 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-21T17:37:33.162 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-21T17:37:33.162 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-21T17:37:33.162 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-21T17:37:33.162 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-21T17:37:33.162 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-21T17:37:33.162 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:33.415 INFO:teuthology.orchestra.run.smithi042.stdout:(4/4): ceph-test-19.3.0-5129.g0ecbb435.el9.x86_ 32 MB/s | 46 MB 00:01 2024-09-21T17:37:33.417 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:37:33.417 INFO:teuthology.orchestra.run.smithi042.stdout:Total 29 MB/s | 46 MB 00:01 2024-09-21T17:37:33.445 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:37:33.469 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:37:33.469 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:37:33.867 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:37:33.867 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:37:34.193 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 33/35 2024-09-21T17:37:34.218 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 33/35 2024-09-21T17:37:34.219 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:37:34.219 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T17:37:34.219 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T17:37:34.219 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T17:37:34.219 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:34.221 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T17:37:34.304 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T17:37:34.304 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T17:37:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:37:34.537 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T17:37:34.589 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T17:37:34.617 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.3.0-5129.g0ecbb435.el9.x86_64 3/4 2024-09-21T17:37:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T17:37:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/35 2024-09-21T17:37:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 2/35 2024-09-21T17:37:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 3/35 2024-09-21T17:37:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.3.0-5129.g0ecbb435.el9.x86_64 4/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.3.0-5129.g0ecbb435.el9.x86_64 5/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.3.0-5129.g0ecbb435.el9.x86_6 6/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.3.0-5129.g0ecbb435.el9.x86_64 7/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5129.g0ecbb435.el9. 8/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.3.0-5129.g0ecbb435.el9.x8 9/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.3.0-5129.g0ecbb435.el9.x86_64 10/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.3.0-5129.g0ecbb435.el9.x86_64 11/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 12/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 13/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-21T17:37:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-21T17:37:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-21T17:37:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-21T17:37:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-21T17:37:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-21T17:37:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-21T17:37:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-21T17:37:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-21T17:37:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-21T17:37:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-21T17:37:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-21T17:37:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-21T17:37:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-21T17:37:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.3.0-5129.g0ecbb435.el9.x86_64 32/35 2024-09-21T17:37:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-21T17:37:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.3.0-5129.g0ecbb435.el9.x86_64 34/35 2024-09-21T17:37:36.317 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T17:37:36.317 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:36.317 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-21T17:37:36.317 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.317 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.317 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:37:36.317 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T17:37:36.317 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.318 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T17:37:36.319 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.319 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T17:37:36.319 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T17:37:36.319 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T17:37:36.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T17:37:36.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:36.320 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T17:37:36.320 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T17:37:36.320 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T17:37:36.320 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T17:37:36.320 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T17:37:36.320 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:36.320 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:37:36.683 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-test 2024-09-21T17:37:37.268 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:28 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:37:37.398 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:37:37.398 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 46 M 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 161 k 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout:Install 4 Packages 2024-09-21T17:37:37.399 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:37.400 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 46 M 2024-09-21T17:37:37.400 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 201 M 2024-09-21T17:37:37.400 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:37:37.721 INFO:teuthology.orchestra.run.smithi162.stdout:(1/4): libcephsqlite-19.3.0-5129.g0ecbb435.el9. 741 kB/s | 161 kB 00:00 2024-09-21T17:37:38.096 INFO:teuthology.orchestra.run.smithi162.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 170 kB/s | 64 kB 00:00 2024-09-21T17:37:38.138 INFO:teuthology.orchestra.run.smithi162.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 479 kB/s | 304 kB 00:00 2024-09-21T17:37:38.929 INFO:teuthology.orchestra.run.smithi162.stdout:(4/4): ceph-test-19.3.0-5129.g0ecbb435.el9.x86_ 32 MB/s | 46 MB 00:01 2024-09-21T17:37:38.931 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:37:38.932 INFO:teuthology.orchestra.run.smithi162.stdout:Total 30 MB/s | 46 MB 00:01 2024-09-21T17:37:38.959 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:37:38.979 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:37:38.979 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:37:39.241 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5129.g0ecbb435.el9.x86_64 3/4 2024-09-21T17:37:39.336 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.3.0-5129.g0ecbb435.el9.x86_64 4/4 2024-09-21T17:37:39.357 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:37:39.358 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:37:39.868 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:37:39.969 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T17:37:40.020 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T17:37:40.048 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.3.0-5129.g0ecbb435.el9.x86_64 3/4 2024-09-21T17:37:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-test-2:19.3.0-5129.g0ecbb435.el9.x86_64 4/4 2024-09-21T17:37:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/4 2024-09-21T17:37:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.3.0-5129.g0ecbb435.el9.x86_64 2/4 2024-09-21T17:37:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T17:37:42.075 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T17:37:42.076 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:42.076 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:37:42.076 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:42.076 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:42.076 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T17:37:42.076 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T17:37:42.076 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:42.076 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:37:42.335 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph 2024-09-21T17:37:42.938 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:39 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:37:43.076 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:37:43.078 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:43.078 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-21T17:37:43.078 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 6.6 k 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 2.4 M 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 1.5 M 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 293 k 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 4.8 M 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 17 M 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T17:37:43.079 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T17:37:43.080 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:43.081 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:37:43.082 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:43.082 INFO:teuthology.orchestra.run.smithi042.stdout:Install 37 Packages 2024-09-21T17:37:43.082 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:43.082 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 31 M 2024-09-21T17:37:43.082 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 109 M 2024-09-21T17:37:43.082 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:37:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:(1/37): ceph-19.3.0-5129.g0ecbb435.el9.x86_64.r 47 kB/s | 6.6 kB 00:00 2024-09-21T17:37:43.960 INFO:teuthology.orchestra.run.smithi042.stdout:(2/37): ceph-mgr-19.3.0-5129.g0ecbb435.el9.x86_ 4.9 MB/s | 1.5 MB 00:00 2024-09-21T17:37:44.010 INFO:teuthology.orchestra.run.smithi042.stdout:(3/37): ceph-mds-19.3.0-5129.g0ecbb435.el9.x86_ 6.5 MB/s | 2.4 MB 00:00 2024-09-21T17:37:44.085 INFO:teuthology.orchestra.run.smithi042.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5129.g0ecb 3.8 MB/s | 293 kB 00:00 2024-09-21T17:37:44.227 INFO:teuthology.orchestra.run.smithi042.stdout:(5/37): ceph-mon-19.3.0-5129.g0ecbb435.el9.x86_ 11 MB/s | 4.8 MB 00:00 2024-09-21T17:37:44.336 INFO:teuthology.orchestra.run.smithi042.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-21T17:37:44.418 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5129.g0ecbb435.el9.x86_64 3/4 2024-09-21T17:37:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.3.0-5129.g0ecbb435.el9.x86_64 4/4 2024-09-21T17:37:44.544 INFO:teuthology.orchestra.run.smithi042.stdout:(7/37): ceph-osd-19.3.0-5129.g0ecbb435.el9.x86_ 29 MB/s | 17 MB 00:00 2024-09-21T17:37:44.570 INFO:teuthology.orchestra.run.smithi042.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 456 kB/s | 106 kB 00:00 2024-09-21T17:37:44.645 INFO:teuthology.orchestra.run.smithi042.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.6 MB/s | 125 kB 00:00 2024-09-21T17:37:44.729 INFO:teuthology.orchestra.run.smithi042.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-21T17:37:44.754 INFO:teuthology.orchestra.run.smithi042.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 647 kB/s | 135 kB 00:00 2024-09-21T17:37:44.821 INFO:teuthology.orchestra.run.smithi042.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 2.1 MB/s | 1.2 MB 00:00 2024-09-21T17:37:45.004 INFO:teuthology.orchestra.run.smithi042.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 190 kB/s | 35 kB 00:00 2024-09-21T17:37:45.071 INFO:teuthology.orchestra.run.smithi042.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 551 kB/s | 188 kB 00:00 2024-09-21T17:37:45.122 INFO:teuthology.orchestra.run.smithi042.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 469 kB/s | 172 kB 00:00 2024-09-21T17:37:45.147 INFO:teuthology.orchestra.run.smithi042.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 678 kB/s | 51 kB 00:00 2024-09-21T17:37:45.172 INFO:teuthology.orchestra.run.smithi042.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 461 kB/s | 77 kB 00:00 2024-09-21T17:37:45.206 INFO:teuthology.orchestra.run.smithi042.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 497 kB/s | 42 kB 00:00 2024-09-21T17:37:45.239 INFO:teuthology.orchestra.run.smithi042.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-21T17:37:45.273 INFO:teuthology.orchestra.run.smithi042.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.4 MB/s | 172 kB 00:00 2024-09-21T17:37:45.298 INFO:teuthology.orchestra.run.smithi042.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 147 kB/s | 22 kB 00:00 2024-09-21T17:37:45.323 INFO:teuthology.orchestra.run.smithi042.stdout:(22/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 377 kB/s | 43 kB 00:00 2024-09-21T17:37:45.359 INFO:teuthology.orchestra.run.smithi042.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 303 kB/s | 11 kB 00:00 2024-09-21T17:37:45.385 INFO:teuthology.orchestra.run.smithi042.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 1.0 MB/s | 23 kB 00:00 2024-09-21T17:37:45.410 INFO:teuthology.orchestra.run.smithi042.stdout:(25/37): python3-jaraco-classes-3.2.1-5.el9.noa 206 kB/s | 18 kB 00:00 2024-09-21T17:37:45.435 INFO:teuthology.orchestra.run.smithi042.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-09-21T17:37:45.460 INFO:teuthology.orchestra.run.smithi042.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-09-21T17:37:45.486 INFO:teuthology.orchestra.run.smithi042.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-21T17:37:45.511 INFO:teuthology.orchestra.run.smithi042.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T17:37:45.536 INFO:teuthology.orchestra.run.smithi042.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-21T17:37:45.553 INFO:teuthology.orchestra.run.smithi042.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 392 kB/s | 16 kB 00:00 2024-09-21T17:37:45.578 INFO:teuthology.orchestra.run.smithi042.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-21T17:37:45.604 INFO:teuthology.orchestra.run.smithi042.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-09-21T17:37:45.637 INFO:teuthology.orchestra.run.smithi042.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-21T17:37:45.663 INFO:teuthology.orchestra.run.smithi042.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T17:37:45.688 INFO:teuthology.orchestra.run.smithi042.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 398 kB/s | 20 kB 00:00 2024-09-21T17:37:45.713 INFO:teuthology.orchestra.run.smithi042.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-21T17:37:45.718 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:37:45.718 INFO:teuthology.orchestra.run.smithi042.stdout:Total 12 MB/s | 31 MB 00:02 2024-09-21T17:37:45.877 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:37:45.921 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:37:45.921 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:37:46.431 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:37:46.432 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:37:46.943 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-test-2:19.3.0-5129.g0ecbb435.el9.x86_64 4/4 2024-09-21T17:37:46.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/4 2024-09-21T17:37:46.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.3.0-5129.g0ecbb435.el9.x86_64 2/4 2024-09-21T17:37:46.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T17:37:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T17:37:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:47.375 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:37:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T17:37:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T17:37:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:47.375 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:37:47.648 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph 2024-09-21T17:37:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:37:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T17:37:48.009 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T17:37:48.043 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T17:37:48.120 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T17:37:48.239 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:39 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:37:48.306 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T17:37:48.342 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T17:37:48.371 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:37:48.373 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:37:48.373 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T17:37:48.373 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:37:48.373 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:37:48.373 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 6.6 k 2024-09-21T17:37:48.373 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 2.4 M 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 1.5 M 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 293 k 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 4.8 M 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 17 M 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T17:37:48.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T17:37:48.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout:Install 37 Packages 2024-09-21T17:37:48.376 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:48.377 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 31 M 2024-09-21T17:37:48.377 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 109 M 2024-09-21T17:37:48.377 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:37:48.440 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T17:37:48.516 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T17:37:48.562 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T17:37:48.597 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T17:37:48.634 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T17:37:48.669 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T17:37:48.702 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T17:37:48.744 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T17:37:48.795 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T17:37:48.829 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T17:37:48.887 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T17:37:48.927 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T17:37:48.937 INFO:teuthology.orchestra.run.smithi162.stdout:(1/37): ceph-19.3.0-5129.g0ecbb435.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-21T17:37:49.003 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T17:37:49.121 INFO:teuthology.orchestra.run.smithi162.stdout:(2/37): ceph-mgr-19.3.0-5129.g0ecbb435.el9.x86_ 4.8 MB/s | 1.5 MB 00:00 2024-09-21T17:37:49.158 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T17:37:49.163 INFO:teuthology.orchestra.run.smithi162.stdout:(3/37): ceph-mds-19.3.0-5129.g0ecbb435.el9.x86_ 6.7 MB/s | 2.4 MB 00:00 2024-09-21T17:37:49.230 INFO:teuthology.orchestra.run.smithi162.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5129.g0ecb 4.3 MB/s | 293 kB 00:00 2024-09-21T17:37:49.239 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T17:37:49.297 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T17:37:49.385 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T17:37:49.422 INFO:teuthology.orchestra.run.smithi162.stdout:(5/37): ceph-mon-19.3.0-5129.g0ecbb435.el9.x86_ 9.9 MB/s | 4.8 MB 00:00 2024-09-21T17:37:49.444 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T17:37:49.508 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T17:37:49.556 INFO:teuthology.orchestra.run.smithi162.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 779 kB/s | 253 kB 00:00 2024-09-21T17:37:49.704 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T17:37:49.731 INFO:teuthology.orchestra.run.smithi162.stdout:(7/37): ceph-osd-19.3.0-5129.g0ecbb435.el9.x86_ 28 MB/s | 17 MB 00:00 2024-09-21T17:37:49.755 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T17:37:49.756 INFO:teuthology.orchestra.run.smithi162.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 532 kB/s | 106 kB 00:00 2024-09-21T17:37:49.815 INFO:teuthology.orchestra.run.smithi162.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-21T17:37:49.845 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T17:37:49.874 INFO:teuthology.orchestra.run.smithi162.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-21T17:37:49.908 INFO:teuthology.orchestra.run.smithi162.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 2.5 MB/s | 1.2 MB 00:00 2024-09-21T17:37:49.933 INFO:teuthology.orchestra.run.smithi162.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 672 kB/s | 135 kB 00:00 2024-09-21T17:37:49.943 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T17:37:49.988 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T17:37:50.125 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T17:37:50.225 INFO:teuthology.orchestra.run.smithi162.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 119 kB/s | 35 kB 00:00 2024-09-21T17:37:50.312 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5129.g0ecbb435.el9. 32/37 2024-09-21T17:37:50.348 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.3.0-5129.g0ecbb435.el9.x86_64 33/37 2024-09-21T17:37:50.375 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5129.g0ecbb435.el9.x86_64 33/37 2024-09-21T17:37:50.376 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:37:50.376 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T17:37:50.376 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T17:37:50.376 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T17:37:50.376 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:50.458 INFO:teuthology.orchestra.run.smithi162.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 322 kB/s | 188 kB 00:00 2024-09-21T17:37:50.483 INFO:teuthology.orchestra.run.smithi162.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 299 kB/s | 172 kB 00:00 2024-09-21T17:37:50.509 INFO:teuthology.orchestra.run.smithi162.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 272 kB/s | 77 kB 00:00 2024-09-21T17:37:50.568 INFO:teuthology.orchestra.run.smithi162.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 468 kB/s | 51 kB 00:00 2024-09-21T17:37:50.585 INFO:teuthology.orchestra.run.smithi162.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-09-21T17:37:50.618 INFO:teuthology.orchestra.run.smithi162.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 310 kB/s | 42 kB 00:00 2024-09-21T17:37:50.651 INFO:teuthology.orchestra.run.smithi162.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 650 kB/s | 43 kB 00:00 2024-09-21T17:37:50.677 INFO:teuthology.orchestra.run.smithi162.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-21T17:37:50.702 INFO:teuthology.orchestra.run.smithi162.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 431 kB/s | 11 kB 00:00 2024-09-21T17:37:50.727 INFO:teuthology.orchestra.run.smithi162.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 711 kB/s | 18 kB 00:00 2024-09-21T17:37:50.753 INFO:teuthology.orchestra.run.smithi162.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-21T17:37:50.778 INFO:teuthology.orchestra.run.smithi162.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-21T17:37:50.803 INFO:teuthology.orchestra.run.smithi162.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-21T17:37:50.829 INFO:teuthology.orchestra.run.smithi162.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-21T17:37:50.854 INFO:teuthology.orchestra.run.smithi162.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-21T17:37:50.879 INFO:teuthology.orchestra.run.smithi162.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-09-21T17:37:50.905 INFO:teuthology.orchestra.run.smithi162.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-21T17:37:50.930 INFO:teuthology.orchestra.run.smithi162.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 662 kB/s | 16 kB 00:00 2024-09-21T17:37:50.956 INFO:teuthology.orchestra.run.smithi162.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-21T17:37:50.981 INFO:teuthology.orchestra.run.smithi162.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-21T17:37:51.006 INFO:teuthology.orchestra.run.smithi162.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-21T17:37:51.031 INFO:teuthology.orchestra.run.smithi162.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 801 kB/s | 20 kB 00:00 2024-09-21T17:37:51.057 INFO:teuthology.orchestra.run.smithi162.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T17:37:51.090 INFO:teuthology.orchestra.run.smithi162.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-21T17:37:51.094 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:37:51.094 INFO:teuthology.orchestra.run.smithi162.stdout:Total 11 MB/s | 31 MB 00:02 2024-09-21T17:37:51.239 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:37:51.280 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:37:51.280 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:37:51.738 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:37:51.739 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:37:51.923 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.3.0-5129.g0ecbb435.el9.x86_64 34/37 2024-09-21T17:37:51.953 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.3.0-5129.g0ecbb435.el9.x86_64 34/37 2024-09-21T17:37:51.954 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:37:51.954 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T17:37:51.954 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T17:37:51.954 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T17:37:51.954 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.3.0-5129.g0ecbb435.el9.x86_64 35/37 2024-09-21T17:37:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.3.0-5129.g0ecbb435.el9.x86_64 35/37 2024-09-21T17:37:52.458 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:37:52.458 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T17:37:52.458 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T17:37:52.458 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T17:37:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:52.700 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.3.0-5129.g0ecbb435.el9.x86_64 36/37 2024-09-21T17:37:52.725 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.3.0-5129.g0ecbb435.el9.x86_64 36/37 2024-09-21T17:37:52.725 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:37:52.725 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T17:37:52.725 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T17:37:52.725 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T17:37:52.725 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:52.791 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.3.0-5129.g0ecbb435.el9.x86_64 37/37 2024-09-21T17:37:53.044 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:37:53.101 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T17:37:53.149 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T17:37:53.178 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T17:37:53.249 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T17:37:53.294 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T17:37:53.335 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T17:37:53.427 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T17:37:53.522 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T17:37:53.572 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T17:37:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T17:37:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T17:37:53.671 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T17:37:53.705 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T17:37:53.745 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T17:37:53.789 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T17:37:53.823 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T17:37:53.872 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T17:37:53.912 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T17:37:53.985 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T17:37:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T17:37:54.213 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T17:37:54.265 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T17:37:54.304 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T17:37:54.361 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T17:37:54.433 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T17:37:54.618 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T17:37:54.667 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T17:37:54.685 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-2:19.3.0-5129.g0ecbb435.el9.x86_64 37/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.3.0-5129.g0ecbb435.el9.x86_64 2/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.3.0-5129.g0ecbb435.el9.x86_64 3/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.3.0-5129.g0ecbb435.el9.x86_64 4/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.3.0-5129.g0ecbb435.el9.x86_64 5/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5129.g0ecbb435.el9. 6/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T17:37:54.686 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T17:37:54.687 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T17:37:54.688 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T17:37:54.688 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T17:37:54.688 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T17:37:54.688 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T17:37:54.688 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T17:37:54.688 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T17:37:54.688 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T17:37:54.688 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T17:37:54.688 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T17:37:54.688 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T17:37:54.688 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T17:37:54.736 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T17:37:54.825 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T17:37:54.879 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T17:37:55.012 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T17:37:55.172 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5129.g0ecbb435.el9. 32/37 2024-09-21T17:37:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.3.0-5129.g0ecbb435.el9.x86_64 33/37 2024-09-21T17:37:55.235 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5129.g0ecbb435.el9.x86_64 33/37 2024-09-21T17:37:55.236 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:37:55.236 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T17:37:55.236 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T17:37:55.236 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T17:37:55.236 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:55.646 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T17:37:55.646 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:55.646 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:37:55.646 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:55.646 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T17:37:55.647 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T17:37:55.648 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T17:37:55.649 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T17:37:55.649 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T17:37:55.649 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T17:37:55.649 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T17:37:55.649 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T17:37:55.649 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T17:37:55.649 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:55.649 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:37:56.075 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-base 2024-09-21T17:37:56.687 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:37:56.703 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.3.0-5129.g0ecbb435.el9.x86_64 34/37 2024-09-21T17:37:56.731 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.3.0-5129.g0ecbb435.el9.x86_64 34/37 2024-09-21T17:37:56.731 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:37:56.731 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T17:37:56.731 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T17:37:56.731 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T17:37:56.731 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:56.779 INFO:teuthology.orchestra.run.smithi042.stdout:Package ceph-base-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:37:56.824 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:37:56.825 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-09-21T17:37:56.825 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:37:56.906 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install cephadm 2024-09-21T17:37:57.187 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.3.0-5129.g0ecbb435.el9.x86_64 35/37 2024-09-21T17:37:57.211 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.3.0-5129.g0ecbb435.el9.x86_64 35/37 2024-09-21T17:37:57.211 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:37:57.211 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T17:37:57.211 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T17:37:57.212 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T17:37:57.212 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:57.446 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.3.0-5129.g0ecbb435.el9.x86_64 36/37 2024-09-21T17:37:57.470 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.3.0-5129.g0ecbb435.el9.x86_64 36/37 2024-09-21T17:37:57.470 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:37:57.470 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T17:37:57.470 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T17:37:57.470 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T17:37:57.471 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:37:57.511 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:37:57.535 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.3.0-5129.g0ecbb435.el9.x86_64 37/37 2024-09-21T17:37:57.649 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:37:57.650 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:57.650 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-21T17:37:57.650 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:57.650 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:37:57.650 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 784 k 2024-09-21T17:37:57.650 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:57.650 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:37:57.650 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:37:57.650 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-09-21T17:37:57.650 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:57.651 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 784 k 2024-09-21T17:37:57.651 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 791 k 2024-09-21T17:37:57.651 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:37:57.924 INFO:teuthology.orchestra.run.smithi042.stdout:cephadm-19.3.0-5129.g0ecbb435.el9.noarch.rpm 2.8 MB/s | 784 kB 00:00 2024-09-21T17:37:57.924 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:37:57.925 INFO:teuthology.orchestra.run.smithi042.stdout:Total 2.8 MB/s | 784 kB 00:00 2024-09-21T17:37:57.925 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:37:57.931 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:37:57.931 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:37:57.937 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:37:57.937 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:37:58.010 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:37:58.410 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:37:58.498 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:37:58.849 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:37:59.125 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:37:59.126 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:59.126 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:37:59.126 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:37:59.126 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:37:59.126 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:37:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-2:19.3.0-5129.g0ecbb435.el9.x86_64 37/37 2024-09-21T17:37:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/37 2024-09-21T17:37:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.3.0-5129.g0ecbb435.el9.x86_64 2/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.3.0-5129.g0ecbb435.el9.x86_64 3/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.3.0-5129.g0ecbb435.el9.x86_64 4/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.3.0-5129.g0ecbb435.el9.x86_64 5/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5129.g0ecbb435.el9. 6/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T17:37:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T17:37:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T17:37:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T17:37:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T17:37:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T17:37:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T17:37:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T17:37:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T17:37:59.350 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T17:37:59.956 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:38:00.092 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:38:00.093 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:00.093 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-09-21T17:38:00.093 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:00.093 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:38:00.093 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 145 k 2024-09-21T17:38:00.093 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:00.093 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:38:00.093 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:00.094 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-09-21T17:38:00.094 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:00.094 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 145 k 2024-09-21T17:38:00.094 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 432 k 2024-09-21T17:38:00.094 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:38:00.288 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-immutable-object-cache-19.3.0-5129.g0ecbb4 747 kB/s | 145 kB 00:00 2024-09-21T17:38:00.289 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:00.289 INFO:teuthology.orchestra.run.smithi042.stdout:Total 742 kB/s | 145 kB 00:00 2024-09-21T17:38:00.289 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:38:00.298 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:38:00.298 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:38:00.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T17:38:00.341 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:00.341 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T17:38:00.342 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T17:38:00.343 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:00.344 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:38:00.359 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:38:00.508 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:38:00.573 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5129.g0ecbb435. 1/1 2024-09-21T17:38:00.599 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5129.g0ecbb435. 1/1 2024-09-21T17:38:00.599 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:38:00.599 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T17:38:00.599 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:00.747 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-base 2024-09-21T17:38:01.337 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:01.426 INFO:teuthology.orchestra.run.smithi162.stdout:Package ceph-base-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:38:01.467 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:01.468 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T17:38:01.469 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:01.549 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install cephadm 2024-09-21T17:38:01.586 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5129.g0ecbb435. 1/1 2024-09-21T17:38:01.586 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:01.586 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:38:01.586 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:38:01.586 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:01.587 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:38:01.805 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr 2024-09-21T17:38:02.132 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:02.263 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:02.264 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:02.264 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T17:38:02.264 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:02.264 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:02.264 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 784 k 2024-09-21T17:38:02.264 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:02.264 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:02.264 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:02.264 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T17:38:02.264 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:02.264 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 784 k 2024-09-21T17:38:02.265 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 791 k 2024-09-21T17:38:02.265 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:02.412 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:38:02.505 INFO:teuthology.orchestra.run.smithi042.stdout:Package ceph-mgr-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:38:02.548 INFO:teuthology.orchestra.run.smithi162.stdout:cephadm-19.3.0-5129.g0ecbb435.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-21T17:38:02.549 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:02.549 INFO:teuthology.orchestra.run.smithi162.stdout:Total 2.7 MB/s | 784 kB 00:00 2024-09-21T17:38:02.549 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:02.550 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:38:02.551 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-09-21T17:38:02.551 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:38:02.555 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:02.555 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:02.561 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:02.561 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:02.633 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T17:38:02.633 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:03.091 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:38:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:38:03.241 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:38:03.379 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:38:03.380 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-21T17:38:03.381 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:03.381 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:38:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 14 M 2024-09-21T17:38:03.381 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-21T17:38:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T17:38:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 34 k 2024-09-21T17:38:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 16 k 2024-09-21T17:38:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T17:38:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T17:38:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T17:38:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T17:38:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T17:38:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T17:38:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T17:38:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T17:38:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:03.382 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:38:03.382 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:03.382 INFO:teuthology.orchestra.run.smithi042.stdout:Install 12 Packages 2024-09-21T17:38:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:03.383 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 19 M 2024-09-21T17:38:03.383 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 159 M 2024-09-21T17:38:03.383 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:38:03.550 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:38:03.798 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:38:03.798 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:03.798 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:03.798 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:03.798 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:03.798 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:03.926 INFO:teuthology.orchestra.run.smithi042.stdout:(1/12): ceph-grafana-dashboards-19.3.0-5129.g0e 240 kB/s | 34 kB 00:00 2024-09-21T17:38:03.943 INFO:teuthology.orchestra.run.smithi042.stdout:(2/12): ceph-prometheus-alerts-19.3.0-5129.g0ec 103 kB/s | 16 kB 00:00 2024-09-21T17:38:04.046 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T17:38:04.418 INFO:teuthology.orchestra.run.smithi042.stdout:(3/12): ceph-mgr-dashboard-19.3.0-5129.g0ecbb43 22 MB/s | 14 MB 00:00 2024-09-21T17:38:04.444 INFO:teuthology.orchestra.run.smithi042.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 538 kB/s | 269 kB 00:00 2024-09-21T17:38:04.494 INFO:teuthology.orchestra.run.smithi042.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-21T17:38:04.510 INFO:teuthology.orchestra.run.smithi042.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-21T17:38:04.594 INFO:teuthology.orchestra.run.smithi042.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 24 MB/s | 2.0 MB 00:00 2024-09-21T17:38:04.628 INFO:teuthology.orchestra.run.smithi042.stdout:(8/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.4 MB/s | 1.0 MB 00:00 2024-09-21T17:38:04.634 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:04.662 INFO:teuthology.orchestra.run.smithi042.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2024-09-21T17:38:04.687 INFO:teuthology.orchestra.run.smithi042.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 525 kB/s | 31 kB 00:00 2024-09-21T17:38:04.712 INFO:teuthology.orchestra.run.smithi042.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.8 MB/s | 188 kB 00:00 2024-09-21T17:38:04.737 INFO:teuthology.orchestra.run.smithi042.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.6 MB/s | 863 kB 00:00 2024-09-21T17:38:04.741 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:04.742 INFO:teuthology.orchestra.run.smithi042.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-21T17:38:04.768 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:04.769 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:04.769 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repo Size 2024-09-21T17:38:04.769 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:04.769 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:04.769 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 145 k 2024-09-21T17:38:04.769 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:04.769 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:04.769 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:04.770 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T17:38:04.770 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:04.770 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 145 k 2024-09-21T17:38:04.770 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 432 k 2024-09-21T17:38:04.771 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:04.795 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:38:04.817 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:38:04.817 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:38:04.989 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-immutable-object-cache-19.3.0-5129.g0ecbb4 666 kB/s | 145 kB 00:00 2024-09-21T17:38:04.989 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:04.990 INFO:teuthology.orchestra.run.smithi162.stdout:Total 660 kB/s | 145 kB 00:00 2024-09-21T17:38:04.990 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:04.997 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:04.997 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:05.055 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:05.055 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:05.102 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:38:05.102 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:38:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:05.298 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5129.g0ecbb435. 1/1 2024-09-21T17:38:05.324 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5129.g0ecbb435. 1/1 2024-09-21T17:38:05.324 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:38:05.324 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T17:38:05.324 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:05.704 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:38:05.797 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T17:38:05.840 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T17:38:05.887 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T17:38:05.916 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T17:38:06.011 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T17:38:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T17:38:06.248 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T17:38:06.263 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5129.g0ecbb435. 1/1 2024-09-21T17:38:06.264 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:06.264 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:06.264 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:38:06.264 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:06.264 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:06.297 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T17:38:06.325 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T17:38:06.357 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5129.g0ecbb435.el9 10/12 2024-09-21T17:38:06.559 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-mgr 2024-09-21T17:38:07.152 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:07.241 INFO:teuthology.orchestra.run.smithi162.stdout:Package ceph-mgr-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:38:07.283 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:07.284 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T17:38:07.284 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:07.368 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T17:38:07.944 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:08.076 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:08.077 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:08.077 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 14 M 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 34 k 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 16 k 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T17:38:08.078 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T17:38:08.079 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T17:38:08.079 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T17:38:08.079 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:08.079 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:08.079 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:08.079 INFO:teuthology.orchestra.run.smithi162.stdout:Install 12 Packages 2024-09-21T17:38:08.079 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:08.080 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 19 M 2024-09-21T17:38:08.080 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 159 M 2024-09-21T17:38:08.080 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:08.527 INFO:teuthology.orchestra.run.smithi162.stdout:(1/12): ceph-grafana-dashboards-19.3.0-5129.g0e 237 kB/s | 34 kB 00:00 2024-09-21T17:38:08.552 INFO:teuthology.orchestra.run.smithi162.stdout:(2/12): ceph-prometheus-alerts-19.3.0-5129.g0ec 97 kB/s | 16 kB 00:00 2024-09-21T17:38:09.036 INFO:teuthology.orchestra.run.smithi162.stdout:(3/12): ceph-mgr-dashboard-19.3.0-5129.g0ecbb43 22 MB/s | 14 MB 00:00 2024-09-21T17:38:09.194 INFO:teuthology.orchestra.run.smithi162.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 5.3 MB/s | 863 kB 00:00 2024-09-21T17:38:09.220 INFO:teuthology.orchestra.run.smithi162.stdout:(5/12): python3-protobuf-3.14.0-13.el9.noarch.r 403 kB/s | 269 kB 00:00 2024-09-21T17:38:09.270 INFO:teuthology.orchestra.run.smithi162.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-09-21T17:38:09.295 INFO:teuthology.orchestra.run.smithi162.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 5.3 MB/s | 548 kB 00:00 2024-09-21T17:38:09.354 INFO:teuthology.orchestra.run.smithi162.stdout:(8/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.2 MB/s | 1.0 MB 00:00 2024-09-21T17:38:09.379 INFO:teuthology.orchestra.run.smithi162.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.7 MB/s | 144 kB 00:00 2024-09-21T17:38:09.404 INFO:teuthology.orchestra.run.smithi162.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 610 kB/s | 31 kB 00:00 2024-09-21T17:38:09.480 INFO:teuthology.orchestra.run.smithi162.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.7 MB/s | 2.0 MB 00:00 2024-09-21T17:38:09.505 INFO:teuthology.orchestra.run.smithi162.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.5 MB/s | 188 kB 00:00 2024-09-21T17:38:09.509 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:09.509 INFO:teuthology.orchestra.run.smithi162.stdout:Total 13 MB/s | 19 MB 00:01 2024-09-21T17:38:09.557 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:09.576 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:09.576 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:09.748 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5129.g0ecbb435.el 11/12 2024-09-21T17:38:09.803 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5129.g0ecbb435.el9.noa 12/12 2024-09-21T17:38:09.849 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:09.849 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:10.466 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:10.547 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T17:38:10.591 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T17:38:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T17:38:10.668 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T17:38:10.759 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T17:38:10.886 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T17:38:10.980 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T17:38:11.040 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T17:38:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T17:38:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5129.g0ecbb435.el9 10/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5129.g0ecbb435.el9.noa 12/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5129.g0ecbb435.el 1/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5129.g0ecbb435.el9.noa 2/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5129.g0ecbb435.el9 3/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T17:38:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T17:38:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T17:38:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:12.135 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:38:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T17:38:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T17:38:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T17:38:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T17:38:12.136 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T17:38:12.136 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T17:38:12.136 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T17:38:12.136 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T17:38:12.136 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T17:38:12.136 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:12.136 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:38:12.366 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T17:38:12.985 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:09 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:38:13.129 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:38:13.130 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-09-21T17:38:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 7.4 M 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T17:38:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T17:38:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T17:38:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T17:38:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:13.132 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:38:13.132 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-09-21T17:38:13.132 INFO:teuthology.orchestra.run.smithi042.stdout:Install 12 Packages 2024-09-21T17:38:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:13.132 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 38 M 2024-09-21T17:38:13.133 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 212 M 2024-09-21T17:38:13.133 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:38:13.414 INFO:teuthology.orchestra.run.smithi042.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 833 kB/s | 191 kB 00:00 2024-09-21T17:38:13.537 INFO:teuthology.orchestra.run.smithi042.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-21T17:38:13.753 INFO:teuthology.orchestra.run.smithi042.stdout:(3/12): ceph-mgr-diskprediction-local-19.3.0-51 13 MB/s | 7.4 MB 00:00 2024-09-21T17:38:13.779 INFO:teuthology.orchestra.run.smithi042.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 89 kB/s | 33 kB 00:00 2024-09-21T17:38:13.987 INFO:teuthology.orchestra.run.smithi042.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 184 kB/s | 38 kB 00:00 2024-09-21T17:38:14.037 INFO:teuthology.orchestra.run.smithi042.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 64 kB/s | 18 kB 00:00 2024-09-21T17:38:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5129.g0ecbb435.el 11/12 2024-09-21T17:38:14.356 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5129.g0ecbb435.el9.noa 12/12 2024-09-21T17:38:14.504 INFO:teuthology.orchestra.run.smithi042.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 524 kB/s | 245 kB 00:00 2024-09-21T17:38:14.571 INFO:teuthology.orchestra.run.smithi042.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.9 MB/s | 3.0 MB 00:01 2024-09-21T17:38:14.688 INFO:teuthology.orchestra.run.smithi042.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-09-21T17:38:16.022 INFO:teuthology.orchestra.run.smithi042.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.4 MB/s | 5.1 MB 00:01 2024-09-21T17:38:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5129.g0ecbb435.el9.noa 12/12 2024-09-21T17:38:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5129.g0ecbb435.el 1/12 2024-09-21T17:38:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5129.g0ecbb435.el9.noa 2/12 2024-09-21T17:38:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5129.g0ecbb435.el9 3/12 2024-09-21T17:38:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T17:38:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T17:38:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T17:38:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T17:38:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T17:38:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T17:38:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T17:38:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T17:38:16.745 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T17:38:16.745 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:16.745 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:16.745 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T17:38:16.745 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:16.745 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:16.745 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:16.745 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T17:38:16.745 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T17:38:16.745 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T17:38:16.746 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T17:38:16.746 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T17:38:16.746 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T17:38:16.746 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T17:38:16.746 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T17:38:16.746 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:16.746 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:16.888 INFO:teuthology.orchestra.run.smithi042.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 1.7 MB/s | 4.9 MB 00:02 2024-09-21T17:38:17.010 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T17:38:17.591 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:08 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:17.725 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:17.726 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T17:38:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T17:38:17.726 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T17:38:17.726 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 7.4 M 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T17:38:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T17:38:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T17:38:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:17.728 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:17.728 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T17:38:17.728 INFO:teuthology.orchestra.run.smithi162.stdout:Install 12 Packages 2024-09-21T17:38:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:17.728 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 38 M 2024-09-21T17:38:17.729 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 212 M 2024-09-21T17:38:17.729 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:18.605 INFO:teuthology.orchestra.run.smithi162.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-51 14 MB/s | 7.4 MB 00:00 2024-09-21T17:38:18.672 INFO:teuthology.orchestra.run.smithi162.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 492 kB/s | 33 kB 00:00 2024-09-21T17:38:18.923 INFO:teuthology.orchestra.run.smithi162.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 230 kB/s | 191 kB 00:00 2024-09-21T17:38:18.989 INFO:teuthology.orchestra.run.smithi162.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 275 kB/s | 18 kB 00:00 2024-09-21T17:38:19.031 INFO:teuthology.orchestra.run.smithi162.stdout:(5/12): libgfortran-11.5.0-2.el9.x86_64.rpm 853 kB/s | 801 kB 00:00 2024-09-21T17:38:19.056 INFO:teuthology.orchestra.run.smithi162.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-21T17:38:19.140 INFO:teuthology.orchestra.run.smithi162.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-21T17:38:19.382 INFO:teuthology.orchestra.run.smithi162.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.2 MB/s | 3.0 MB 00:00 2024-09-21T17:38:19.474 INFO:teuthology.orchestra.run.smithi162.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.7 MB/s | 250 kB 00:00 2024-09-21T17:38:19.616 INFO:teuthology.orchestra.run.smithi162.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 8.5 MB/s | 4.9 MB 00:00 2024-09-21T17:38:20.216 INFO:teuthology.orchestra.run.smithi162.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.7 MB/s | 5.1 MB 00:01 2024-09-21T17:38:20.466 INFO:teuthology.orchestra.run.smithi162.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:00 2024-09-21T17:38:20.467 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:20.467 INFO:teuthology.orchestra.run.smithi162.stdout:Total 14 MB/s | 38 MB 00:02 2024-09-21T17:38:20.827 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:20.853 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:20.853 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:21.272 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:21.272 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T17:38:22.146 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T17:38:22.246 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T17:38:22.282 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T17:38:22.472 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T17:38:22.506 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T17:38:22.589 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T17:38:23.229 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T17:38:23.344 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T17:38:24.615 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T17:38:25.646 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T17:38:25.665 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5129.g0ecbb 12/12 2024-09-21T17:38:28.662 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5129.g0ecbb 12/12 2024-09-21T17:38:28.662 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5129.g0ecbb 1/12 2024-09-21T17:38:28.662 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T17:38:28.662 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T17:38:28.662 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T17:38:28.662 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T17:38:28.662 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T17:38:28.663 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T17:38:28.663 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T17:38:28.663 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T17:38:28.663 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T17:38:28.663 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T17:38:29.127 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T17:38:29.127 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:29.127 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:29.127 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:29.127 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T17:38:29.127 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T17:38:29.128 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T17:38:29.128 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T17:38:29.128 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T17:38:29.128 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T17:38:29.128 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T17:38:29.128 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T17:38:29.128 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T17:38:29.128 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T17:38:29.128 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T17:38:29.128 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:29.128 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:29.556 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-mgr-rook 2024-09-21T17:38:30.143 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:21 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:30.278 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:30.279 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 49 k 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T17:38:30.280 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T17:38:30.281 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T17:38:30.281 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T17:38:30.281 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T17:38:30.281 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T17:38:30.281 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:30.281 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:30.281 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:30.281 INFO:teuthology.orchestra.run.smithi162.stdout:Install 13 Packages 2024-09-21T17:38:30.281 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:30.282 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 2.2 M 2024-09-21T17:38:30.282 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 26 M 2024-09-21T17:38:30.282 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:30.644 INFO:teuthology.orchestra.run.smithi162.stdout:(1/13): ceph-mgr-rook-19.3.0-5129.g0ecbb435.el9 292 kB/s | 49 kB 00:00 2024-09-21T17:38:30.669 INFO:teuthology.orchestra.run.smithi162.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 132 kB/s | 26 kB 00:00 2024-09-21T17:38:30.694 INFO:teuthology.orchestra.run.smithi162.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 87 kB/s | 19 kB 00:00 2024-09-21T17:38:30.903 INFO:teuthology.orchestra.run.smithi162.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 760 kB/s | 159 kB 00:00 2024-09-21T17:38:30.936 INFO:teuthology.orchestra.run.smithi162.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 759 kB/s | 222 kB 00:00 2024-09-21T17:38:30.970 INFO:teuthology.orchestra.run.smithi162.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 965 kB/s | 32 kB 00:00 2024-09-21T17:38:30.987 INFO:teuthology.orchestra.run.smithi162.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 853 kB/s | 14 kB 00:00 2024-09-21T17:38:31.012 INFO:teuthology.orchestra.run.smithi162.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.5 MB/s | 220 kB 00:00 2024-09-21T17:38:31.038 INFO:teuthology.orchestra.run.smithi162.stdout:(9/13): python3-requests-oauthlib-1.3.0-12.el9. 398 kB/s | 54 kB 00:00 2024-09-21T17:38:31.088 INFO:teuthology.orchestra.run.smithi162.stdout:(10/13): python3-kubernetes-26.1.0-2.el9.noarch 14 MB/s | 1.0 MB 00:00 2024-09-21T17:38:31.113 INFO:teuthology.orchestra.run.smithi162.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 787 kB/s | 59 kB 00:00 2024-09-21T17:38:31.138 INFO:teuthology.orchestra.run.smithi162.stdout:(12/13): python3-pyasn1-modules-0.4.8-6.el9.noa 628 kB/s | 279 kB 00:00 2024-09-21T17:38:31.164 INFO:teuthology.orchestra.run.smithi162.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-09-21T17:38:31.165 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:31.166 INFO:teuthology.orchestra.run.smithi162.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-09-21T17:38:31.230 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:31.245 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:31.245 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:31.338 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:31.339 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:31.851 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:32.028 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T17:38:32.082 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T17:38:32.137 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T17:38:32.174 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T17:38:32.224 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T17:38:32.334 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T17:38:32.436 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T17:38:32.501 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T17:38:33.213 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T17:38:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T17:38:33.299 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T17:38:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T17:38:33.378 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.3.0-5129.g0ecbb435.el9.noarch 13/13 2024-09-21T17:38:34.156 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5129.g0ecbb435.el9.noarch 13/13 2024-09-21T17:38:34.156 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5129.g0ecbb435.el9.noarch 1/13 2024-09-21T17:38:34.157 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T17:38:34.157 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T17:38:34.157 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T17:38:34.157 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T17:38:34.157 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T17:38:34.157 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T17:38:34.157 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T17:38:34.157 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T17:38:34.157 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T17:38:34.157 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T17:38:34.157 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T17:38:34.517 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T17:38:34.517 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:34.517 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:34.517 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:34.517 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T17:38:34.517 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T17:38:34.517 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T17:38:34.517 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T17:38:34.517 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T17:38:34.517 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T17:38:34.518 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T17:38:34.518 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T17:38:34.518 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T17:38:34.518 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T17:38:34.518 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T17:38:34.518 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T17:38:34.518 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:34.518 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:34.793 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T17:38:35.377 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:26 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:35.509 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:35.510 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T17:38:35.510 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:35.510 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 156 k 2024-09-21T17:38:35.510 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T17:38:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T17:38:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T17:38:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T17:38:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T17:38:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T17:38:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:35.511 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:35.511 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:35.511 INFO:teuthology.orchestra.run.smithi162.stdout:Install 6 Packages 2024-09-21T17:38:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:35.511 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 7.0 M 2024-09-21T17:38:35.512 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 33 M 2024-09-21T17:38:35.512 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:35.704 INFO:teuthology.orchestra.run.smithi042.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 792 kB/s | 16 MB 00:21 2024-09-21T17:38:35.705 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:35.705 INFO:teuthology.orchestra.run.smithi042.stdout:Total 1.7 MB/s | 38 MB 00:22 2024-09-21T17:38:35.917 INFO:teuthology.orchestra.run.smithi162.stdout:(1/6): ceph-mgr-cephadm-19.3.0-5129.g0ecbb435.e 741 kB/s | 156 kB 00:00 2024-09-21T17:38:35.985 INFO:teuthology.orchestra.run.smithi162.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.1 MB/s | 548 kB 00:00 2024-09-21T17:38:36.010 INFO:teuthology.orchestra.run.smithi162.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-21T17:38:36.035 INFO:teuthology.orchestra.run.smithi162.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-21T17:38:36.071 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:38:36.100 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:38:36.100 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:38:36.352 INFO:teuthology.orchestra.run.smithi162.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 385 kB/s | 248 kB 00:00 2024-09-21T17:38:36.553 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:38:36.553 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:38:36.877 INFO:teuthology.orchestra.run.smithi162.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-21T17:38:36.879 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:36.880 INFO:teuthology.orchestra.run.smithi162.stdout:Total 5.1 MB/s | 7.0 MB 00:01 2024-09-21T17:38:36.952 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:36.964 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:36.964 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:37.063 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:37.064 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:37.410 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:37.463 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:38:37.532 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T17:38:37.576 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T17:38:37.581 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T17:38:37.630 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T17:38:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T17:38:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T17:38:37.912 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T17:38:37.944 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T17:38:38.028 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T17:38:38.150 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T17:38:38.240 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T17:38:38.309 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T17:38:38.333 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 6/6 2024-09-21T17:38:38.715 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T17:38:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T17:38:39.148 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 6/6 2024-09-21T17:38:39.148 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 1/6 2024-09-21T17:38:39.148 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T17:38:39.148 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T17:38:39.148 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T17:38:39.148 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T17:38:39.455 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T17:38:39.455 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:39.455 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:39.455 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:39.455 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T17:38:39.456 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T17:38:39.456 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T17:38:39.456 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T17:38:39.456 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T17:38:39.456 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:39.456 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:39.708 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-fuse 2024-09-21T17:38:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T17:38:40.289 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:31 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:40.422 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:40.422 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:40.422 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T17:38:40.423 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:40.423 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:40.423 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 900 k 2024-09-21T17:38:40.423 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T17:38:40.423 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T17:38:40.423 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:40.423 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:40.423 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:40.423 INFO:teuthology.orchestra.run.smithi162.stdout:Install 2 Packages 2024-09-21T17:38:40.423 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:40.424 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 979 k 2024-09-21T17:38:40.424 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 2.9 M 2024-09-21T17:38:40.424 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:40.905 INFO:teuthology.orchestra.run.smithi162.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 395 kB/s | 80 kB 00:00 2024-09-21T17:38:40.972 INFO:teuthology.orchestra.run.smithi162.stdout:(2/2): ceph-fuse-19.3.0-5129.g0ecbb435.el9.x86_ 3.3 MB/s | 900 kB 00:00 2024-09-21T17:38:40.972 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:40.973 INFO:teuthology.orchestra.run.smithi162.stdout:Total 1.7 MB/s | 979 kB 00:00 2024-09-21T17:38:40.985 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:41.007 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:41.007 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:41.090 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:41.090 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:41.280 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:41.282 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T17:38:41.309 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5129.g0ecbb 12/12 2024-09-21T17:38:41.416 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T17:38:41.487 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 2/2 2024-09-21T17:38:42.177 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 2/2 2024-09-21T17:38:42.178 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/2 2024-09-21T17:38:42.458 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T17:38:42.458 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:42.458 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:42.458 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T17:38:42.458 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:42.459 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:42.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-volume 2024-09-21T17:38:43.437 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:43.572 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:43.572 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:43.572 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T17:38:43.572 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:43.573 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:43.573 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 285 k 2024-09-21T17:38:43.573 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:43.573 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:43.573 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:43.573 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T17:38:43.573 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:43.573 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 285 k 2024-09-21T17:38:43.573 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 1.3 M 2024-09-21T17:38:43.574 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:43.802 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-volume-19.3.0-5129.g0ecbb435.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-21T17:38:43.803 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:43.803 INFO:teuthology.orchestra.run.smithi162.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-21T17:38:43.803 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:43.811 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:43.812 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:43.842 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:43.842 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:43.940 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5129.g0ecbb 12/12 2024-09-21T17:38:43.940 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5129.g0ecbb 1/12 2024-09-21T17:38:43.940 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T17:38:43.940 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T17:38:43.940 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T17:38:43.940 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T17:38:43.940 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T17:38:43.940 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T17:38:43.940 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T17:38:43.941 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T17:38:43.941 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T17:38:43.941 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T17:38:44.106 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:44.179 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:38:44.195 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:38:44.195 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:38:44.195 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T17:38:44.196 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:44.379 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T17:38:44.379 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:44.379 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:38:44.379 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:44.379 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T17:38:44.379 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T17:38:44.379 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T17:38:44.380 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T17:38:44.380 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T17:38:44.380 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T17:38:44.380 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T17:38:44.380 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T17:38:44.380 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T17:38:44.380 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T17:38:44.380 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T17:38:44.380 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:44.380 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:38:44.791 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-rook 2024-09-21T17:38:45.264 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:38:45.264 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:45.264 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:45.264 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:45.264 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:45.264 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:45.420 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:38:45.561 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 49 k 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T17:38:45.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T17:38:45.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T17:38:45.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T17:38:45.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T17:38:45.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T17:38:45.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T17:38:45.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T17:38:45.564 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:45.564 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:38:45.564 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:45.564 INFO:teuthology.orchestra.run.smithi042.stdout:Install 13 Packages 2024-09-21T17:38:45.564 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:45.565 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 2.2 M 2024-09-21T17:38:45.565 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 26 M 2024-09-21T17:38:45.565 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:38:45.602 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install librados-devel 2024-09-21T17:38:46.151 INFO:teuthology.orchestra.run.smithi042.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 262 kB/s | 26 kB 00:00 2024-09-21T17:38:46.176 INFO:teuthology.orchestra.run.smithi042.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 156 kB/s | 19 kB 00:00 2024-09-21T17:38:46.204 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:46.235 INFO:teuthology.orchestra.run.smithi042.stdout:(3/13): ceph-mgr-rook-19.3.0-5129.g0ecbb435.el9 271 kB/s | 49 kB 00:00 2024-09-21T17:38:46.260 INFO:teuthology.orchestra.run.smithi042.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-21T17:38:46.310 INFO:teuthology.orchestra.run.smithi042.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-21T17:38:46.336 INFO:teuthology.orchestra.run.smithi042.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 713 kB/s | 54 kB 00:00 2024-09-21T17:38:46.340 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:46.340 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:46.340 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repo Size 2024-09-21T17:38:46.340 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:46.340 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:46.340 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 127 k 2024-09-21T17:38:46.341 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:46.341 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:46.341 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:46.341 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T17:38:46.341 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:46.341 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 127 k 2024-09-21T17:38:46.341 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 456 k 2024-09-21T17:38:46.342 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:46.394 INFO:teuthology.orchestra.run.smithi042.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 385 kB/s | 32 kB 00:00 2024-09-21T17:38:46.419 INFO:teuthology.orchestra.run.smithi042.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 169 kB/s | 14 kB 00:00 2024-09-21T17:38:46.445 INFO:teuthology.orchestra.run.smithi042.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-09-21T17:38:46.478 INFO:teuthology.orchestra.run.smithi042.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.7 MB/s | 220 kB 00:00 2024-09-21T17:38:46.504 INFO:teuthology.orchestra.run.smithi042.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-21T17:38:46.525 INFO:teuthology.orchestra.run.smithi162.stdout:librados-devel-19.3.0-5129.g0ecbb435.el9.x86_64 692 kB/s | 127 kB 00:00 2024-09-21T17:38:46.525 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:46.526 INFO:teuthology.orchestra.run.smithi162.stdout:Total 686 kB/s | 127 kB 00:00 2024-09-21T17:38:46.526 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:46.529 INFO:teuthology.orchestra.run.smithi042.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-09-21T17:38:46.531 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:46.531 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:46.571 INFO:teuthology.orchestra.run.smithi042.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-21T17:38:46.574 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:46.574 INFO:teuthology.orchestra.run.smithi042.stdout:Total 2.2 MB/s | 2.2 MB 00:01 2024-09-21T17:38:46.597 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:46.598 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:46.638 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:38:46.654 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:38:46.654 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:38:46.747 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:46.751 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:38:46.753 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:38:46.848 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:38:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:38:47.309 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:38:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T17:38:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T17:38:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T17:38:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T17:38:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:38:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:47.612 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:38:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:47.612 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T17:38:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T17:38:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T17:38:47.886 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install libcephfs2 2024-09-21T17:38:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T17:38:48.487 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:48.580 INFO:teuthology.orchestra.run.smithi162.stdout:Package libcephfs2-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:38:48.624 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:48.625 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T17:38:48.625 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:48.675 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T17:38:48.710 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install libcephfs-devel 2024-09-21T17:38:48.722 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T17:38:48.756 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T17:38:48.805 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T17:38:48.825 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.3.0-5129.g0ecbb435.el9.noarch 13/13 2024-09-21T17:38:49.291 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:49.424 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:49.425 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:49.425 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repo Size 2024-09-21T17:38:49.425 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:49.425 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:49.425 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 32 k 2024-09-21T17:38:49.426 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:49.426 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:49.426 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:49.426 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T17:38:49.426 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:49.426 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 32 k 2024-09-21T17:38:49.426 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 142 k 2024-09-21T17:38:49.426 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:49.579 INFO:teuthology.orchestra.run.smithi162.stdout:libcephfs-devel-19.3.0-5129.g0ecbb435.el9.x86_6 207 kB/s | 32 kB 00:00 2024-09-21T17:38:49.580 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:49.580 INFO:teuthology.orchestra.run.smithi162.stdout:Total 205 kB/s | 32 kB 00:00 2024-09-21T17:38:49.580 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:49.583 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:49.584 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:49.602 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:49.602 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:49.680 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5129.g0ecbb435.el9.noarch 13/13 2024-09-21T17:38:49.680 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5129.g0ecbb435.el9.noarch 1/13 2024-09-21T17:38:49.680 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T17:38:49.680 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T17:38:49.680 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T17:38:49.680 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T17:38:49.680 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T17:38:49.680 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T17:38:49.681 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T17:38:49.681 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T17:38:49.681 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T17:38:49.681 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T17:38:49.681 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T17:38:49.691 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:38:50.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T17:38:50.140 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:50.140 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:38:50.140 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:50.140 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T17:38:50.140 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T17:38:50.140 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T17:38:50.140 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T17:38:50.140 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T17:38:50.140 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T17:38:50.140 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T17:38:50.140 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T17:38:50.141 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T17:38:50.141 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T17:38:50.141 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T17:38:50.141 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T17:38:50.141 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:50.141 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:38:50.192 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:38:50.412 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T17:38:50.443 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:38:50.443 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:50.444 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:50.444 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:38:50.444 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:50.444 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:50.644 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install librados2 2024-09-21T17:38:51.021 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:48 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:38:51.161 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:38:51.161 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 156 k 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:51.162 INFO:teuthology.orchestra.run.smithi042.stdout:Install 6 Packages 2024-09-21T17:38:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:51.163 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 7.0 M 2024-09-21T17:38:51.163 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 33 M 2024-09-21T17:38:51.163 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:38:51.222 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:51.312 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:38:51.355 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:51.356 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T17:38:51.356 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:51.431 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install librbd1 2024-09-21T17:38:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-21T17:38:51.565 INFO:teuthology.orchestra.run.smithi042.stdout:(2/6): ceph-mgr-cephadm-19.3.0-5129.g0ecbb435.e 728 kB/s | 156 kB 00:00 2024-09-21T17:38:51.624 INFO:teuthology.orchestra.run.smithi042.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-21T17:38:51.649 INFO:teuthology.orchestra.run.smithi042.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 690 kB/s | 58 kB 00:00 2024-09-21T17:38:51.674 INFO:teuthology.orchestra.run.smithi042.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-21T17:38:51.791 INFO:teuthology.orchestra.run.smithi042.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-21T17:38:51.794 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:51.794 INFO:teuthology.orchestra.run.smithi042.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-21T17:38:51.867 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:38:51.879 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:38:51.879 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:38:51.985 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:38:51.985 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:38:52.012 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:52.101 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:38:52.144 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:52.145 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T17:38:52.145 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:52.221 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install python3-rados 2024-09-21T17:38:52.305 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:38:52.491 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T17:38:52.545 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T17:38:52.803 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:52.893 INFO:teuthology.orchestra.run.smithi162.stdout:Package python3-rados-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:38:52.936 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:52.937 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T17:38:52.937 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:53.013 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install python3-rgw 2024-09-21T17:38:53.101 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T17:38:53.199 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T17:38:53.275 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T17:38:53.305 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 6/6 2024-09-21T17:38:53.594 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:44 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:53.684 INFO:teuthology.orchestra.run.smithi162.stdout:Package python3-rgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:38:53.729 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:53.730 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T17:38:53.730 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:53.805 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install python3-cephfs 2024-09-21T17:38:54.101 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 6/6 2024-09-21T17:38:54.101 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 1/6 2024-09-21T17:38:54.101 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T17:38:54.101 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T17:38:54.101 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T17:38:54.101 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T17:38:54.385 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:45 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:54.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T17:38:54.385 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:54.386 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:38:54.386 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:38:54.386 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T17:38:54.386 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T17:38:54.386 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T17:38:54.386 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T17:38:54.386 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T17:38:54.386 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:54.386 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:38:54.475 INFO:teuthology.orchestra.run.smithi162.stdout:Package python3-cephfs-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:38:54.518 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:54.519 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T17:38:54.519 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:54.603 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install python3-rbd 2024-09-21T17:38:54.672 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-fuse 2024-09-21T17:38:55.189 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:46 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:55.278 INFO:teuthology.orchestra.run.smithi162.stdout:Package python3-rbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:38:55.279 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:52 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:38:55.322 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:55.323 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T17:38:55.323 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:55.403 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install rbd-fuse 2024-09-21T17:38:55.419 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:38:55.419 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:55.419 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-21T17:38:55.420 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:55.420 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:38:55.420 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 900 k 2024-09-21T17:38:55.420 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-21T17:38:55.420 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T17:38:55.420 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:55.420 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:38:55.420 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:55.420 INFO:teuthology.orchestra.run.smithi042.stdout:Install 2 Packages 2024-09-21T17:38:55.420 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:55.421 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 979 k 2024-09-21T17:38:55.421 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 2.9 M 2024-09-21T17:38:55.421 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:38:55.735 INFO:teuthology.orchestra.run.smithi042.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 439 kB/s | 80 kB 00:00 2024-09-21T17:38:55.827 INFO:teuthology.orchestra.run.smithi042.stdout:(2/2): ceph-fuse-19.3.0-5129.g0ecbb435.el9.x86_ 3.2 MB/s | 900 kB 00:00 2024-09-21T17:38:55.828 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:55.828 INFO:teuthology.orchestra.run.smithi042.stdout:Total 2.3 MB/s | 979 kB 00:00 2024-09-21T17:38:55.840 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:38:55.864 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:38:55.864 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:38:55.952 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:38:55.952 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:38:55.984 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:46 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:56.119 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:56.119 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 85 k 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 85 k 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 231 k 2024-09-21T17:38:56.120 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:56.146 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:38:56.301 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T17:38:56.315 INFO:teuthology.orchestra.run.smithi162.stdout:rbd-fuse-19.3.0-5129.g0ecbb435.el9.x86_64.rpm 437 kB/s | 85 kB 00:00 2024-09-21T17:38:56.316 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:56.316 INFO:teuthology.orchestra.run.smithi162.stdout:Total 434 kB/s | 85 kB 00:00 2024-09-21T17:38:56.316 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:56.323 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:56.323 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 2/2 2024-09-21T17:38:56.387 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:56.387 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:56.538 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:56.637 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:38:57.065 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:38:57.067 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 2/2 2024-09-21T17:38:57.067 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/2 2024-09-21T17:38:57.345 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:38:57.345 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:57.345 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:38:57.345 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:38:57.345 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:57.345 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:38:57.360 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T17:38:57.360 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:57.360 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:38:57.360 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T17:38:57.360 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:57.361 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:38:57.603 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install rbd-mirror 2024-09-21T17:38:57.696 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-volume 2024-09-21T17:38:58.222 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:49 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:38:58.313 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:55 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:38:58.359 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repo Size 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 3.2 M 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 3.2 M 2024-09-21T17:38:58.360 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 14 M 2024-09-21T17:38:58.361 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:38:58.452 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:38:58.452 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.3.0-5129.g0ecbb435.el9 ceph-noarch 285 k 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 285 k 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 1.3 M 2024-09-21T17:38:58.453 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:38:58.690 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-volume-19.3.0-5129.g0ecbb435.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-21T17:38:58.691 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:58.691 INFO:teuthology.orchestra.run.smithi042.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-21T17:38:58.691 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:38:58.700 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:38:58.701 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:38:58.712 INFO:teuthology.orchestra.run.smithi162.stdout:rbd-mirror-19.3.0-5129.g0ecbb435.el9.x86_64.rpm 9.1 MB/s | 3.2 MB 00:00 2024-09-21T17:38:58.713 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:38:58.713 INFO:teuthology.orchestra.run.smithi162.stdout:Total 9.0 MB/s | 3.2 MB 00:00 2024-09-21T17:38:58.713 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:38:58.723 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:38:58.723 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:38:58.732 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:38:58.732 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:38:58.805 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:38:58.805 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:38:58.970 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:38:59.034 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:38:59.050 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:38:59.050 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:38:59.050 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T17:38:59.050 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:38:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:38:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:38:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:38:59.389 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:38:59.389 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T17:38:59.390 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T17:38:59.390 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T17:38:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:39:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.3.0-5129.g0ecbb435.el9.noarch 1/1 2024-09-21T17:39:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:00.145 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:39:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.3.0-5129.g0ecbb435.el9.noarch 2024-09-21T17:39:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:00.145 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:00.481 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install librados-devel 2024-09-21T17:39:00.518 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:00.518 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:39:00.518 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:39:00.518 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:39:00.518 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:39:00.518 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:39:00.791 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install rbd-nbd 2024-09-21T17:39:01.095 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:58 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:01.234 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:01.235 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:01.235 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-09-21T17:39:01.235 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:01.235 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:39:01.235 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 127 k 2024-09-21T17:39:01.235 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:01.235 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:39:01.235 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:01.236 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-09-21T17:39:01.236 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:01.236 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 127 k 2024-09-21T17:39:01.236 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 456 k 2024-09-21T17:39:01.236 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:39:01.390 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:52 ago on Sat 21 Sep 2024 05:37:09 PM UTC. 2024-09-21T17:39:01.445 INFO:teuthology.orchestra.run.smithi042.stdout:librados-devel-19.3.0-5129.g0ecbb435.el9.x86_64 604 kB/s | 127 kB 00:00 2024-09-21T17:39:01.446 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:39:01.446 INFO:teuthology.orchestra.run.smithi042.stdout:Total 600 kB/s | 127 kB 00:00 2024-09-21T17:39:01.446 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:39:01.452 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:39:01.453 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:39:01.521 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:39:01.521 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:39:01.529 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T17:39:01.529 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:39:01.529 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-21T17:39:01.530 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:39:01.530 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T17:39:01.530 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 170 k 2024-09-21T17:39:01.530 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:39:01.530 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T17:39:01.530 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T17:39:01.530 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T17:39:01.530 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:39:01.530 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 170 k 2024-09-21T17:39:01.531 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 490 k 2024-09-21T17:39:01.531 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T17:39:01.678 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:39:01.742 INFO:teuthology.orchestra.run.smithi162.stdout:rbd-nbd-19.3.0-5129.g0ecbb435.el9.x86_64.rpm 808 kB/s | 170 kB 00:00 2024-09-21T17:39:01.742 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:39:01.743 INFO:teuthology.orchestra.run.smithi162.stdout:Total 802 kB/s | 170 kB 00:00 2024-09-21T17:39:01.743 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T17:39:01.751 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T17:39:01.751 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T17:39:01.771 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:01.816 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T17:39:01.817 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T17:39:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T17:39:02.082 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:02.247 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:02.510 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:02.517 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:02.517 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:02.517 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:39:02.517 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:39:02.517 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:02.517 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:02.752 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:02.752 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:39:02.752 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T17:39:02.752 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:39:02.752 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:39:02.752 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T17:39:02.815 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install libcephfs2 2024-09-21T17:39:02.998 DEBUG:teuthology.parallel:result is None 2024-09-21T17:39:03.433 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:00 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:03.530 INFO:teuthology.orchestra.run.smithi042.stdout:Package libcephfs2-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:39:03.577 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:03.578 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-09-21T17:39:03.578 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:03.656 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install libcephfs-devel 2024-09-21T17:39:04.266 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:01 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:04.404 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:04.405 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:04.405 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-09-21T17:39:04.405 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:04.405 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:39:04.405 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 32 k 2024-09-21T17:39:04.405 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:04.405 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:39:04.405 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:04.405 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-09-21T17:39:04.406 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:04.406 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 32 k 2024-09-21T17:39:04.406 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 142 k 2024-09-21T17:39:04.406 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:39:04.550 INFO:teuthology.orchestra.run.smithi042.stdout:libcephfs-devel-19.3.0-5129.g0ecbb435.el9.x86_6 221 kB/s | 32 kB 00:00 2024-09-21T17:39:04.550 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:39:04.550 INFO:teuthology.orchestra.run.smithi042.stdout:Total 219 kB/s | 32 kB 00:00 2024-09-21T17:39:04.551 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:39:04.554 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:39:04.554 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:39:04.578 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:39:04.578 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:39:04.663 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:39:04.775 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:05.152 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:05.382 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:05.382 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:05.383 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:39:05.383 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:39:05.383 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:05.383 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:05.571 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install librados2 2024-09-21T17:39:06.187 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:03 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:06.281 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:39:06.327 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:06.328 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-09-21T17:39:06.328 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:06.405 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install librbd1 2024-09-21T17:39:07.011 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:04 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:07.103 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:39:07.149 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:07.151 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-09-21T17:39:07.151 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:07.221 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-rados 2024-09-21T17:39:07.830 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:04 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:07.921 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-rados-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:39:07.969 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:07.970 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-09-21T17:39:07.970 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:08.046 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-rgw 2024-09-21T17:39:08.652 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:05 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:08.745 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-rgw-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:39:08.790 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:08.792 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-09-21T17:39:08.792 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:08.874 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-cephfs 2024-09-21T17:39:09.485 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:06 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:09.579 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-cephfs-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:39:09.627 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:09.628 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-09-21T17:39:09.628 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:09.708 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-rbd 2024-09-21T17:39:10.325 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:07 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:10.419 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-rbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 is already installed. 2024-09-21T17:39:10.465 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:10.504 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-09-21T17:39:10.504 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:10.549 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install rbd-fuse 2024-09-21T17:39:11.160 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:08 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:11.300 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:11.301 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:11.301 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-09-21T17:39:11.301 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:11.301 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:39:11.301 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 85 k 2024-09-21T17:39:11.301 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:11.301 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:39:11.302 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:11.302 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-09-21T17:39:11.302 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:11.302 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 85 k 2024-09-21T17:39:11.302 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 231 k 2024-09-21T17:39:11.302 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:39:11.494 INFO:teuthology.orchestra.run.smithi042.stdout:rbd-fuse-19.3.0-5129.g0ecbb435.el9.x86_64.rpm 443 kB/s | 85 kB 00:00 2024-09-21T17:39:11.495 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:39:11.495 INFO:teuthology.orchestra.run.smithi042.stdout:Total 439 kB/s | 85 kB 00:00 2024-09-21T17:39:11.495 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:39:11.503 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:39:11.503 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:39:11.572 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:39:11.572 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:39:11.735 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:39:11.837 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:12.230 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:12.471 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:39:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:39:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:12.471 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:12.722 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install rbd-mirror 2024-09-21T17:39:13.334 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:10 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:13.474 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:13.475 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:13.475 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-09-21T17:39:13.475 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:13.475 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:39:13.475 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 3.2 M 2024-09-21T17:39:13.475 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:13.475 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:39:13.475 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:13.475 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-09-21T17:39:13.476 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:13.476 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 3.2 M 2024-09-21T17:39:13.476 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 14 M 2024-09-21T17:39:13.476 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:39:13.823 INFO:teuthology.orchestra.run.smithi042.stdout:rbd-mirror-19.3.0-5129.g0ecbb435.el9.x86_64.rpm 9.2 MB/s | 3.2 MB 00:00 2024-09-21T17:39:13.823 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:39:13.824 INFO:teuthology.orchestra.run.smithi042.stdout:Total 9.2 MB/s | 3.2 MB 00:00 2024-09-21T17:39:13.824 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:39:13.834 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:39:13.834 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:39:13.921 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:39:13.921 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:39:14.446 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:39:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:14.542 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:14.542 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T17:39:14.542 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T17:39:14.542 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T17:39:14.542 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T17:39:14.542 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:15.674 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:39:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:39:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:15.675 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:15.956 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install rbd-nbd 2024-09-21T17:39:16.580 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:13 ago on Sat 21 Sep 2024 05:37:03 PM UTC. 2024-09-21T17:39:16.722 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T17:39:16.722 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:16.722 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-09-21T17:39:16.723 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:16.723 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T17:39:16.723 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.3.0-5129.g0ecbb435.el9 ceph 170 k 2024-09-21T17:39:16.723 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:16.723 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T17:39:16.723 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-21T17:39:16.723 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-09-21T17:39:16.723 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:16.723 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 170 k 2024-09-21T17:39:16.723 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 490 k 2024-09-21T17:39:16.723 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T17:39:16.936 INFO:teuthology.orchestra.run.smithi042.stdout:rbd-nbd-19.3.0-5129.g0ecbb435.el9.x86_64.rpm 802 kB/s | 170 kB 00:00 2024-09-21T17:39:16.936 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:39:16.937 INFO:teuthology.orchestra.run.smithi042.stdout:Total 796 kB/s | 170 kB 00:00 2024-09-21T17:39:16.937 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T17:39:16.946 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T17:39:16.946 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T17:39:17.015 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T17:39:17.016 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T17:39:17.186 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T17:39:17.287 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:17.741 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:17.990 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 1/1 2024-09-21T17:39:17.990 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:17.990 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T17:39:17.990 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.3.0-5129.g0ecbb435.el9.x86_64 2024-09-21T17:39:17.990 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:39:17.990 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T17:39:18.376 DEBUG:teuthology.parallel:result is None 2024-09-21T17:39:18.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0ecbb435437226bc091a0c2d4549ba25bf724efe 2024-09-21T17:39:18.525 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T17:39:18.547 INFO:teuthology.orchestra.run.smithi042.stdout:19.3.0-5129.g0ecbb435.el9 2024-09-21T17:39:18.548 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5129.g0ecbb435.el9 2024-09-21T17:39:18.548 INFO:teuthology.task.install:The correct ceph version 19.3.0-5129.g0ecbb435 is installed. 2024-09-21T17:39:18.550 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0ecbb435437226bc091a0c2d4549ba25bf724efe 2024-09-21T17:39:18.689 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T17:39:18.716 INFO:teuthology.orchestra.run.smithi162.stdout:19.3.0-5129.g0ecbb435.el9 2024-09-21T17:39:18.716 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5129.g0ecbb435.el9 2024-09-21T17:39:18.716 INFO:teuthology.task.install:The correct ceph version 19.3.0-5129.g0ecbb435 is installed. 2024-09-21T17:39:18.718 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T17:39:18.718 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:39:18.718 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T17:39:18.747 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:39:18.747 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T17:39:18.787 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T17:39:18.787 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:39:18.787 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T17:39:18.814 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T17:39:18.883 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:39:18.883 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T17:39:18.913 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T17:39:18.982 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T17:39:18.982 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:39:18.982 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T17:39:19.009 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T17:39:19.078 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:39:19.078 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T17:39:19.106 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T17:39:19.174 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T17:39:19.175 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:39:19.175 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T17:39:19.201 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T17:39:19.267 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:39:19.267 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T17:39:19.295 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T17:39:19.362 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T17:39:19.449 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', 'CEPHADM_STRAY_DAEMON'], 'log-only-match': ['CEPHADM_'], 'sha1': '0ecbb435437226bc091a0c2d4549ba25bf724efe', 'cephadm_mode': 'cephadm-package'} 2024-09-21T17:39:19.449 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe 2024-09-21T17:39:19.450 INFO:tasks.cephadm:Cluster fsid is 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:39:19.450 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T17:39:19.450 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.42', 'mon.c': '[v2:172.21.15.42:3301,v1:172.21.15.42:6790]', 'mon.b': '172.21.15.162'} 2024-09-21T17:39:19.450 INFO:tasks.cephadm:First mon is mon.a on smithi042 2024-09-21T17:39:19.451 INFO:tasks.cephadm:First mgr is y 2024-09-21T17:39:19.451 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T17:39:19.451 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname $(hostname -s) 2024-09-21T17:39:19.477 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2024-09-21T17:39:19.514 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe on all hosts... 2024-09-21T17:39:19.514 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe pull 2024-09-21T17:39:19.519 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe pull 2024-09-21T17:39:21.121 INFO:teuthology.orchestra.run.smithi162.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe... 2024-09-21T17:39:21.201 INFO:teuthology.orchestra.run.smithi042.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe... 2024-09-21T17:39:56.011 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-21T17:39:56.011 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 19.3.0-5129-g0ecbb435 (0ecbb435437226bc091a0c2d4549ba25bf724efe) squid (dev)", 2024-09-21T17:39:56.011 INFO:teuthology.orchestra.run.smithi042.stdout: "image_id": "3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25", 2024-09-21T17:39:56.011 INFO:teuthology.orchestra.run.smithi042.stdout: "repo_digests": [ 2024-09-21T17:39:56.011 INFO:teuthology.orchestra.run.smithi042.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5" 2024-09-21T17:39:56.011 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-21T17:39:56.011 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-21T17:39:58.100 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T17:39:58.100 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.3.0-5129-g0ecbb435 (0ecbb435437226bc091a0c2d4549ba25bf724efe) squid (dev)", 2024-09-21T17:39:58.100 INFO:teuthology.orchestra.run.smithi162.stdout: "image_id": "3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25", 2024-09-21T17:39:58.100 INFO:teuthology.orchestra.run.smithi162.stdout: "repo_digests": [ 2024-09-21T17:39:58.100 INFO:teuthology.orchestra.run.smithi162.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5" 2024-09-21T17:39:58.100 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-21T17:39:58.101 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T17:39:58.126 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph 2024-09-21T17:39:58.160 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2024-09-21T17:39:58.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /etc/ceph 2024-09-21T17:39:58.231 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2024-09-21T17:39:58.255 INFO:tasks.cephadm:Writing seed config... 2024-09-21T17:39:58.256 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [global] ms bind msgr1 = False 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [global] ms bind msgr2 = True 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [global] ms type = async 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T17:39:58.257 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-09-21T17:39:58.258 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-09-21T17:39:58.258 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T17:39:58.258 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:39:58.258 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T17:39:58.289 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6e3cf65a-7840-11ef-baf6-efdc52797490 mon election default strategy = 1 ms bind msgr1 = False ms bind msgr2 = True ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-09-21T17:39:58.289 DEBUG:teuthology.orchestra.run.smithi042:mon.a> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.a.service 2024-09-21T17:39:58.332 DEBUG:teuthology.orchestra.run.smithi042:mgr.y> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mgr.y.service 2024-09-21T17:39:58.375 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T17:39:58.375 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe -v bootstrap --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.42 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T17:39:58.587 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T17:39:58.587 INFO:teuthology.orchestra.run.smithi042.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe', '-v', 'bootstrap', '--fsid', '6e3cf65a-7840-11ef-baf6-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.42', '--skip-admin-label'] 2024-09-21T17:39:58.587 INFO:teuthology.orchestra.run.smithi042.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T17:39:58.587 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying podman|docker is present... 2024-09-21T17:39:58.611 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 5.2.2 2024-09-21T17:39:58.611 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying lvm2 is present... 2024-09-21T17:39:58.611 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying time synchronization is in place... 2024-09-21T17:39:58.619 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T17:39:58.619 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T17:39:58.625 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T17:39:58.625 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-21T17:39:58.632 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout enabled 2024-09-21T17:39:58.639 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout active 2024-09-21T17:39:58.639 INFO:teuthology.orchestra.run.smithi042.stdout:Unit chronyd.service is enabled and running 2024-09-21T17:39:58.639 INFO:teuthology.orchestra.run.smithi042.stdout:Repeating the final host check... 2024-09-21T17:39:58.661 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 5.2.2 2024-09-21T17:39:58.661 INFO:teuthology.orchestra.run.smithi042.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T17:39:58.661 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl is present 2024-09-21T17:39:58.661 INFO:teuthology.orchestra.run.smithi042.stdout:lvcreate is present 2024-09-21T17:39:58.668 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T17:39:58.668 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T17:39:58.674 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T17:39:58.674 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-21T17:39:58.681 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout enabled 2024-09-21T17:39:58.688 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout active 2024-09-21T17:39:58.688 INFO:teuthology.orchestra.run.smithi042.stdout:Unit chronyd.service is enabled and running 2024-09-21T17:39:58.688 INFO:teuthology.orchestra.run.smithi042.stdout:Host looks OK 2024-09-21T17:39:58.688 INFO:teuthology.orchestra.run.smithi042.stdout:Cluster fsid: 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:39:58.688 INFO:teuthology.orchestra.run.smithi042.stdout:Acquiring lock 140397115645568 on /run/cephadm/6e3cf65a-7840-11ef-baf6-efdc52797490.lock 2024-09-21T17:39:58.689 INFO:teuthology.orchestra.run.smithi042.stdout:Lock 140397115645568 acquired on /run/cephadm/6e3cf65a-7840-11ef-baf6-efdc52797490.lock 2024-09-21T17:39:58.689 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying IP 172.21.15.42 port 3300 ... 2024-09-21T17:39:58.689 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying IP 172.21.15.42 port 6789 ... 2024-09-21T17:39:58.689 INFO:teuthology.orchestra.run.smithi042.stdout:Base mon IP(s) is [172.21.15.42:3300, 172.21.15.42:6789], mon addrv is [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-09-21T17:39:58.692 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.42 metric 100 2024-09-21T17:39:58.692 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.42 metric 100 2024-09-21T17:39:58.695 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T17:39:58.695 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T17:39:58.695 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1795sec hoplimit 64 pref medium 2024-09-21T17:39:58.698 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T17:39:58.698 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T17:39:58.698 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T17:39:58.698 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T17:39:58.698 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-21T17:39:58.698 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T17:39:58.699 INFO:teuthology.orchestra.run.smithi042.stdout:Mon IP `172.21.15.42` is in CIDR network `172.21.0.0/20` 2024-09-21T17:39:58.699 INFO:teuthology.orchestra.run.smithi042.stdout:Mon IP `172.21.15.42` is in CIDR network `172.21.0.0/20` 2024-09-21T17:39:58.699 INFO:teuthology.orchestra.run.smithi042.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T17:39:58.699 INFO:teuthology.orchestra.run.smithi042.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T17:39:58.700 INFO:teuthology.orchestra.run.smithi042.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe... 2024-09-21T17:40:02.383 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 2024-09-21T17:40:02.383 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe... 2024-09-21T17:40:02.383 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T17:40:02.383 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T17:40:02.384 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying blob sha256:21b5a2bb4fd2b634e899a996bd2c361c29a2bbdb6dc6de9dcb7e17a30e3d130c 2024-09-21T17:40:02.384 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying config sha256:3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 2024-09-21T17:40:02.384 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T17:40:11.679 INFO:teuthology.orchestra.run.smithi042.stdout:ceph: stdout ceph version 19.3.0-5129-g0ecbb435 (0ecbb435437226bc091a0c2d4549ba25bf724efe) squid (dev) 2024-09-21T17:40:11.680 INFO:teuthology.orchestra.run.smithi042.stdout:Ceph version: ceph version 19.3.0-5129-g0ecbb435 (0ecbb435437226bc091a0c2d4549ba25bf724efe) squid (dev) 2024-09-21T17:40:11.680 INFO:teuthology.orchestra.run.smithi042.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T17:40:12.517 INFO:teuthology.orchestra.run.smithi042.stdout:stat: stdout 167 167 2024-09-21T17:40:12.518 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial keys... 2024-09-21T17:40:13.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQD8BO9mXx80MxAAPf+RToWiSWf2T/7A4IGHag== 2024-09-21T17:40:14.454 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQD9BO9mKHmRLRAApjshT1Iae+796b/wEZgS9A== 2024-09-21T17:40:15.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQD+BO9mTrz2LRAA4PUFj26CO3/dKUTIDcZbjg== 2024-09-21T17:40:15.462 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial monmap... 2024-09-21T17:40:16.400 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T17:40:16.400 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T17:40:16.400 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:40:16.400 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T17:40:16.400 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool for a [v2:172.21.15.42:3300,v1:172.21.15.42:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T17:40:16.400 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = quincy 2024-09-21T17:40:16.401 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: set fsid to 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:40:16.401 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T17:40:16.401 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:40:16.401 INFO:teuthology.orchestra.run.smithi042.stdout:Creating mon... 2024-09-21T17:40:17.854 INFO:teuthology.orchestra.run.smithi042.stdout:create mon.a on 2024-09-21T17:40:18.169 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T17:40:18.332 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T17:40:18.540 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6e3cf65a-7840-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-6e3cf65a-7840-11ef-baf6-efdc52797490.target. 2024-09-21T17:40:18.541 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6e3cf65a-7840-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-6e3cf65a-7840-11ef-baf6-efdc52797490.target. 2024-09-21T17:40:18.769 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.a 2024-09-21T17:40:18.769 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.a.service: Unit ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.a.service not loaded. 2024-09-21T17:40:18.939 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6e3cf65a-7840-11ef-baf6-efdc52797490.target.wants/ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.a.service → /etc/systemd/system/ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@.service. 2024-09-21T17:40:19.462 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T17:40:19.462 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-21T17:40:19.469 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T17:40:19.469 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-21T17:40:19.469 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-21T17:40:19.470 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T17:40:19.470 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mon to start... 2024-09-21T17:40:19.470 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mon... 2024-09-21T17:40:20.413 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout id: 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout services: 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.535492s) 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout data: 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:20.414 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.872+0000 7fa85bf01640 1 Processor -- start 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.873+0000 7fa85bf01640 1 -- start start 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.873+0000 7fa85bf01640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa854105c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.873+0000 7fa85bf01640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa854106260 con 0x7fa854105870 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.873+0000 7fa859c9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa854105c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.873+0000 7fa859c9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa854105c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43422/0 (socket says 172.21.15.42:43422) 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.873+0000 7fa859c9d640 1 -- 172.21.15.42:0/3225618085 learned_addr learned my addr 172.21.15.42:0/3225618085 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.874+0000 7fa859c9d640 1 -- 172.21.15.42:0/3225618085 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8541063e0 con 0x7fa854105870 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.876+0000 7fa859c9d640 1 --2- 172.21.15.42:0/3225618085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa854105c70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa850009820 tx=0x7fa85002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c6f618f1729740 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.876+0000 7fa858c9b640 1 -- 172.21.15.42:0/3225618085 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa850037070 con 0x7fa854105870 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.876+0000 7fa858c9b640 1 -- 172.21.15.42:0/3225618085 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa850032440 con 0x7fa854105870 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.876+0000 7fa858c9b640 1 -- 172.21.15.42:0/3225618085 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa850032740 con 0x7fa854105870 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.876+0000 7fa85bf01640 1 -- 172.21.15.42:0/3225618085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 msgr2=0x7fa854105c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.876+0000 7fa85bf01640 1 --2- 172.21.15.42:0/3225618085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa854105c70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa850009820 tx=0x7fa85002a270 comp rx=0 tx=0).stop 2024-09-21T17:40:20.415 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.876+0000 7fa85bf01640 1 -- 172.21.15.42:0/3225618085 shutdown_connections 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.876+0000 7fa85bf01640 1 --2- 172.21.15.42:0/3225618085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa854105c70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.876+0000 7fa85bf01640 1 -- 172.21.15.42:0/3225618085 >> 172.21.15.42:0/3225618085 conn(0x7fa854101140 msgr2=0x7fa854103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.877+0000 7fa85bf01640 1 -- 172.21.15.42:0/3225618085 shutdown_connections 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.877+0000 7fa85bf01640 1 -- 172.21.15.42:0/3225618085 wait complete. 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.877+0000 7fa85bf01640 1 Processor -- start 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.877+0000 7fa85bf01640 1 -- start start 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.877+0000 7fa85bf01640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa85419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.877+0000 7fa85bf01640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa854106d80 con 0x7fa854105870 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.877+0000 7fa859c9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa85419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.877+0000 7fa859c9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa85419a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43424/0 (socket says 172.21.15.42:43424) 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.877+0000 7fa859c9d640 1 -- 172.21.15.42:0/226159715 learned_addr learned my addr 172.21.15.42:0/226159715 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.878+0000 7fa859c9d640 1 -- 172.21.15.42:0/226159715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85419a710 con 0x7fa854105870 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.878+0000 7fa859c9d640 1 --2- 172.21.15.42:0/226159715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa85419a1b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa8500090b0 tx=0x7fa8500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.878+0000 7fa84affd640 1 -- 172.21.15.42:0/226159715 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa850041070 con 0x7fa854105870 2024-09-21T17:40:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.878+0000 7fa84affd640 1 -- 172.21.15.42:0/226159715 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa85003c7a0 con 0x7fa854105870 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.878+0000 7fa85bf01640 1 -- 172.21.15.42:0/226159715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa85419a9a0 con 0x7fa854105870 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.878+0000 7fa84affd640 1 -- 172.21.15.42:0/226159715 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa850037040 con 0x7fa854105870 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.878+0000 7fa85bf01640 1 -- 172.21.15.42:0/226159715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa85419b360 con 0x7fa854105870 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.878+0000 7fa84affd640 1 -- 172.21.15.42:0/226159715 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa850044070 con 0x7fa854105870 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.878+0000 7fa84affd640 1 -- 172.21.15.42:0/226159715 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa85003d3f0 con 0x7fa854105870 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.879+0000 7fa85bf01640 1 -- 172.21.15.42:0/226159715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa854107530 con 0x7fa854105870 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.881+0000 7fa84affd640 1 -- 172.21.15.42:0/226159715 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa850046450 con 0x7fa854105870 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.945+0000 7fa85bf01640 1 -- 172.21.15.42:0/226159715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fa85419c120 con 0x7fa854105870 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.946+0000 7fa84affd640 1 -- 172.21.15.42:0/226159715 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fa850046630 con 0x7fa854105870 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.947+0000 7fa85bf01640 1 -- 172.21.15.42:0/226159715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 msgr2=0x7fa85419a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.947+0000 7fa85bf01640 1 --2- 172.21.15.42:0/226159715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa85419a1b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa8500090b0 tx=0x7fa8500046c0 comp rx=0 tx=0).stop 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.947+0000 7fa85bf01640 1 -- 172.21.15.42:0/226159715 shutdown_connections 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.947+0000 7fa85bf01640 1 --2- 172.21.15.42:0/226159715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa854105870 0x7fa85419a1b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.947+0000 7fa85bf01640 1 -- 172.21.15.42:0/226159715 >> 172.21.15.42:0/226159715 conn(0x7fa854101140 msgr2=0x7fa854190c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:20.417 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.947+0000 7fa85bf01640 1 -- 172.21.15.42:0/226159715 shutdown_connections 2024-09-21T17:40:20.418 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:19.947+0000 7fa85bf01640 1 -- 172.21.15.42:0/226159715 wait complete. 2024-09-21T17:40:20.418 INFO:teuthology.orchestra.run.smithi042.stdout:mon is available 2024-09-21T17:40:20.418 INFO:teuthology.orchestra.run.smithi042.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout fsid = 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T17:40:21.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.820+0000 7f8c194bb640 1 Processor -- start 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.820+0000 7f8c194bb640 1 -- start start 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.820+0000 7f8c194bb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1410b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.820+0000 7f8c194bb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1407a6d0 con 0x7f8c1407a2d0 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.820+0000 7f8c12ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1410b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.820+0000 7f8c12ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1410b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43432/0 (socket says 172.21.15.42:43432) 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.821+0000 7f8c12ffd640 1 -- 172.21.15.42:0/650307629 learned_addr learned my addr 172.21.15.42:0/650307629 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.821+0000 7f8c12ffd640 1 -- 172.21.15.42:0/650307629 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1410bec0 con 0x7f8c1407a2d0 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.822+0000 7f8c12ffd640 1 --2- 172.21.15.42:0/650307629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1410b980 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009820 tx=0x7f8c0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d53ba26f276762 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.822+0000 7f8c11ffb640 1 -- 172.21.15.42:0/650307629 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c037070 con 0x7f8c1407a2d0 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.822+0000 7f8c11ffb640 1 -- 172.21.15.42:0/650307629 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0c032440 con 0x7f8c1407a2d0 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.822+0000 7f8c11ffb640 1 -- 172.21.15.42:0/650307629 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c032740 con 0x7f8c1407a2d0 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.822+0000 7f8c194bb640 1 -- 172.21.15.42:0/650307629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 msgr2=0x7f8c1410b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.822+0000 7f8c194bb640 1 --2- 172.21.15.42:0/650307629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1410b980 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009820 tx=0x7f8c0c02a270 comp rx=0 tx=0).stop 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.822+0000 7f8c194bb640 1 -- 172.21.15.42:0/650307629 shutdown_connections 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.822+0000 7f8c194bb640 1 --2- 172.21.15.42:0/650307629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1410b980 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.822+0000 7f8c194bb640 1 -- 172.21.15.42:0/650307629 >> 172.21.15.42:0/650307629 conn(0x7f8c141011b0 msgr2=0x7f8c141035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.822+0000 7f8c194bb640 1 -- 172.21.15.42:0/650307629 shutdown_connections 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.822+0000 7f8c194bb640 1 -- 172.21.15.42:0/650307629 wait complete. 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.823+0000 7f8c194bb640 1 Processor -- start 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.823+0000 7f8c194bb640 1 -- start start 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.823+0000 7f8c194bb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1419c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:21.423 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.823+0000 7f8c194bb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1410c390 con 0x7f8c1407a2d0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.823+0000 7f8c12ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1419c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.824+0000 7f8c12ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1419c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43436/0 (socket says 172.21.15.42:43436) 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.824+0000 7f8c12ffd640 1 -- 172.21.15.42:0/2105349842 learned_addr learned my addr 172.21.15.42:0/2105349842 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.824+0000 7f8c12ffd640 1 -- 172.21.15.42:0/2105349842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1419c8f0 con 0x7f8c1407a2d0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.824+0000 7f8c12ffd640 1 --2- 172.21.15.42:0/2105349842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1419c390 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0090b0 tx=0x7f8c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.824+0000 7f8c0bfff640 1 -- 172.21.15.42:0/2105349842 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c041070 con 0x7f8c1407a2d0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.824+0000 7f8c0bfff640 1 -- 172.21.15.42:0/2105349842 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0c03c7a0 con 0x7f8c1407a2d0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.824+0000 7f8c194bb640 1 -- 172.21.15.42:0/2105349842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1419cb80 con 0x7f8c1407a2d0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.824+0000 7f8c0bfff640 1 -- 172.21.15.42:0/2105349842 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c037040 con 0x7f8c1407a2d0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.824+0000 7f8c194bb640 1 -- 172.21.15.42:0/2105349842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1419d540 con 0x7f8c1407a2d0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.824+0000 7f8c0bfff640 1 -- 172.21.15.42:0/2105349842 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8c0c044070 con 0x7f8c1407a2d0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.824+0000 7f8c0bfff640 1 -- 172.21.15.42:0/2105349842 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8c0c03d3f0 con 0x7f8c1407a2d0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.825+0000 7f8c194bb640 1 -- 172.21.15.42:0/2105349842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1410ba00 con 0x7f8c1407a2d0 2024-09-21T17:40:21.424 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.827+0000 7f8c0bfff640 1 -- 172.21.15.42:0/2105349842 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8c0c046450 con 0x7f8c1407a2d0 2024-09-21T17:40:21.425 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.889+0000 7f8c194bb640 1 -- 172.21.15.42:0/2105349842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f8c1419dac0 con 0x7f8c1407a2d0 2024-09-21T17:40:21.425 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.892+0000 7f8c0bfff640 1 -- 172.21.15.42:0/2105349842 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+374 (secure 0 0 0) 0x7f8c0c046630 con 0x7f8c1407a2d0 2024-09-21T17:40:21.425 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.893+0000 7f8c0bfff640 1 -- 172.21.15.42:0/2105349842 <== mon.0 v2:172.21.15.42:3300/0 8 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f8c0c058480 con 0x7f8c1407a2d0 2024-09-21T17:40:21.425 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.893+0000 7f8c194bb640 1 -- 172.21.15.42:0/2105349842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 msgr2=0x7f8c1419c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:21.425 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.893+0000 7f8c194bb640 1 --2- 172.21.15.42:0/2105349842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1419c390 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0090b0 tx=0x7f8c0c0046c0 comp rx=0 tx=0).stop 2024-09-21T17:40:21.425 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.893+0000 7f8c194bb640 1 -- 172.21.15.42:0/2105349842 shutdown_connections 2024-09-21T17:40:21.425 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.893+0000 7f8c194bb640 1 --2- 172.21.15.42:0/2105349842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c1407a2d0 0x7f8c1419c390 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:21.425 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.893+0000 7f8c194bb640 1 -- 172.21.15.42:0/2105349842 >> 172.21.15.42:0/2105349842 conn(0x7f8c141011b0 msgr2=0x7f8c14102050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:21.425 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.894+0000 7f8c194bb640 1 -- 172.21.15.42:0/2105349842 shutdown_connections 2024-09-21T17:40:21.425 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:20.894+0000 7f8c194bb640 1 -- 172.21.15.42:0/2105349842 wait complete. 2024-09-21T17:40:21.425 INFO:teuthology.orchestra.run.smithi042.stdout:Generating new minimal ceph.conf... 2024-09-21T17:40:22.503 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:22 smithi042 ceph-mon[28998]: from='client.? 172.21.15.42:0/3232766377' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:40:22.510 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.835+0000 7f9477776640 1 Processor -- start 2024-09-21T17:40:22.510 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.836+0000 7f9477776640 1 -- start start 2024-09-21T17:40:22.510 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.836+0000 7f9477776640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947007b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:22.510 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.836+0000 7f9477776640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f947007d190 con 0x7f947007cce0 2024-09-21T17:40:22.510 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.836+0000 7f9475512640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947007b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:22.510 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.836+0000 7f9475512640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947007b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49936/0 (socket says 172.21.15.42:49936) 2024-09-21T17:40:22.510 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.836+0000 7f9475512640 1 -- 172.21.15.42:0/495968245 learned_addr learned my addr 172.21.15.42:0/495968245 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:22.510 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.836+0000 7f9475512640 1 -- 172.21.15.42:0/495968245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f947007b880 con 0x7f947007cce0 2024-09-21T17:40:22.510 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.837+0000 7f9475512640 1 --2- 172.21.15.42:0/495968245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947007b340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f946c009820 tx=0x7f946c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965e497db6e273b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:22.510 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.837+0000 7f9467fff640 1 -- 172.21.15.42:0/495968245 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c037070 con 0x7f947007cce0 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.837+0000 7f9467fff640 1 -- 172.21.15.42:0/495968245 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f946c0328a0 con 0x7f947007cce0 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.837+0000 7f9467fff640 1 -- 172.21.15.42:0/495968245 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c030690 con 0x7f947007cce0 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.838+0000 7f9477776640 1 -- 172.21.15.42:0/495968245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 msgr2=0x7f947007b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.838+0000 7f9477776640 1 --2- 172.21.15.42:0/495968245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947007b340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f946c009820 tx=0x7f946c02a270 comp rx=0 tx=0).stop 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.838+0000 7f9477776640 1 -- 172.21.15.42:0/495968245 shutdown_connections 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.838+0000 7f9477776640 1 --2- 172.21.15.42:0/495968245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947007b340 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.838+0000 7f9477776640 1 -- 172.21.15.42:0/495968245 >> 172.21.15.42:0/495968245 conn(0x7f9470102250 msgr2=0x7f9470104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.838+0000 7f9477776640 1 -- 172.21.15.42:0/495968245 shutdown_connections 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.838+0000 7f9477776640 1 -- 172.21.15.42:0/495968245 wait complete. 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.839+0000 7f9477776640 1 Processor -- start 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.839+0000 7f9477776640 1 -- start start 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.839+0000 7f9477776640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.839+0000 7f9477776640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f947010ceb0 con 0x7f947007cce0 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.839+0000 7f9475512640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:22.511 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.839+0000 7f9475512640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947019ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49952/0 (socket says 172.21.15.42:49952) 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.839+0000 7f9475512640 1 -- 172.21.15.42:0/3232766377 learned_addr learned my addr 172.21.15.42:0/3232766377 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.839+0000 7f9475512640 1 -- 172.21.15.42:0/3232766377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f947019cff0 con 0x7f947007cce0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.839+0000 7f9475512640 1 --2- 172.21.15.42:0/3232766377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947019ca90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f946c006f10 tx=0x7f946c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.840+0000 7f94667fc640 1 -- 172.21.15.42:0/3232766377 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c037040 con 0x7f947007cce0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.840+0000 7f94667fc640 1 -- 172.21.15.42:0/3232766377 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f946c040070 con 0x7f947007cce0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.840+0000 7f9477776640 1 -- 172.21.15.42:0/3232766377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f947019d280 con 0x7f947007cce0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.840+0000 7f94667fc640 1 -- 172.21.15.42:0/3232766377 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c03a390 con 0x7f947007cce0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.840+0000 7f9477776640 1 -- 172.21.15.42:0/3232766377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f947019dc40 con 0x7f947007cce0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.840+0000 7f94667fc640 1 -- 172.21.15.42:0/3232766377 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f946c03a600 con 0x7f947007cce0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.840+0000 7f94667fc640 1 -- 172.21.15.42:0/3232766377 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f946c045770 con 0x7f947007cce0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.841+0000 7f9477776640 1 -- 172.21.15.42:0/3232766377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f947007b3c0 con 0x7f947007cce0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.843+0000 7f94667fc640 1 -- 172.21.15.42:0/3232766377 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f946c032830 con 0x7f947007cce0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.904+0000 7f9477776640 1 -- 172.21.15.42:0/3232766377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f947019e250 con 0x7f947007cce0 2024-09-21T17:40:22.512 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.904+0000 7f94667fc640 1 -- 172.21.15.42:0/3232766377 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f946c03b430 con 0x7f947007cce0 2024-09-21T17:40:22.513 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.905+0000 7f9477776640 1 -- 172.21.15.42:0/3232766377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 msgr2=0x7f947019ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:22.513 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.905+0000 7f9477776640 1 --2- 172.21.15.42:0/3232766377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947019ca90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f946c006f10 tx=0x7f946c032670 comp rx=0 tx=0).stop 2024-09-21T17:40:22.513 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.905+0000 7f9477776640 1 -- 172.21.15.42:0/3232766377 shutdown_connections 2024-09-21T17:40:22.513 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.905+0000 7f9477776640 1 --2- 172.21.15.42:0/3232766377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f947007cce0 0x7f947019ca90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:22.513 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.905+0000 7f9477776640 1 -- 172.21.15.42:0/3232766377 >> 172.21.15.42:0/3232766377 conn(0x7f9470102250 msgr2=0x7f9470102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:22.513 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.905+0000 7f9477776640 1 -- 172.21.15.42:0/3232766377 shutdown_connections 2024-09-21T17:40:22.513 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:21.905+0000 7f9477776640 1 -- 172.21.15.42:0/3232766377 wait complete. 2024-09-21T17:40:22.513 INFO:teuthology.orchestra.run.smithi042.stdout:Restarting the monitor... 2024-09-21T17:40:22.774 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:22 smithi042 systemd[1]: Stopping Ceph mon.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:40:23.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:22 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a[28994]: 2024-09-21T17:40:22.771+0000 7f6f5cdf5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T17:40:23.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:22 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a[28994]: 2024-09-21T17:40:22.771+0000 7f6f5cdf5640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T17:40:23.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:22 smithi042 podman[29240]: 2024-09-21 17:40:22.853859749 +0000 UTC m=+0.181960296 container died 2b431916e382ed3fe871db1012d7674f0ed191b3978979807293dc8f038b9b1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T17:40:23.374 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:23 smithi042 podman[29240]: 2024-09-21 17:40:23.171618439 +0000 UTC m=+0.499718976 container cleanup 2b431916e382ed3fe871db1012d7674f0ed191b3978979807293dc8f038b9b1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T17:40:23.374 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:23 smithi042 bash[29240]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a 2024-09-21T17:40:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:23 smithi042 podman[29252]: 2024-09-21 17:40:23.372340429 +0000 UTC m=+0.513161685 container remove 2b431916e382ed3fe871db1012d7674f0ed191b3978979807293dc8f038b9b1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T17:40:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:23 smithi042 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T17:40:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:23 smithi042 systemd[1]: Stopped Ceph mon.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:40:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:23 smithi042 systemd[1]: Starting Ceph mon.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:40:24.052 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:23 smithi042 podman[29342]: 2024-09-21 17:40:23.781775283 +0000 UTC m=+0.101082006 container create 0c8039e706c8d8a9a09afa9b1fb3fe3daf9e33d5aebc0783dc3a13bfff862202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:23 smithi042 podman[29342]: 2024-09-21 17:40:23.697098816 +0000 UTC m=+0.016405539 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:23 smithi042 podman[29342]: 2024-09-21 17:40:23.97572885 +0000 UTC m=+0.295035581 container init 0c8039e706c8d8a9a09afa9b1fb3fe3daf9e33d5aebc0783dc3a13bfff862202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:23 smithi042 podman[29342]: 2024-09-21 17:40:23.978857055 +0000 UTC m=+0.298163779 container start 0c8039e706c8d8a9a09afa9b1fb3fe3daf9e33d5aebc0783dc3a13bfff862202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, io.buildah.version=1.37.2) 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: ceph version 19.3.0-5129-g0ecbb435 (0ecbb435437226bc091a0c2d4549ba25bf724efe) squid (dev), process ceph-mon, pid 2 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: pidfile_write: ignore empty --pid-file 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: load: jerasure load: lrc 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: RocksDB version: 7.9.2 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Git sha 0 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Compile date 2024-09-21 14:38:11 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: DB SUMMARY 2024-09-21T17:40:24.053 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: DB Session ID: 2PACPS4JK3UZB814YP6E 2024-09-21T17:40:24.054 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: CURRENT file: CURRENT 2024-09-21T17:40:24.054 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T17:40:24.054 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T17:40:24.054 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T17:40:24.054 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 91888 ; 2024-09-21T17:40:24.055 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.error_if_exists: 0 2024-09-21T17:40:24.055 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.create_if_missing: 0 2024-09-21T17:40:24.055 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.paranoid_checks: 1 2024-09-21T17:40:24.055 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T17:40:24.055 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T17:40:24.055 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T17:40:24.055 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.env: 0x5571099aa120 2024-09-21T17:40:24.055 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.info_log: 0x55710abb5700 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.statistics: (nil) 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.use_fsync: 0 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_log_file_size: 0 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.allow_fallocate: 1 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.use_direct_reads: 0 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T17:40:24.056 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.db_log_dir: 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.wal_dir: 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.write_buffer_manager: 0x55710abb9b80 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T17:40:24.057 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.unordered_write: 0 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.row_cache: None 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.wal_filter: None 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T17:40:24.058 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.two_write_queues: 0 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.wal_compression: 0 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.atomic_flush: 0 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.log_readahead_size: 0 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T17:40:24.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_background_jobs: 2 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_background_compactions: -1 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_subcompactions: 1 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_open_files: -1 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T17:40:24.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_background_flushes: -1 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Compression algorithms supported: 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: kZSTD supported: 0 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: kXpressCompression supported: 0 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: kBZip2Compression supported: 0 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: kLZ4Compression supported: 1 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: kZlibCompression supported: 1 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: kSnappyCompression supported: 1 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.merge_operator: 2024-09-21T17:40:24.061 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_filter: None 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55710abb5320) 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout: cache_index_and_filter_blocks: 1 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout: pin_top_level_index_and_filter: 1 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_type: 0 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout: data_block_index_type: 0 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_shortening: 1 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout: checksum: 4 2024-09-21T17:40:24.062 INFO:journalctl@ceph.mon.a.smithi042.stdout: no_block_cache: 0 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache: 0x55710aba9610 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_name: BinnedLRUCache 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_options: 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: capacity : 536870912 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: num_shard_bits : 4 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: strict_capacity_limit : 0 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: high_pri_pool_ratio: 0.000 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_compressed: (nil) 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: persistent_cache: (nil) 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_size: 4096 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_size_deviation: 10 2024-09-21T17:40:24.063 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_restart_interval: 16 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_block_restart_interval: 1 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: metadata_block_size: 4096 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: partition_filters: 0 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: use_delta_encoding: 1 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: filter_policy: bloomfilter 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: whole_key_filtering: 1 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: verify_compression: 0 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: read_amp_bytes_per_bit: 0 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: format_version: 5 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: enable_index_compression: 1 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_align: 0 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: max_auto_readahead_size: 262144 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: prepopulate_block_cache: 0 2024-09-21T17:40:24.064 INFO:journalctl@ceph.mon.a.smithi042.stdout: initial_auto_readahead_size: 8192 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compression: NoCompression 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.num_levels: 7 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T17:40:24.065 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T17:40:24.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T17:40:24.067 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T17:40:24.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T17:40:24.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.inplace_update_support: 0 2024-09-21T17:40:24.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T17:40:24.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T17:40:24.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T17:40:24.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T17:40:24.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.bloom_locality: 0 2024-09-21T17:40:24.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.max_successive_merges: 0 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.ttl: 2592000 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.enable_blob_files: false 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.min_blob_size: 0 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T17:40:24.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9a098faa-38f7-422d-ba4a-ac785638890b 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726940424007146, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726940424008482, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 88317, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 273, "table_properties": {"data_size": 86385, "index_size": 252, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 10932, "raw_average_key_size": 47, "raw_value_size": 80203, "raw_average_value_size": 345, "num_data_blocks": 11, "num_entries": 232, "num_filter_entries": 232, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726940424, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9a098faa-38f7-422d-ba4a-ac785638890b", "db_session_id": "2PACPS4JK3UZB814YP6E", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726940424008616, "job": 1, "event": "recovery_finished"} 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55710abd8e00 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: DB pointer 0x55710acda000 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T17:40:24.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** DB Stats ** 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** Compaction Stats [default] ** 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: L0 2/0 88.11 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: Sum 2/0 88.11 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T17:40:24.072 INFO:journalctl@ceph.mon.a.smithi042.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** Compaction Stats [default] ** 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 104.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T17:40:24.073 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative compaction: 0.00 GB write, 19.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval compaction: 0.00 GB write, 19.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout: Block cache BinnedLRUCache@0x55710aba9610#2 capacity: 512.00 MB usage: 1.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: starting mon.a rank 0 at public addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] at bind addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: mon.a@-1(???) e1 preinit fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: mon.a@-1(???).mds e1 new map 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: mon.a@-1(???).mds e1 print_map 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout: e1 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout: btime 2024-09-21T17:40:19:412275+0000 2024-09-21T17:40:24.074 INFO:journalctl@ceph.mon.a.smithi042.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T17:40:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T17:40:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout: legacy client fscid: -1 2024-09-21T17:40:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-21T17:40:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout: No filesystems configured 2024-09-21T17:40:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T17:40:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T17:40:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T17:40:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T17:40:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T17:40:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 bash[29342]: 0c8039e706c8d8a9a09afa9b1fb3fe3daf9e33d5aebc0783dc3a13bfff862202 2024-09-21T17:40:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 systemd[1]: Started Ceph mon.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:40:24.075 INFO:teuthology.orchestra.run.smithi042.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T17:40:24.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T17:40:24.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: monmap epoch 1 2024-09-21T17:40:24.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:40:24.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: last_changed 2024-09-21T17:40:15.831038+0000 2024-09-21T17:40:24.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: created 2024-09-21T17:40:15.831038+0000 2024-09-21T17:40:24.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: min_mon_release 19 (squid) 2024-09-21T17:40:24.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: election_strategy: 1 2024-09-21T17:40:24.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-21T17:40:24.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: fsmap 2024-09-21T17:40:24.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T17:40:24.309 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:24 smithi042 ceph-mon[29361]: mgrmap e1: no daemons active 2024-09-21T17:40:25.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.521+0000 7f4ed5ed6640 1 Processor -- start 2024-09-21T17:40:25.200 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.521+0000 7f4ed5ed6640 1 -- start start 2024-09-21T17:40:25.200 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.522+0000 7f4ed5ed6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed0106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:25.200 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.522+0000 7f4ed5ed6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed0107350 con 0x7f4ed0106960 2024-09-21T17:40:25.200 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.522+0000 7f4ecf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed0106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:25.200 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.522+0000 7f4ecf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed0106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49968/0 (socket says 172.21.15.42:49968) 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.522+0000 7f4ecf7fe640 1 -- 172.21.15.42:0/1458654227 learned_addr learned my addr 172.21.15.42:0/1458654227 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.522+0000 7f4ecf7fe640 1 -- 172.21.15.42:0/1458654227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed01074d0 con 0x7f4ed0106960 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.524+0000 7f4ecf7fe640 1 --2- 172.21.15.42:0/1458654227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed0106d60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009820 tx=0x7f4ec002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354f9b03255611d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.525+0000 7f4eceffd640 1 -- 172.21.15.42:0/1458654227 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ec0037070 con 0x7f4ed0106960 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.525+0000 7f4eceffd640 1 -- 172.21.15.42:0/1458654227 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f4ec00328a0 con 0x7f4ed0106960 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.525+0000 7f4eceffd640 1 -- 172.21.15.42:0/1458654227 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ec0030690 con 0x7f4ed0106960 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.525+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/1458654227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 msgr2=0x7f4ed0106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.525+0000 7f4ed5ed6640 1 --2- 172.21.15.42:0/1458654227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed0106d60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009820 tx=0x7f4ec002a270 comp rx=0 tx=0).stop 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.525+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/1458654227 shutdown_connections 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.525+0000 7f4ed5ed6640 1 --2- 172.21.15.42:0/1458654227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed0106d60 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.525+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/1458654227 >> 172.21.15.42:0/1458654227 conn(0x7f4ed0102250 msgr2=0x7f4ed0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.525+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/1458654227 shutdown_connections 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.525+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/1458654227 wait complete. 2024-09-21T17:40:25.201 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.526+0000 7f4ed5ed6640 1 Processor -- start 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.526+0000 7f4ed5ed6640 1 -- start start 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.526+0000 7f4ed5ed6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.526+0000 7f4ed5ed6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed010ade0 con 0x7f4ed0106960 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.526+0000 7f4ecf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.526+0000 7f4ecf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed019a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49980/0 (socket says 172.21.15.42:49980) 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.526+0000 7f4ecf7fe640 1 -- 172.21.15.42:0/3403777956 learned_addr learned my addr 172.21.15.42:0/3403777956 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.526+0000 7f4ecf7fe640 1 -- 172.21.15.42:0/3403777956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed019ae40 con 0x7f4ed0106960 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.527+0000 7f4ecf7fe640 1 --2- 172.21.15.42:0/3403777956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed019a8e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0006f10 tx=0x7f4ec0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.527+0000 7f4ecd7fa640 1 -- 172.21.15.42:0/3403777956 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ec0037040 con 0x7f4ed0106960 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.527+0000 7f4ecd7fa640 1 -- 172.21.15.42:0/3403777956 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f4ec0040070 con 0x7f4ed0106960 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.527+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/3403777956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed019b0d0 con 0x7f4ed0106960 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.527+0000 7f4ecd7fa640 1 -- 172.21.15.42:0/3403777956 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ec003a390 con 0x7f4ed0106960 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.527+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/3403777956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed019ba90 con 0x7f4ed0106960 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.527+0000 7f4ecd7fa640 1 -- 172.21.15.42:0/3403777956 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ec003a600 con 0x7f4ed0106960 2024-09-21T17:40:25.202 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.527+0000 7f4ecd7fa640 1 -- 172.21.15.42:0/3403777956 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4ec0045770 con 0x7f4ed0106960 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.528+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/3403777956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ed0106de0 con 0x7f4ed0106960 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.530+0000 7f4ecd7fa640 1 -- 172.21.15.42:0/3403777956 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4ec0032830 con 0x7f4ed0106960 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.591+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/3403777956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f4ed019c110 con 0x7f4ed0106960 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.593+0000 7f4ecd7fa640 1 -- 172.21.15.42:0/3403777956 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f4ec003b430 con 0x7f4ed0106960 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.593+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/3403777956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 msgr2=0x7f4ed019a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.594+0000 7f4ed5ed6640 1 --2- 172.21.15.42:0/3403777956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed019a8e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0006f10 tx=0x7f4ec0032670 comp rx=0 tx=0).stop 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.594+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/3403777956 shutdown_connections 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.594+0000 7f4ed5ed6640 1 --2- 172.21.15.42:0/3403777956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ed0106960 0x7f4ed019a8e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.594+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/3403777956 >> 172.21.15.42:0/3403777956 conn(0x7f4ed0102250 msgr2=0x7f4ed0102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.594+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/3403777956 shutdown_connections 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:24.594+0000 7f4ed5ed6640 1 -- 172.21.15.42:0/3403777956 wait complete. 2024-09-21T17:40:25.203 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T17:40:25.217 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T17:40:25.217 INFO:teuthology.orchestra.run.smithi042.stdout:Creating mgr... 2024-09-21T17:40:25.218 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T17:40:25.218 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T17:40:25.459 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mgr.y 2024-09-21T17:40:25.460 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mgr.y.service: Unit ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mgr.y.service not loaded. 2024-09-21T17:40:25.620 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6e3cf65a-7840-11ef-baf6-efdc52797490.target.wants/ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mgr.y.service → /etc/systemd/system/ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@.service. 2024-09-21T17:40:25.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3403777956' entity='client.admin' 2024-09-21T17:40:25.846 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:25 smithi042 systemd[1]: Starting Ceph mgr.y for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:40:26.115 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:25 smithi042 podman[29574]: 2024-09-21 17:40:25.843957353 +0000 UTC m=+0.105168629 container create 8ebd75c0e6a1ce286b8c1c204e9e4df4a29a7c37911ae0eba4fa1f9831690aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T17:40:26.115 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:25 smithi042 podman[29574]: 2024-09-21 17:40:25.755025836 +0000 UTC m=+0.016237070 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe 2024-09-21T17:40:26.115 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:26 smithi042 podman[29574]: 2024-09-21 17:40:26.038100668 +0000 UTC m=+0.299311906 container init 8ebd75c0e6a1ce286b8c1c204e9e4df4a29a7c37911ae0eba4fa1f9831690aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.license=GPLv2) 2024-09-21T17:40:26.115 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:26 smithi042 podman[29574]: 2024-09-21 17:40:26.041039412 +0000 UTC m=+0.302250644 container start 8ebd75c0e6a1ce286b8c1c204e9e4df4a29a7c37911ae0eba4fa1f9831690aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T17:40:26.115 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:26 smithi042 bash[29574]: 8ebd75c0e6a1ce286b8c1c204e9e4df4a29a7c37911ae0eba4fa1f9831690aea 2024-09-21T17:40:26.130 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T17:40:26.130 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-21T17:40:26.138 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T17:40:26.138 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-21T17:40:26.139 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-21T17:40:26.139 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T17:40:26.148 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T17:40:26.148 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-21T17:40:26.155 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T17:40:26.155 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-21T17:40:26.155 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-21T17:40:26.155 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T17:40:26.155 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr to start... 2024-09-21T17:40:26.155 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr... 2024-09-21T17:40:26.393 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:26 smithi042 systemd[1]: Started Ceph mgr.y for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:40:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4269883277' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T17:40:27.435 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:27.435 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-21T17:40:27.435 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "6e3cf65a-7840-11ef-baf6-efdc52797490", 2024-09-21T17:40:27.435 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T17:40:27.435 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T17:40:27.435 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T17:40:27.435 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:27.436 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T17:40:27.437 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T17:40:27.437 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:27.437 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T17:40:27.437 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:27.437 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T17:40:27.437 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T17:40:27.437 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T17:40:27.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T17:40:27.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T17:40:27.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T17:40:27.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:27.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T17:40:27.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T17:40:27.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T17:40:27.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T17:40:19:412275+0000", 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T17:40:27.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T17:40:19.412932+0000", 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.571+0000 7f6ba3d00640 1 Processor -- start 2024-09-21T17:40:27.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.571+0000 7f6ba3d00640 1 -- start start 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.571+0000 7f6ba3d00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c105c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.571+0000 7f6ba3d00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c106250 con 0x7f6b9c105860 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.571+0000 7f6ba1a9c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.571+0000 7f6ba1a9c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c105c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50014/0 (socket says 172.21.15.42:50014) 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.572+0000 7f6ba1a9c640 1 -- 172.21.15.42:0/651161544 learned_addr learned my addr 172.21.15.42:0/651161544 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.572+0000 7f6ba1a9c640 1 -- 172.21.15.42:0/651161544 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c1063d0 con 0x7f6b9c105860 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.572+0000 7f6ba1a9c640 1 --2- 172.21.15.42:0/651161544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c105c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800bac0 tx=0x7f6b9800b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d057f8333d9931f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.573+0000 7f6ba0a9a640 1 -- 172.21.15.42:0/651161544 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b9803a070 con 0x7f6b9c105860 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.573+0000 7f6ba0a9a640 1 -- 172.21.15.42:0/651161544 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f6b98033aa0 con 0x7f6b9c105860 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.573+0000 7f6ba0a9a640 1 -- 172.21.15.42:0/651161544 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b98035b30 con 0x7f6b9c105860 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.573+0000 7f6ba3d00640 1 -- 172.21.15.42:0/651161544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 msgr2=0x7f6b9c105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.573+0000 7f6ba3d00640 1 --2- 172.21.15.42:0/651161544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c105c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800bac0 tx=0x7f6b9800b450 comp rx=0 tx=0).stop 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.573+0000 7f6ba3d00640 1 -- 172.21.15.42:0/651161544 shutdown_connections 2024-09-21T17:40:27.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.573+0000 7f6ba3d00640 1 --2- 172.21.15.42:0/651161544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c105c60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.573+0000 7f6ba3d00640 1 -- 172.21.15.42:0/651161544 >> 172.21.15.42:0/651161544 conn(0x7f6b9c1011b0 msgr2=0x7f6b9c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.574+0000 7f6ba3d00640 1 -- 172.21.15.42:0/651161544 shutdown_connections 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.574+0000 7f6ba3d00640 1 -- 172.21.15.42:0/651161544 wait complete. 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.574+0000 7f6ba3d00640 1 Processor -- start 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.574+0000 7f6ba3d00640 1 -- start start 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.574+0000 7f6ba3d00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.574+0000 7f6ba3d00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0797f0 con 0x7f6b9c105860 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.574+0000 7f6ba1a9c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.575+0000 7f6ba1a9c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50022/0 (socket says 172.21.15.42:50022) 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.575+0000 7f6ba1a9c640 1 -- 172.21.15.42:0/4269883277 learned_addr learned my addr 172.21.15.42:0/4269883277 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.575+0000 7f6ba1a9c640 1 -- 172.21.15.42:0/4269883277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c198bd0 con 0x7f6b9c105860 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.575+0000 7f6ba1a9c640 1 --2- 172.21.15.42:0/4269883277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c198670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800ba90 tx=0x7f6b980337b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.575+0000 7f6b92ffd640 1 -- 172.21.15.42:0/4269883277 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b98045020 con 0x7f6b9c105860 2024-09-21T17:40:27.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.575+0000 7f6b92ffd640 1 -- 172.21.15.42:0/4269883277 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f6b98040a00 con 0x7f6b9c105860 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.575+0000 7f6ba3d00640 1 -- 172.21.15.42:0/4269883277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c198e60 con 0x7f6b9c105860 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.575+0000 7f6b92ffd640 1 -- 172.21.15.42:0/4269883277 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b9803a040 con 0x7f6b9c105860 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.575+0000 7f6ba3d00640 1 -- 172.21.15.42:0/4269883277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c199820 con 0x7f6b9c105860 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.576+0000 7f6b90ff9640 1 -- 172.21.15.42:0/4269883277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9c105c60 con 0x7f6b9c105860 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.576+0000 7f6b92ffd640 1 -- 172.21.15.42:0/4269883277 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6b98048020 con 0x7f6b9c105860 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.576+0000 7f6b92ffd640 1 -- 172.21.15.42:0/4269883277 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6b9804a400 con 0x7f6b9c105860 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.578+0000 7f6b92ffd640 1 -- 172.21.15.42:0/4269883277 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6b980339c0 con 0x7f6b9c105860 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.642+0000 7f6b90ff9640 1 -- 172.21.15.42:0/4269883277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6b9c19a300 con 0x7f6b9c105860 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.643+0000 7f6b92ffd640 1 -- 172.21.15.42:0/4269883277 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f6b9804a6f0 con 0x7f6b9c105860 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.644+0000 7f6b90ff9640 1 -- 172.21.15.42:0/4269883277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 msgr2=0x7f6b9c198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.644+0000 7f6b90ff9640 1 --2- 172.21.15.42:0/4269883277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c198670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800ba90 tx=0x7f6b980337b0 comp rx=0 tx=0).stop 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.644+0000 7f6b90ff9640 1 -- 172.21.15.42:0/4269883277 shutdown_connections 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.644+0000 7f6b90ff9640 1 --2- 172.21.15.42:0/4269883277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c105860 0x7f6b9c198670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.644+0000 7f6b90ff9640 1 -- 172.21.15.42:0/4269883277 >> 172.21.15.42:0/4269883277 conn(0x7f6b9c1011b0 msgr2=0x7f6b9c18eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:27.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.644+0000 7f6b90ff9640 1 -- 172.21.15.42:0/4269883277 shutdown_connections 2024-09-21T17:40:27.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:26.644+0000 7f6b90ff9640 1 -- 172.21.15.42:0/4269883277 wait complete. 2024-09-21T17:40:27.450 INFO:teuthology.orchestra.run.smithi042.stdout:mgr not available, waiting (1/15)... 2024-09-21T17:40:30.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2155543818' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "6e3cf65a-7840-11ef-baf6-efdc52797490", 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-21T17:40:30.791 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T17:40:30.792 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:30.793 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T17:40:19:412275+0000", 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-21T17:40:30.794 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T17:40:19.412932+0000", 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.842+0000 7f65c85ea640 1 Processor -- start 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.842+0000 7f65c85ea640 1 -- start start 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.842+0000 7f65c85ea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c0109520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.842+0000 7f65c85ea640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f65c0109a60 con 0x7f65c007a440 2024-09-21T17:40:30.795 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.843+0000 7f65c6386640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c0109520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.843+0000 7f65c6386640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c0109520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50032/0 (socket says 172.21.15.42:50032) 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.843+0000 7f65c6386640 1 -- 172.21.15.42:0/1692646694 learned_addr learned my addr 172.21.15.42:0/1692646694 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.843+0000 7f65c6386640 1 -- 172.21.15.42:0/1692646694 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c0109be0 con 0x7f65c007a440 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.844+0000 7f65c6386640 1 --2- 172.21.15.42:0/1692646694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c0109520 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009820 tx=0x7f65bc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156eab275393078e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.844+0000 7f65c5384640 1 -- 172.21.15.42:0/1692646694 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65bc037070 con 0x7f65c007a440 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.844+0000 7f65c5384640 1 -- 172.21.15.42:0/1692646694 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f65bc0328a0 con 0x7f65c007a440 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.844+0000 7f65c5384640 1 -- 172.21.15.42:0/1692646694 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65bc030710 con 0x7f65c007a440 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.845+0000 7f65c85ea640 1 -- 172.21.15.42:0/1692646694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 msgr2=0x7f65c0109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.845+0000 7f65c85ea640 1 --2- 172.21.15.42:0/1692646694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c0109520 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009820 tx=0x7f65bc02a300 comp rx=0 tx=0).stop 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.845+0000 7f65c85ea640 1 -- 172.21.15.42:0/1692646694 shutdown_connections 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.845+0000 7f65c85ea640 1 --2- 172.21.15.42:0/1692646694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c0109520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.845+0000 7f65c85ea640 1 -- 172.21.15.42:0/1692646694 >> 172.21.15.42:0/1692646694 conn(0x7f65c01011b0 msgr2=0x7f65c01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:30.796 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.845+0000 7f65c85ea640 1 -- 172.21.15.42:0/1692646694 shutdown_connections 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.845+0000 7f65c85ea640 1 -- 172.21.15.42:0/1692646694 wait complete. 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.845+0000 7f65c85ea640 1 Processor -- start 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.845+0000 7f65c85ea640 1 -- start start 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.846+0000 7f65c85ea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.846+0000 7f65c85ea640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f65c010aca0 con 0x7f65c007a440 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.846+0000 7f65c6386640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.846+0000 7f65c6386640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c019a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50036/0 (socket says 172.21.15.42:50036) 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.846+0000 7f65c6386640 1 -- 172.21.15.42:0/2155543818 learned_addr learned my addr 172.21.15.42:0/2155543818 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.846+0000 7f65c6386640 1 -- 172.21.15.42:0/2155543818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c019ae20 con 0x7f65c007a440 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.846+0000 7f65c6386640 1 --2- 172.21.15.42:0/2155543818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c019a8c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f65bc030460 tx=0x7f65bc030710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.846+0000 7f65b77fe640 1 -- 172.21.15.42:0/2155543818 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65bc037040 con 0x7f65c007a440 2024-09-21T17:40:30.797 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.846+0000 7f65b77fe640 1 -- 172.21.15.42:0/2155543818 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f65bc040070 con 0x7f65c007a440 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.846+0000 7f65c85ea640 1 -- 172.21.15.42:0/2155543818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c019b0b0 con 0x7f65c007a440 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.846+0000 7f65c85ea640 1 -- 172.21.15.42:0/2155543818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c019ba70 con 0x7f65c007a440 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.847+0000 7f65b77fe640 1 -- 172.21.15.42:0/2155543818 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65bc03be30 con 0x7f65c007a440 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.847+0000 7f65b77fe640 1 -- 172.21.15.42:0/2155543818 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f65bc0454a0 con 0x7f65c007a440 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.847+0000 7f65b77fe640 1 -- 172.21.15.42:0/2155543818 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f65bc03a780 con 0x7f65c007a440 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.847+0000 7f65c85ea640 1 -- 172.21.15.42:0/2155543818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a40050b0 con 0x7f65c007a440 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.849+0000 7f65b77fe640 1 -- 172.21.15.42:0/2155543818 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f65bc03b5c0 con 0x7f65c007a440 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.913+0000 7f65c85ea640 1 -- 172.21.15.42:0/2155543818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f65a4005670 con 0x7f65c007a440 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.913+0000 7f65b77fe640 1 -- 172.21.15.42:0/2155543818 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f65bc030af0 con 0x7f65c007a440 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.914+0000 7f65c85ea640 1 -- 172.21.15.42:0/2155543818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 msgr2=0x7f65c019a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.914+0000 7f65c85ea640 1 --2- 172.21.15.42:0/2155543818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c019a8c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f65bc030460 tx=0x7f65bc030710 comp rx=0 tx=0).stop 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.914+0000 7f65c85ea640 1 -- 172.21.15.42:0/2155543818 shutdown_connections 2024-09-21T17:40:30.798 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.914+0000 7f65c85ea640 1 --2- 172.21.15.42:0/2155543818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65c007a440 0x7f65c019a8c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:30.799 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.914+0000 7f65c85ea640 1 -- 172.21.15.42:0/2155543818 >> 172.21.15.42:0/2155543818 conn(0x7f65c01011b0 msgr2=0x7f65c0101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:30.799 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.914+0000 7f65c85ea640 1 -- 172.21.15.42:0/2155543818 shutdown_connections 2024-09-21T17:40:30.799 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:29.914+0000 7f65c85ea640 1 -- 172.21.15.42:0/2155543818 wait complete. 2024-09-21T17:40:30.799 INFO:teuthology.orchestra.run.smithi042.stdout:mgr not available, waiting (2/15)... 2024-09-21T17:40:31.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: Activating manager daemon y 2024-09-21T17:40:31.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: mgrmap e2: y(active, starting, since 0.00328498s) 2024-09-21T17:40:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: from='mgr.14100 172.21.15.42:0/1836092487' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T17:40:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: from='mgr.14100 172.21.15.42:0/1836092487' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T17:40:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: from='mgr.14100 172.21.15.42:0/1836092487' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T17:40:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: from='mgr.14100 172.21.15.42:0/1836092487' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:40:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: from='mgr.14100 172.21.15.42:0/1836092487' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T17:40:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: Manager daemon y is now available 2024-09-21T17:40:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: from='mgr.14100 172.21.15.42:0/1836092487' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T17:40:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: from='mgr.14100 172.21.15.42:0/1836092487' entity='mgr.y' 2024-09-21T17:40:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: from='mgr.14100 172.21.15.42:0/1836092487' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T17:40:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: from='mgr.14100 172.21.15.42:0/1836092487' entity='mgr.y' 2024-09-21T17:40:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:31 smithi042 ceph-mon[29361]: from='mgr.14100 172.21.15.42:0/1836092487' entity='mgr.y' 2024-09-21T17:40:33.459 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:33 smithi042 ceph-mon[29361]: mgrmap e3: y(active, since 1.00736s) 2024-09-21T17:40:34.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:34.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "6e3cf65a-7840-11ef-baf6-efdc52797490", 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-21T17:40:34.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T17:40:34.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T17:40:34.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:34.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T17:40:34.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T17:40:34.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:34.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T17:40:34.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:34.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T17:40:34.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T17:40:34.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T17:40:34.024 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T17:40:19:412275+0000", 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T17:40:34.025 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T17:40:19.412932+0000", 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.179+0000 7f3824b8c640 1 Processor -- start 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.179+0000 7f3824b8c640 1 -- start start 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.179+0000 7f3824b8c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f3820106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.179+0000 7f3824b8c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3820107350 con 0x7f3820106960 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.179+0000 7f381e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f3820106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:34.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.179+0000 7f381e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f3820106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43388/0 (socket says 172.21.15.42:43388) 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.179+0000 7f381e59c640 1 -- 172.21.15.42:0/2265512052 learned_addr learned my addr 172.21.15.42:0/2265512052 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.179+0000 7f381e59c640 1 -- 172.21.15.42:0/2265512052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38201074d0 con 0x7f3820106960 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.180+0000 7f381e59c640 1 --2- 172.21.15.42:0/2265512052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f3820106d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3810009820 tx=0x7f381002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555cb1819ba1f217 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.180+0000 7f381d59a640 1 -- 172.21.15.42:0/2265512052 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3810037070 con 0x7f3820106960 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.180+0000 7f381d59a640 1 -- 172.21.15.42:0/2265512052 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f38100328a0 con 0x7f3820106960 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.180+0000 7f381d59a640 1 -- 172.21.15.42:0/2265512052 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3810030690 con 0x7f3820106960 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.181+0000 7f3824b8c640 1 -- 172.21.15.42:0/2265512052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 msgr2=0x7f3820106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.181+0000 7f3824b8c640 1 --2- 172.21.15.42:0/2265512052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f3820106d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3810009820 tx=0x7f381002a270 comp rx=0 tx=0).stop 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.181+0000 7f3824b8c640 1 -- 172.21.15.42:0/2265512052 shutdown_connections 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.181+0000 7f3824b8c640 1 --2- 172.21.15.42:0/2265512052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f3820106d60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.181+0000 7f3824b8c640 1 -- 172.21.15.42:0/2265512052 >> 172.21.15.42:0/2265512052 conn(0x7f3820102250 msgr2=0x7f3820104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.181+0000 7f3824b8c640 1 -- 172.21.15.42:0/2265512052 shutdown_connections 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.181+0000 7f3824b8c640 1 -- 172.21.15.42:0/2265512052 wait complete. 2024-09-21T17:40:34.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.182+0000 7f3824b8c640 1 Processor -- start 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.182+0000 7f3824b8c640 1 -- start start 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.182+0000 7f3824b8c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f382007c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.182+0000 7f3824b8c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f382010ade0 con 0x7f3820106960 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.182+0000 7f381e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f382007c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.182+0000 7f381e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f382007c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43402/0 (socket says 172.21.15.42:43402) 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.182+0000 7f381e59c640 1 -- 172.21.15.42:0/3552176410 learned_addr learned my addr 172.21.15.42:0/3552176410 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.183+0000 7f381e59c640 1 -- 172.21.15.42:0/3552176410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382007cef0 con 0x7f3820106960 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.183+0000 7f381e59c640 1 --2- 172.21.15.42:0/3552176410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f382007c990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3810000c00 tx=0x7f3810032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.183+0000 7f38177fe640 1 -- 172.21.15.42:0/3552176410 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3810037040 con 0x7f3820106960 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.183+0000 7f3824b8c640 1 -- 172.21.15.42:0/3552176410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382007b2e0 con 0x7f3820106960 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.183+0000 7f38177fe640 1 -- 172.21.15.42:0/3552176410 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f3810040070 con 0x7f3820106960 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.183+0000 7f38177fe640 1 -- 172.21.15.42:0/3552176410 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f381003be40 con 0x7f3820106960 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.183+0000 7f3824b8c640 1 -- 172.21.15.42:0/3552176410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382007b860 con 0x7f3820106960 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.184+0000 7f38177fe640 1 -- 172.21.15.42:0/3552176410 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 3) ==== 51690+0+0 (secure 0 0 0) 0x7f381003b680 con 0x7f3820106960 2024-09-21T17:40:34.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.184+0000 7f3824b8c640 1 -- 172.21.15.42:0/3552176410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3820106de0 con 0x7f3820106960 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.184+0000 7f38177fe640 1 --2- 172.21.15.42:0/3552176410 >> v2:172.21.15.42:6800/604611129 conn(0x7f380c03f6f0 0x7f380c041bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.184+0000 7f38177fe640 1 -- 172.21.15.42:0/3552176410 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3810073b60 con 0x7f3820106960 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.184+0000 7f381dd9b640 1 --2- 172.21.15.42:0/3552176410 >> v2:172.21.15.42:6800/604611129 conn(0x7f380c03f6f0 0x7f380c041bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.185+0000 7f381dd9b640 1 --2- 172.21.15.42:0/3552176410 >> v2:172.21.15.42:6800/604611129 conn(0x7f380c03f6f0 0x7f380c041bb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f38080098c0 tx=0x7f3808006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.190+0000 7f38177fe640 1 -- 172.21.15.42:0/3552176410 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f381003b430 con 0x7f3820106960 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.293+0000 7f38177fe640 1 -- 172.21.15.42:0/3552176410 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 4) ==== 51796+0+0 (secure 0 0 0) 0x7f3810045460 con 0x7f3820106960 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.457+0000 7f3824b8c640 1 -- 172.21.15.42:0/3552176410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f382007bd90 con 0x7f3820106960 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.457+0000 7f38177fe640 1 -- 172.21.15.42:0/3552176410 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f3810038250 con 0x7f3820106960 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.460+0000 7f3824b8c640 1 -- 172.21.15.42:0/3552176410 >> v2:172.21.15.42:6800/604611129 conn(0x7f380c03f6f0 msgr2=0x7f380c041bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.460+0000 7f3824b8c640 1 --2- 172.21.15.42:0/3552176410 >> v2:172.21.15.42:6800/604611129 conn(0x7f380c03f6f0 0x7f380c041bb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f38080098c0 tx=0x7f3808006db0 comp rx=0 tx=0).stop 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.460+0000 7f3824b8c640 1 -- 172.21.15.42:0/3552176410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 msgr2=0x7f382007c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.460+0000 7f3824b8c640 1 --2- 172.21.15.42:0/3552176410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f382007c990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3810000c00 tx=0x7f3810032740 comp rx=0 tx=0).stop 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.460+0000 7f3824b8c640 1 -- 172.21.15.42:0/3552176410 shutdown_connections 2024-09-21T17:40:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.460+0000 7f3824b8c640 1 --2- 172.21.15.42:0/3552176410 >> v2:172.21.15.42:6800/604611129 conn(0x7f380c03f6f0 0x7f380c041bb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:34.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.460+0000 7f3824b8c640 1 --2- 172.21.15.42:0/3552176410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3820106960 0x7f382007c990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:34.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.460+0000 7f3824b8c640 1 -- 172.21.15.42:0/3552176410 >> 172.21.15.42:0/3552176410 conn(0x7f3820102250 msgr2=0x7f3820102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:34.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.460+0000 7f3824b8c640 1 -- 172.21.15.42:0/3552176410 shutdown_connections 2024-09-21T17:40:34.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:33.460+0000 7f3824b8c640 1 -- 172.21.15.42:0/3552176410 wait complete. 2024-09-21T17:40:34.030 INFO:teuthology.orchestra.run.smithi042.stdout:mgr is available 2024-09-21T17:40:34.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:34 smithi042 ceph-mon[29361]: mgrmap e4: y(active, since 2s) 2024-09-21T17:40:34.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3552176410' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T17:40:35.066 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:35.066 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout fsid = 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T17:40:35.067 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.436+0000 7fd909409640 1 Processor -- start 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.437+0000 7fd909409640 1 -- start start 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.437+0000 7fd909409640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd90407b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.437+0000 7fd909409640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd90407b8c0 con 0x7fd90407cd20 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.437+0000 7fd902ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd90407b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.437+0000 7fd902ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd90407b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43418/0 (socket says 172.21.15.42:43418) 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.437+0000 7fd902ffd640 1 -- 172.21.15.42:0/4188687727 learned_addr learned my addr 172.21.15.42:0/4188687727 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.437+0000 7fd902ffd640 1 -- 172.21.15.42:0/4188687727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90407ba40 con 0x7fd90407cd20 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.438+0000 7fd902ffd640 1 --2- 172.21.15.42:0/4188687727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd90407b380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009820 tx=0x7fd8f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd9cb6ba80d738b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.438+0000 7fd901ffb640 1 -- 172.21.15.42:0/4188687727 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8f4037070 con 0x7fd90407cd20 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.438+0000 7fd901ffb640 1 -- 172.21.15.42:0/4188687727 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fd8f40328a0 con 0x7fd90407cd20 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.438+0000 7fd901ffb640 1 -- 172.21.15.42:0/4188687727 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8f4030690 con 0x7fd90407cd20 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.439+0000 7fd909409640 1 -- 172.21.15.42:0/4188687727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 msgr2=0x7fd90407b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.439+0000 7fd909409640 1 --2- 172.21.15.42:0/4188687727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd90407b380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009820 tx=0x7fd8f402a270 comp rx=0 tx=0).stop 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.439+0000 7fd909409640 1 -- 172.21.15.42:0/4188687727 shutdown_connections 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.439+0000 7fd909409640 1 --2- 172.21.15.42:0/4188687727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd90407b380 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.439+0000 7fd909409640 1 -- 172.21.15.42:0/4188687727 >> 172.21.15.42:0/4188687727 conn(0x7fd904102250 msgr2=0x7fd904104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.439+0000 7fd909409640 1 -- 172.21.15.42:0/4188687727 shutdown_connections 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.439+0000 7fd909409640 1 -- 172.21.15.42:0/4188687727 wait complete. 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.439+0000 7fd909409640 1 Processor -- start 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.440+0000 7fd909409640 1 -- start start 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.440+0000 7fd909409640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd9041a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.440+0000 7fd909409640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd904108ac0 con 0x7fd90407cd20 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.440+0000 7fd902ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd9041a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.440+0000 7fd902ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd9041a0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43426/0 (socket says 172.21.15.42:43426) 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.440+0000 7fd902ffd640 1 -- 172.21.15.42:0/2075924758 learned_addr learned my addr 172.21.15.42:0/2075924758 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.440+0000 7fd902ffd640 1 -- 172.21.15.42:0/2075924758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9041a1400 con 0x7fd90407cd20 2024-09-21T17:40:35.069 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.440+0000 7fd902ffd640 1 --2- 172.21.15.42:0/2075924758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd9041a0ea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4000c00 tx=0x7fd8f4032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.441+0000 7fd8ebfff640 1 -- 172.21.15.42:0/2075924758 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8f4037040 con 0x7fd90407cd20 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.441+0000 7fd8ebfff640 1 -- 172.21.15.42:0/2075924758 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fd8f4040070 con 0x7fd90407cd20 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.441+0000 7fd909409640 1 -- 172.21.15.42:0/2075924758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9041a1690 con 0x7fd90407cd20 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.441+0000 7fd8ebfff640 1 -- 172.21.15.42:0/2075924758 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8f403be40 con 0x7fd90407cd20 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.441+0000 7fd909409640 1 -- 172.21.15.42:0/2075924758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9041a2050 con 0x7fd90407cd20 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.442+0000 7fd8ebfff640 1 -- 172.21.15.42:0/2075924758 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 51796+0+0 (secure 0 0 0) 0x7fd8f4045460 con 0x7fd90407cd20 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.442+0000 7fd909409640 1 -- 172.21.15.42:0/2075924758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd90407b400 con 0x7fd90407cd20 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.442+0000 7fd8ebfff640 1 --2- 172.21.15.42:0/2075924758 >> v2:172.21.15.42:6800/604611129 conn(0x7fd8ec03f870 0x7fd8ec041d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.442+0000 7fd8ebfff640 1 -- 172.21.15.42:0/2075924758 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd8f4073f50 con 0x7fd90407cd20 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.442+0000 7fd9027fc640 1 --2- 172.21.15.42:0/2075924758 >> v2:172.21.15.42:6800/604611129 conn(0x7fd8ec03f870 0x7fd8ec041d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.442+0000 7fd9027fc640 1 --2- 172.21.15.42:0/2075924758 >> v2:172.21.15.42:6800/604611129 conn(0x7fd8ec03f870 0x7fd8ec041d30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80098c0 tx=0x7fd8f8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.447+0000 7fd8ebfff640 1 -- 172.21.15.42:0/2075924758 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fd8f403b430 con 0x7fd90407cd20 2024-09-21T17:40:35.070 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.632+0000 7fd909409640 1 -- 172.21.15.42:0/2075924758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fd9041a2770 con 0x7fd90407cd20 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.633+0000 7fd8ebfff640 1 -- 172.21.15.42:0/2075924758 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+374 (secure 0 0 0) 0x7fd8f4073cb0 con 0x7fd90407cd20 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.636+0000 7fd909409640 1 -- 172.21.15.42:0/2075924758 >> v2:172.21.15.42:6800/604611129 conn(0x7fd8ec03f870 msgr2=0x7fd8ec041d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.636+0000 7fd909409640 1 --2- 172.21.15.42:0/2075924758 >> v2:172.21.15.42:6800/604611129 conn(0x7fd8ec03f870 0x7fd8ec041d30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80098c0 tx=0x7fd8f8006db0 comp rx=0 tx=0).stop 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.636+0000 7fd909409640 1 -- 172.21.15.42:0/2075924758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 msgr2=0x7fd9041a0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.636+0000 7fd909409640 1 --2- 172.21.15.42:0/2075924758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd9041a0ea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4000c00 tx=0x7fd8f4032740 comp rx=0 tx=0).stop 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.636+0000 7fd909409640 1 -- 172.21.15.42:0/2075924758 shutdown_connections 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.636+0000 7fd909409640 1 --2- 172.21.15.42:0/2075924758 >> v2:172.21.15.42:6800/604611129 conn(0x7fd8ec03f870 0x7fd8ec041d30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.636+0000 7fd909409640 1 --2- 172.21.15.42:0/2075924758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd90407cd20 0x7fd9041a0ea0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.636+0000 7fd909409640 1 -- 172.21.15.42:0/2075924758 >> 172.21.15.42:0/2075924758 conn(0x7fd904102250 msgr2=0x7fd904102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.637+0000 7fd909409640 1 -- 172.21.15.42:0/2075924758 shutdown_connections 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:34.637+0000 7fd909409640 1 -- 172.21.15.42:0/2075924758 wait complete. 2024-09-21T17:40:35.071 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling cephadm module... 2024-09-21T17:40:35.403 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2075924758' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T17:40:36.615 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/573249501' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T17:40:36.615 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:36 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ignoring --setuser ceph since I am not root 2024-09-21T17:40:36.615 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:36 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ignoring --setgroup ceph since I am not root 2024-09-21T17:40:36.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.501+0000 7f0071a8b640 1 Processor -- start 2024-09-21T17:40:36.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.502+0000 7f0071a8b640 1 -- start start 2024-09-21T17:40:36.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.502+0000 7f0071a8b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c105c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:36.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.502+0000 7f0071a8b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f006c106250 con 0x7f006c105860 2024-09-21T17:40:36.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.502+0000 7f006b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:36.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.502+0000 7f006b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c105c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43428/0 (socket says 172.21.15.42:43428) 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.502+0000 7f006b7fe640 1 -- 172.21.15.42:0/931558912 learned_addr learned my addr 172.21.15.42:0/931558912 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.502+0000 7f006b7fe640 1 -- 172.21.15.42:0/931558912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c1063d0 con 0x7f006c105860 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.503+0000 7f006b7fe640 1 --2- 172.21.15.42:0/931558912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c105c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f005c009820 tx=0x7f005c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952fe7d7a37eaf5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.503+0000 7f006affd640 1 -- 172.21.15.42:0/931558912 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f005c037070 con 0x7f006c105860 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.503+0000 7f006affd640 1 -- 172.21.15.42:0/931558912 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f005c0328a0 con 0x7f006c105860 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.503+0000 7f006affd640 1 -- 172.21.15.42:0/931558912 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f005c030690 con 0x7f006c105860 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.504+0000 7f0071a8b640 1 -- 172.21.15.42:0/931558912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 msgr2=0x7f006c105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.504+0000 7f0071a8b640 1 --2- 172.21.15.42:0/931558912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c105c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f005c009820 tx=0x7f005c02a270 comp rx=0 tx=0).stop 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.504+0000 7f0071a8b640 1 -- 172.21.15.42:0/931558912 shutdown_connections 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.504+0000 7f0071a8b640 1 --2- 172.21.15.42:0/931558912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c105c60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.504+0000 7f0071a8b640 1 -- 172.21.15.42:0/931558912 >> 172.21.15.42:0/931558912 conn(0x7f006c1011b0 msgr2=0x7f006c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.504+0000 7f0071a8b640 1 -- 172.21.15.42:0/931558912 shutdown_connections 2024-09-21T17:40:36.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.504+0000 7f0071a8b640 1 -- 172.21.15.42:0/931558912 wait complete. 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.505+0000 7f0071a8b640 1 Processor -- start 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.505+0000 7f0071a8b640 1 -- start start 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.505+0000 7f0071a8b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c190810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.505+0000 7f0071a8b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f006c109ce0 con 0x7f006c105860 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.505+0000 7f006b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c190810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.505+0000 7f006b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c190810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43438/0 (socket says 172.21.15.42:43438) 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.505+0000 7f006b7fe640 1 -- 172.21.15.42:0/573249501 learned_addr learned my addr 172.21.15.42:0/573249501 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.505+0000 7f006b7fe640 1 -- 172.21.15.42:0/573249501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c190d70 con 0x7f006c105860 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.506+0000 7f006b7fe640 1 --2- 172.21.15.42:0/573249501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c190810 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f005c000c00 tx=0x7f005c032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.506+0000 7f00697fa640 1 -- 172.21.15.42:0/573249501 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f005c037040 con 0x7f006c105860 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.506+0000 7f0071a8b640 1 -- 172.21.15.42:0/573249501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006c18f160 con 0x7f006c105860 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.506+0000 7f00697fa640 1 -- 172.21.15.42:0/573249501 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f005c040070 con 0x7f006c105860 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.506+0000 7f00697fa640 1 -- 172.21.15.42:0/573249501 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f005c03be40 con 0x7f006c105860 2024-09-21T17:40:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.506+0000 7f0071a8b640 1 -- 172.21.15.42:0/573249501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f006c18f6e0 con 0x7f006c105860 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.507+0000 7f00697fa640 1 -- 172.21.15.42:0/573249501 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 51796+0+0 (secure 0 0 0) 0x7f005c045460 con 0x7f006c105860 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.507+0000 7f00697fa640 1 --2- 172.21.15.42:0/573249501 >> v2:172.21.15.42:6800/604611129 conn(0x7f005803f820 0x7f0058041ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.507+0000 7f00697fa640 1 -- 172.21.15.42:0/573249501 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f005c073df0 con 0x7f006c105860 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.507+0000 7f0071a8b640 1 -- 172.21.15.42:0/573249501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f006c105ce0 con 0x7f006c105860 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.507+0000 7f0063fff640 1 --2- 172.21.15.42:0/573249501 >> v2:172.21.15.42:6800/604611129 conn(0x7f005803f820 0x7f0058041ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.508+0000 7f0063fff640 1 --2- 172.21.15.42:0/573249501 >> v2:172.21.15.42:6800/604611129 conn(0x7f005803f820 0x7f0058041ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00540098c0 tx=0x7f0054006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.512+0000 7f00697fa640 1 -- 172.21.15.42:0/573249501 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f005c03b430 con 0x7f006c105860 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:35.751+0000 7f0071a8b640 1 -- 172.21.15.42:0/573249501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f006c18fbd0 con 0x7f006c105860 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.296+0000 7f00697fa640 1 -- 172.21.15.42:0/573249501 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f005c073b50 con 0x7f006c105860 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.298+0000 7f00697fa640 1 -- 172.21.15.42:0/573249501 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mgrmap(e 5) ==== 51807+0+0 (secure 0 0 0) 0x7f005c040af0 con 0x7f006c105860 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.300+0000 7f0071a8b640 1 -- 172.21.15.42:0/573249501 >> v2:172.21.15.42:6800/604611129 conn(0x7f005803f820 msgr2=0x7f0058041ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.300+0000 7f0071a8b640 1 --2- 172.21.15.42:0/573249501 >> v2:172.21.15.42:6800/604611129 conn(0x7f005803f820 0x7f0058041ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00540098c0 tx=0x7f0054006db0 comp rx=0 tx=0).stop 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.300+0000 7f0071a8b640 1 -- 172.21.15.42:0/573249501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 msgr2=0x7f006c190810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:36.917 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.300+0000 7f0071a8b640 1 --2- 172.21.15.42:0/573249501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c190810 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f005c000c00 tx=0x7f005c032740 comp rx=0 tx=0).stop 2024-09-21T17:40:36.918 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.300+0000 7f0071a8b640 1 -- 172.21.15.42:0/573249501 shutdown_connections 2024-09-21T17:40:36.918 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.300+0000 7f0071a8b640 1 --2- 172.21.15.42:0/573249501 >> v2:172.21.15.42:6800/604611129 conn(0x7f005803f820 0x7f0058041ce0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:36.918 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.300+0000 7f0071a8b640 1 --2- 172.21.15.42:0/573249501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f006c105860 0x7f006c190810 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:36.918 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.300+0000 7f0071a8b640 1 -- 172.21.15.42:0/573249501 >> 172.21.15.42:0/573249501 conn(0x7f006c1011b0 msgr2=0x7f006c101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:36.918 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.300+0000 7f0071a8b640 1 -- 172.21.15.42:0/573249501 shutdown_connections 2024-09-21T17:40:36.918 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:36.300+0000 7f0071a8b640 1 -- 172.21.15.42:0/573249501 wait complete. 2024-09-21T17:40:37.463 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/573249501' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T17:40:37.464 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:37 smithi042 ceph-mon[29361]: mgrmap e5: y(active, since 5s) 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.253+0000 7f72080f8640 1 Processor -- start 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.254+0000 7f72080f8640 1 -- start start 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.254+0000 7f72080f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f7200109520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.254+0000 7f72080f8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7200109a60 con 0x7f720007a440 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.254+0000 7f7205e94640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f7200109520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.254+0000 7f7205e94640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f7200109520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43460/0 (socket says 172.21.15.42:43460) 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.254+0000 7f7205e94640 1 -- 172.21.15.42:0/532319319 learned_addr learned my addr 172.21.15.42:0/532319319 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.255+0000 7f7205e94640 1 -- 172.21.15.42:0/532319319 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7200109be0 con 0x7f720007a440 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.255+0000 7f7205e94640 1 --2- 172.21.15.42:0/532319319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f7200109520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009820 tx=0x7f71fc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96e32b5bdd13a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.256+0000 7f7204e92640 1 -- 172.21.15.42:0/532319319 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71fc037070 con 0x7f720007a440 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.256+0000 7f7204e92640 1 -- 172.21.15.42:0/532319319 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f71fc0328a0 con 0x7f720007a440 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.256+0000 7f7204e92640 1 -- 172.21.15.42:0/532319319 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71fc030710 con 0x7f720007a440 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.256+0000 7f72080f8640 1 -- 172.21.15.42:0/532319319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 msgr2=0x7f7200109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.256+0000 7f72080f8640 1 --2- 172.21.15.42:0/532319319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f7200109520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009820 tx=0x7f71fc02a300 comp rx=0 tx=0).stop 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.256+0000 7f72080f8640 1 -- 172.21.15.42:0/532319319 shutdown_connections 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.256+0000 7f72080f8640 1 --2- 172.21.15.42:0/532319319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f7200109520 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.257+0000 7f72080f8640 1 -- 172.21.15.42:0/532319319 >> 172.21.15.42:0/532319319 conn(0x7f72001011b0 msgr2=0x7f72001035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.257+0000 7f72080f8640 1 -- 172.21.15.42:0/532319319 shutdown_connections 2024-09-21T17:40:38.098 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.257+0000 7f72080f8640 1 -- 172.21.15.42:0/532319319 wait complete. 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.257+0000 7f72080f8640 1 Processor -- start 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.258+0000 7f72080f8640 1 -- start start 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.258+0000 7f72080f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f720019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.258+0000 7f72080f8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f720010aca0 con 0x7f720007a440 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.258+0000 7f7205e94640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f720019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.258+0000 7f7205e94640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f720019a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43464/0 (socket says 172.21.15.42:43464) 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.258+0000 7f7205e94640 1 -- 172.21.15.42:0/1692282304 learned_addr learned my addr 172.21.15.42:0/1692282304 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.258+0000 7f7205e94640 1 -- 172.21.15.42:0/1692282304 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720019ae20 con 0x7f720007a440 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.258+0000 7f7205e94640 1 --2- 172.21.15.42:0/1692282304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f720019a8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f71fc030460 tx=0x7f71fc030710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.259+0000 7f71f6ffd640 1 -- 172.21.15.42:0/1692282304 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71fc037040 con 0x7f720007a440 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.259+0000 7f71f6ffd640 1 -- 172.21.15.42:0/1692282304 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f71fc040070 con 0x7f720007a440 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.259+0000 7f72080f8640 1 -- 172.21.15.42:0/1692282304 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720019b0b0 con 0x7f720007a440 2024-09-21T17:40:38.099 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.259+0000 7f71f6ffd640 1 -- 172.21.15.42:0/1692282304 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71fc03be30 con 0x7f720007a440 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.259+0000 7f72080f8640 1 -- 172.21.15.42:0/1692282304 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f720019ba70 con 0x7f720007a440 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.260+0000 7f71f6ffd640 1 -- 172.21.15.42:0/1692282304 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 51807+0+0 (secure 0 0 0) 0x7f71fc030af0 con 0x7f720007a440 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.260+0000 7f72080f8640 1 -- 172.21.15.42:0/1692282304 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7200107590 con 0x7f720007a440 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.260+0000 7f71f6ffd640 1 --2- 172.21.15.42:0/1692282304 >> v2:172.21.15.42:6800/604611129 conn(0x7f71ec03f870 0x7f71ec041d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.260+0000 7f7205693640 1 -- 172.21.15.42:0/1692282304 >> v2:172.21.15.42:6800/604611129 conn(0x7f71ec03f870 msgr2=0x7f71ec041d30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/604611129 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.260+0000 7f71f6ffd640 1 -- 172.21.15.42:0/1692282304 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f71fc073e70 con 0x7f720007a440 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.260+0000 7f7205693640 1 --2- 172.21.15.42:0/1692282304 >> v2:172.21.15.42:6800/604611129 conn(0x7f71ec03f870 0x7f71ec041d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.265+0000 7f71f6ffd640 1 -- 172.21.15.42:0/1692282304 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f71fc0313a0 con 0x7f720007a440 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.462+0000 7f7205693640 1 -- 172.21.15.42:0/1692282304 >> v2:172.21.15.42:6800/604611129 conn(0x7f71ec03f870 msgr2=0x7f71ec041d30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/604611129 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.462+0000 7f7205693640 1 --2- 172.21.15.42:0/1692282304 >> v2:172.21.15.42:6800/604611129 conn(0x7f71ec03f870 0x7f71ec041d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.506+0000 7f72080f8640 1 -- 172.21.15.42:0/1692282304 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f720019c190 con 0x7f720007a440 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.507+0000 7f71f6ffd640 1 -- 172.21.15.42:0/1692282304 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f71fc030de0 con 0x7f720007a440 2024-09-21T17:40:38.100 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.509+0000 7f72080f8640 1 -- 172.21.15.42:0/1692282304 >> v2:172.21.15.42:6800/604611129 conn(0x7f71ec03f870 msgr2=0x7f71ec041d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T17:40:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.509+0000 7f72080f8640 1 --2- 172.21.15.42:0/1692282304 >> v2:172.21.15.42:6800/604611129 conn(0x7f71ec03f870 0x7f71ec041d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.509+0000 7f72080f8640 1 -- 172.21.15.42:0/1692282304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 msgr2=0x7f720019a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.509+0000 7f72080f8640 1 --2- 172.21.15.42:0/1692282304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f720019a8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f71fc030460 tx=0x7f71fc030710 comp rx=0 tx=0).stop 2024-09-21T17:40:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.509+0000 7f72080f8640 1 -- 172.21.15.42:0/1692282304 shutdown_connections 2024-09-21T17:40:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.509+0000 7f72080f8640 1 --2- 172.21.15.42:0/1692282304 >> v2:172.21.15.42:6800/604611129 conn(0x7f71ec03f870 0x7f71ec041d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.509+0000 7f72080f8640 1 --2- 172.21.15.42:0/1692282304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f720007a440 0x7f720019a8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.509+0000 7f72080f8640 1 -- 172.21.15.42:0/1692282304 >> 172.21.15.42:0/1692282304 conn(0x7f72001011b0 msgr2=0x7f7200101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.509+0000 7f72080f8640 1 -- 172.21.15.42:0/1692282304 shutdown_connections 2024-09-21T17:40:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:37.509+0000 7f72080f8640 1 -- 172.21.15.42:0/1692282304 wait complete. 2024-09-21T17:40:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for the mgr to restart... 2024-09-21T17:40:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr epoch 5... 2024-09-21T17:40:38.392 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1692282304' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T17:40:41.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:41 smithi042 ceph-mon[29361]: Active manager daemon y restarted 2024-09-21T17:40:41.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:41 smithi042 ceph-mon[29361]: Activating manager daemon y 2024-09-21T17:40:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:41 smithi042 ceph-mon[29361]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T17:40:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:41 smithi042 ceph-mon[29361]: mgrmap e6: y(active, starting, since 0.00338183s) 2024-09-21T17:40:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:41 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:40:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:41 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T17:40:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:41 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T17:40:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:41 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T17:40:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:41 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T17:40:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:41 smithi042 ceph-mon[29361]: Manager daemon y is now available 2024-09-21T17:40:43.112 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-21T17:40:43.112 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T17:40:43.112 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T17:40:43.112 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-21T17:40:43.112 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.471+0000 7fd67b619640 1 Processor -- start 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.471+0000 7fd67b619640 1 -- start start 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.471+0000 7fd67b619640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd674105c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.471+0000 7fd67b619640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd674106260 con 0x7fd674105870 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.471+0000 7fd6793b5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd674105c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.471+0000 7fd6793b5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd674105c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43478/0 (socket says 172.21.15.42:43478) 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.471+0000 7fd6793b5640 1 -- 172.21.15.42:0/3618946409 learned_addr learned my addr 172.21.15.42:0/3618946409 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.472+0000 7fd6793b5640 1 -- 172.21.15.42:0/3618946409 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6741063e0 con 0x7fd674105870 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.472+0000 7fd6793b5640 1 --2- 172.21.15.42:0/3618946409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd674105c70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd670009820 tx=0x7fd67002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efccea862d4224d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.473+0000 7fd66bfff640 1 -- 172.21.15.42:0/3618946409 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd670037070 con 0x7fd674105870 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.473+0000 7fd66bfff640 1 -- 172.21.15.42:0/3618946409 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fd6700328a0 con 0x7fd674105870 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.473+0000 7fd66bfff640 1 -- 172.21.15.42:0/3618946409 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd670030690 con 0x7fd674105870 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.473+0000 7fd67b619640 1 -- 172.21.15.42:0/3618946409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 msgr2=0x7fd674105c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.473+0000 7fd67b619640 1 --2- 172.21.15.42:0/3618946409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd674105c70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd670009820 tx=0x7fd67002a270 comp rx=0 tx=0).stop 2024-09-21T17:40:43.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.473+0000 7fd67b619640 1 -- 172.21.15.42:0/3618946409 shutdown_connections 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.473+0000 7fd67b619640 1 --2- 172.21.15.42:0/3618946409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd674105c70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.473+0000 7fd67b619640 1 -- 172.21.15.42:0/3618946409 >> 172.21.15.42:0/3618946409 conn(0x7fd674101160 msgr2=0x7fd674103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.474+0000 7fd67b619640 1 -- 172.21.15.42:0/3618946409 shutdown_connections 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.474+0000 7fd67b619640 1 -- 172.21.15.42:0/3618946409 wait complete. 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.474+0000 7fd67b619640 1 Processor -- start 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.474+0000 7fd67b619640 1 -- start start 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.474+0000 7fd67b619640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd67419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.474+0000 7fd67b619640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd674109cf0 con 0x7fd674105870 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.475+0000 7fd6793b5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd67419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.475+0000 7fd6793b5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd67419a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43484/0 (socket says 172.21.15.42:43484) 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.475+0000 7fd6793b5640 1 -- 172.21.15.42:0/3702303210 learned_addr learned my addr 172.21.15.42:0/3702303210 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.475+0000 7fd6793b5640 1 -- 172.21.15.42:0/3702303210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67419ae90 con 0x7fd674105870 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.475+0000 7fd6793b5640 1 --2- 172.21.15.42:0/3702303210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd67419a930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd670000c00 tx=0x7fd670030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:43.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.475+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd670042070 con 0x7fd674105870 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.475+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fd670030e00 con 0x7fd674105870 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.475+0000 7fd67b619640 1 -- 172.21.15.42:0/3702303210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67419b120 con 0x7fd674105870 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.475+0000 7fd67b619640 1 -- 172.21.15.42:0/3702303210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67419bae0 con 0x7fd674105870 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.475+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd670037040 con 0x7fd674105870 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.476+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 51807+0+0 (secure 0 0 0) 0x7fd670045070 con 0x7fd674105870 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.476+0000 7fd66a7fc640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 0x7fd660041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.476+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 --> v2:172.21.15.42:6800/604611129 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd660042450 con 0x7fd66003f8c0 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.477+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd670074140 con 0x7fd674105870 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.477+0000 7fd678bb4640 1 -- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 msgr2=0x7fd660041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/604611129 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.477+0000 7fd678bb4640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 0x7fd660041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.678+0000 7fd678bb4640 1 -- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 msgr2=0x7fd660041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/604611129 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:38.678+0000 7fd678bb4640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 0x7fd660041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:39.080+0000 7fd678bb4640 1 -- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 msgr2=0x7fd660041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/604611129 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:39.080+0000 7fd678bb4640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 0x7fd660041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-21T17:40:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:39.882+0000 7fd678bb4640 1 -- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 msgr2=0x7fd660041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/604611129 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:39.882+0000 7fd678bb4640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 0x7fd660041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:41.483+0000 7fd678bb4640 1 -- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 msgr2=0x7fd660041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/604611129 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:41.483+0000 7fd678bb4640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 0x7fd660041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:41.534+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mgrmap(e 6) ==== 51609+0+0 (secure 0 0 0) 0x7fd67003bd40 con 0x7fd674105870 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:41.534+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 msgr2=0x7fd660041d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:41.534+0000 7fd66a7fc640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 0x7fd660041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.535+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 7) ==== 51701+0+0 (secure 0 0 0) 0x7fd6700762f0 con 0x7fd674105870 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.535+0000 7fd66a7fc640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/475923179 conn(0x7fd660042fb0 0x7fd6600453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.535+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 --> v2:172.21.15.42:6800/475923179 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd670040cc0 con 0x7fd660042fb0 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.535+0000 7fd678bb4640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/475923179 conn(0x7fd660042fb0 0x7fd6600453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.536+0000 7fd678bb4640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/475923179 conn(0x7fd660042fb0 0x7fd6600453a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd664003980 tx=0x7fd6640092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.537+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 <== mgr.14118 v2:172.21.15.42:6800/475923179 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fd670040cc0 con 0x7fd660042fb0 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.543+0000 7fd67b619640 1 -- 172.21.15.42:0/3702303210 --> v2:172.21.15.42:6800/475923179 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fd674105cf0 con 0x7fd660042fb0 2024-09-21T17:40:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd66a7fc640 1 -- 172.21.15.42:0/3702303210 <== mgr.14118 v2:172.21.15.42:6800/475923179 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fd674105cf0 con 0x7fd660042fb0 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd67b619640 1 -- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/475923179 conn(0x7fd660042fb0 msgr2=0x7fd6600453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd67b619640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/475923179 conn(0x7fd660042fb0 0x7fd6600453a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd664003980 tx=0x7fd6640092b0 comp rx=0 tx=0).stop 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd67b619640 1 -- 172.21.15.42:0/3702303210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 msgr2=0x7fd67419a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd67b619640 1 --2- 172.21.15.42:0/3702303210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd67419a930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd670000c00 tx=0x7fd670030bc0 comp rx=0 tx=0).stop 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd67b619640 1 -- 172.21.15.42:0/3702303210 shutdown_connections 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd67b619640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/475923179 conn(0x7fd660042fb0 0x7fd6600453a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd67b619640 1 --2- 172.21.15.42:0/3702303210 >> v2:172.21.15.42:6800/604611129 conn(0x7fd66003f8c0 0x7fd660041d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd67b619640 1 --2- 172.21.15.42:0/3702303210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd674105870 0x7fd67419a930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd67b619640 1 -- 172.21.15.42:0/3702303210 >> 172.21.15.42:0/3702303210 conn(0x7fd674101160 msgr2=0x7fd674079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd67b619640 1 -- 172.21.15.42:0/3702303210 shutdown_connections 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:42.544+0000 7fd67b619640 1 -- 172.21.15.42:0/3702303210 wait complete. 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:mgr epoch 5 is available 2024-09-21T17:40:43.117 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying orchestrator module is enabled... 2024-09-21T17:40:43.760 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:43 smithi042 ceph-mon[29361]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T17:40:43.760 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:43 smithi042 ceph-mon[29361]: mgrmap e7: y(active, since 1.00491s) 2024-09-21T17:40:43.760 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:43 smithi042 ceph-mon[29361]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T17:40:44.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:44 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:44.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:44 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:44.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:44 smithi042 ceph-mon[29361]: Found migration_current of "None". Setting to last migration. 2024-09-21T17:40:44.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:44 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:44.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:44 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:44.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:44 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:40:44.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:44 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:40:44.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:44 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T17:40:44.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:44 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T17:40:44.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3854506410' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T17:40:45.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.502+0000 7f895381d640 1 Processor -- start 2024-09-21T17:40:45.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.502+0000 7f895381d640 1 -- start start 2024-09-21T17:40:45.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.502+0000 7f895381d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c105c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:45.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.502+0000 7f895381d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f894c106250 con 0x7f894c105860 2024-09-21T17:40:45.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.503+0000 7f89515b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:45.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.503+0000 7f89515b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c105c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56674/0 (socket says 172.21.15.42:56674) 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.503+0000 7f89515b9640 1 -- 172.21.15.42:0/3527777653 learned_addr learned my addr 172.21.15.42:0/3527777653 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.503+0000 7f89515b9640 1 -- 172.21.15.42:0/3527777653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894c1063d0 con 0x7f894c105860 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.504+0000 7f89515b9640 1 --2- 172.21.15.42:0/3527777653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c105c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8948009820 tx=0x7f894802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f002b0a3c12ec3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.504+0000 7f893ffff640 1 -- 172.21.15.42:0/3527777653 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8948037070 con 0x7f894c105860 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.504+0000 7f893ffff640 1 -- 172.21.15.42:0/3527777653 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f89480328a0 con 0x7f894c105860 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.504+0000 7f893ffff640 1 -- 172.21.15.42:0/3527777653 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8948030690 con 0x7f894c105860 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.504+0000 7f895381d640 1 -- 172.21.15.42:0/3527777653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 msgr2=0x7f894c105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.504+0000 7f895381d640 1 --2- 172.21.15.42:0/3527777653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c105c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8948009820 tx=0x7f894802a270 comp rx=0 tx=0).stop 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.504+0000 7f895381d640 1 -- 172.21.15.42:0/3527777653 shutdown_connections 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.504+0000 7f895381d640 1 --2- 172.21.15.42:0/3527777653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c105c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.504+0000 7f895381d640 1 -- 172.21.15.42:0/3527777653 >> 172.21.15.42:0/3527777653 conn(0x7f894c1011b0 msgr2=0x7f894c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:45.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.504+0000 7f895381d640 1 -- 172.21.15.42:0/3527777653 shutdown_connections 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.505+0000 7f895381d640 1 -- 172.21.15.42:0/3527777653 wait complete. 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.505+0000 7f895381d640 1 Processor -- start 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.505+0000 7f895381d640 1 -- start start 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.505+0000 7f895381d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.505+0000 7f895381d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f894c109ce0 con 0x7f894c105860 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.505+0000 7f89515b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.505+0000 7f89515b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c19a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56676/0 (socket says 172.21.15.42:56676) 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.505+0000 7f89515b9640 1 -- 172.21.15.42:0/3854506410 learned_addr learned my addr 172.21.15.42:0/3854506410 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.506+0000 7f89515b9640 1 -- 172.21.15.42:0/3854506410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894c19ae10 con 0x7f894c105860 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.506+0000 7f89515b9640 1 --2- 172.21.15.42:0/3854506410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c19a8b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8948006f10 tx=0x7f8948032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.506+0000 7f893e7fc640 1 -- 172.21.15.42:0/3854506410 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8948037040 con 0x7f894c105860 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.506+0000 7f893e7fc640 1 -- 172.21.15.42:0/3854506410 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f8948040070 con 0x7f894c105860 2024-09-21T17:40:45.095 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.506+0000 7f895381d640 1 -- 172.21.15.42:0/3854506410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f894c19b0a0 con 0x7f894c105860 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.506+0000 7f893e7fc640 1 -- 172.21.15.42:0/3854506410 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f894803a390 con 0x7f894c105860 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.506+0000 7f895381d640 1 -- 172.21.15.42:0/3854506410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f894c19ba60 con 0x7f894c105860 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.507+0000 7f893e7fc640 1 -- 172.21.15.42:0/3854506410 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 7) ==== 51701+0+0 (secure 0 0 0) 0x7f894803b430 con 0x7f894c105860 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.507+0000 7f895381d640 1 -- 172.21.15.42:0/3854506410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f894c105ce0 con 0x7f894c105860 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.507+0000 7f893e7fc640 1 --2- 172.21.15.42:0/3854506410 >> v2:172.21.15.42:6800/475923179 conn(0x7f893803f7b0 0x7f8938041c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.507+0000 7f893e7fc640 1 -- 172.21.15.42:0/3854506410 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f8948073cf0 con 0x7f894c105860 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.507+0000 7f8950db8640 1 --2- 172.21.15.42:0/3854506410 >> v2:172.21.15.42:6800/475923179 conn(0x7f893803f7b0 0x7f8938041c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.508+0000 7f8950db8640 1 --2- 172.21.15.42:0/3854506410 >> v2:172.21.15.42:6800/475923179 conn(0x7f893803f7b0 0x7f8938041c70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f89400098c0 tx=0x7f8940006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.512+0000 7f893e7fc640 1 -- 172.21.15.42:0/3854506410 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f894807a080 con 0x7f894c105860 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:43.758+0000 7f895381d640 1 -- 172.21.15.42:0/3854506410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "orchestrator"} v 0) -- 0x7f894c19c180 con 0x7f894c105860 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.554+0000 7f893e7fc640 1 -- 172.21.15.42:0/3854506410 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "orchestrator"}]=0 module 'orchestrator' is already enabled (always-on) v8) ==== 143+0+0 (secure 0 0 0) 0x7f894803b720 con 0x7f894c105860 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.556+0000 7f893e7fc640 1 -- 172.21.15.42:0/3854506410 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mgrmap(e 8) ==== 51701+0+0 (secure 0 0 0) 0x7f894803a980 con 0x7f894c105860 2024-09-21T17:40:45.096 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.557+0000 7f895381d640 1 -- 172.21.15.42:0/3854506410 >> v2:172.21.15.42:6800/475923179 conn(0x7f893803f7b0 msgr2=0x7f8938041c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:45.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.557+0000 7f895381d640 1 --2- 172.21.15.42:0/3854506410 >> v2:172.21.15.42:6800/475923179 conn(0x7f893803f7b0 0x7f8938041c70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f89400098c0 tx=0x7f8940006db0 comp rx=0 tx=0).stop 2024-09-21T17:40:45.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.557+0000 7f895381d640 1 -- 172.21.15.42:0/3854506410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 msgr2=0x7f894c19a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:45.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.557+0000 7f895381d640 1 --2- 172.21.15.42:0/3854506410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c19a8b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8948006f10 tx=0x7f8948032670 comp rx=0 tx=0).stop 2024-09-21T17:40:45.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.557+0000 7f895381d640 1 -- 172.21.15.42:0/3854506410 shutdown_connections 2024-09-21T17:40:45.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.557+0000 7f895381d640 1 --2- 172.21.15.42:0/3854506410 >> v2:172.21.15.42:6800/475923179 conn(0x7f893803f7b0 0x7f8938041c70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:45.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.557+0000 7f895381d640 1 --2- 172.21.15.42:0/3854506410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f894c105860 0x7f894c19a8b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:45.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.557+0000 7f895381d640 1 -- 172.21.15.42:0/3854506410 >> 172.21.15.42:0/3854506410 conn(0x7f894c1011b0 msgr2=0x7f894c079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:45.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.557+0000 7f895381d640 1 -- 172.21.15.42:0/3854506410 shutdown_connections 2024-09-21T17:40:45.097 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:44.557+0000 7f895381d640 1 -- 172.21.15.42:0/3854506410 wait complete. 2024-09-21T17:40:45.097 INFO:teuthology.orchestra.run.smithi042.stdout:Setting orchestrator backend to cephadm... 2024-09-21T17:40:45.414 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: 2024-09-21T17:40:45.184+0000 7fe731097640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:17:40:45] ENGINE Error in HTTPServer.serve 2024-09-21T17:40:45.414 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: Traceback (most recent call last): 2024-09-21T17:40:45.414 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T17:40:45.414 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self._connections.run(self.expiration_interval) 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self._run(expiration_interval) 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: s = self.context.wrap_socket( 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: return self.sslsocket_class._create( 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self.do_handshake() 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T17:40:45.415 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self._sslobj.do_handshake() 2024-09-21T17:40:45.416 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T17:40:45.416 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: 2024-09-21T17:40:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3854506410' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T17:40:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-mon[29361]: mgrmap e8: y(active, since 3s) 2024-09-21T17:40:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-mon[29361]: [21/Sep/2024:17:40:45] ENGINE Bus STARTING 2024-09-21T17:40:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-mon[29361]: [21/Sep/2024:17:40:45] ENGINE Serving on https://172.21.15.42:7150 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-mon[29361]: [21/Sep/2024:17:40:45] ENGINE Error in HTTPServer.serve 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: Traceback (most recent call last): 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._connections.run(self.expiration_interval) 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._run(expiration_interval) 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: s = self.context.wrap_socket( 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T17:40:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout: return self.sslsocket_class._create( 2024-09-21T17:40:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T17:40:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout: self.do_handshake() 2024-09-21T17:40:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T17:40:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._sslobj.do_handshake() 2024-09-21T17:40:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T17:40:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-mon[29361]: [21/Sep/2024:17:40:45] ENGINE Serving on http://172.21.15.42:8765 2024-09-21T17:40:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-mon[29361]: [21/Sep/2024:17:40:45] ENGINE Bus STARTED 2024-09-21T17:40:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:45 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:40:46.211 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.494+0000 7f96f546e640 1 Processor -- start 2024-09-21T17:40:46.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.494+0000 7f96f546e640 1 -- start start 2024-09-21T17:40:46.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.494+0000 7f96f546e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f0106d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:46.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.494+0000 7f96f546e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f96f0107330 con 0x7f96f0106940 2024-09-21T17:40:46.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.494+0000 7f96eeffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f0106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:46.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.494+0000 7f96eeffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f0106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56706/0 (socket says 172.21.15.42:56706) 2024-09-21T17:40:46.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.494+0000 7f96eeffd640 1 -- 172.21.15.42:0/942845475 learned_addr learned my addr 172.21.15.42:0/942845475 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:46.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.495+0000 7f96eeffd640 1 -- 172.21.15.42:0/942845475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f01074b0 con 0x7f96f0106940 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.495+0000 7f96eeffd640 1 --2- 172.21.15.42:0/942845475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f0106d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009820 tx=0x7f96e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14bfec5a35978a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.495+0000 7f96edffb640 1 -- 172.21.15.42:0/942845475 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0037070 con 0x7f96f0106940 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.496+0000 7f96edffb640 1 -- 172.21.15.42:0/942845475 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f96e00328a0 con 0x7f96f0106940 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.496+0000 7f96edffb640 1 -- 172.21.15.42:0/942845475 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0030690 con 0x7f96f0106940 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.496+0000 7f96f546e640 1 -- 172.21.15.42:0/942845475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 msgr2=0x7f96f0106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.496+0000 7f96f546e640 1 --2- 172.21.15.42:0/942845475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f0106d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009820 tx=0x7f96e002a270 comp rx=0 tx=0).stop 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.496+0000 7f96f546e640 1 -- 172.21.15.42:0/942845475 shutdown_connections 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.496+0000 7f96f546e640 1 --2- 172.21.15.42:0/942845475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f0106d40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.496+0000 7f96f546e640 1 -- 172.21.15.42:0/942845475 >> 172.21.15.42:0/942845475 conn(0x7f96f0102210 msgr2=0x7f96f0104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.496+0000 7f96f546e640 1 -- 172.21.15.42:0/942845475 shutdown_connections 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.496+0000 7f96f546e640 1 -- 172.21.15.42:0/942845475 wait complete. 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.497+0000 7f96f546e640 1 Processor -- start 2024-09-21T17:40:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.497+0000 7f96f546e640 1 -- start start 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.497+0000 7f96f546e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.497+0000 7f96f546e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f96f010adc0 con 0x7f96f0106940 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.497+0000 7f96eeffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.497+0000 7f96eeffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f019a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56722/0 (socket says 172.21.15.42:56722) 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.497+0000 7f96eeffd640 1 -- 172.21.15.42:0/2971842950 learned_addr learned my addr 172.21.15.42:0/2971842950 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.498+0000 7f96eeffd640 1 -- 172.21.15.42:0/2971842950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f019ae20 con 0x7f96f0106940 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.498+0000 7f96eeffd640 1 --2- 172.21.15.42:0/2971842950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f019a8c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96e0006f10 tx=0x7f96e0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.498+0000 7f96d7fff640 1 -- 172.21.15.42:0/2971842950 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0037040 con 0x7f96f0106940 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.498+0000 7f96d7fff640 1 -- 172.21.15.42:0/2971842950 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f96e0040070 con 0x7f96f0106940 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.498+0000 7f96f546e640 1 -- 172.21.15.42:0/2971842950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f019b0b0 con 0x7f96f0106940 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.498+0000 7f96d7fff640 1 -- 172.21.15.42:0/2971842950 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e003a390 con 0x7f96f0106940 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.498+0000 7f96f546e640 1 -- 172.21.15.42:0/2971842950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f019ba70 con 0x7f96f0106940 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.499+0000 7f96f546e640 1 -- 172.21.15.42:0/2971842950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f0106dc0 con 0x7f96f0106940 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.499+0000 7f96d7fff640 1 -- 172.21.15.42:0/2971842950 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 51701+0+0 (secure 0 0 0) 0x7f96e003a600 con 0x7f96f0106940 2024-09-21T17:40:46.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.499+0000 7f96d7fff640 1 --2- 172.21.15.42:0/2971842950 >> v2:172.21.15.42:6800/475923179 conn(0x7f96d803f7b0 0x7f96d8041c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.500+0000 7f96d7fff640 1 -- 172.21.15.42:0/2971842950 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f96e0073d30 con 0x7f96f0106940 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.500+0000 7f96ee7fc640 1 --2- 172.21.15.42:0/2971842950 >> v2:172.21.15.42:6800/475923179 conn(0x7f96d803f7b0 0x7f96d8041c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.500+0000 7f96ee7fc640 1 --2- 172.21.15.42:0/2971842950 >> v2:172.21.15.42:6800/475923179 conn(0x7f96d803f7b0 0x7f96d8041c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f96e40098c0 tx=0x7f96e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.504+0000 7f96d7fff640 1 -- 172.21.15.42:0/2971842950 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f96e0043360 con 0x7f96f0106940 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.559+0000 7f96d7fff640 1 -- 172.21.15.42:0/2971842950 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 9) ==== 51807+0+0 (secure 0 0 0) 0x7f96e003a8f0 con 0x7f96f0106940 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.712+0000 7f96f546e640 1 -- 172.21.15.42:0/2971842950 --> v2:172.21.15.42:6800/475923179 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f96f019c2c0 con 0x7f96d803f7b0 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.717+0000 7f96d7fff640 1 -- 172.21.15.42:0/2971842950 <== mgr.14118 v2:172.21.15.42:6800/475923179 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f96f019c2c0 con 0x7f96d803f7b0 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.719+0000 7f96f546e640 1 -- 172.21.15.42:0/2971842950 >> v2:172.21.15.42:6800/475923179 conn(0x7f96d803f7b0 msgr2=0x7f96d8041c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.719+0000 7f96f546e640 1 --2- 172.21.15.42:0/2971842950 >> v2:172.21.15.42:6800/475923179 conn(0x7f96d803f7b0 0x7f96d8041c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f96e40098c0 tx=0x7f96e4006db0 comp rx=0 tx=0).stop 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.719+0000 7f96f546e640 1 -- 172.21.15.42:0/2971842950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 msgr2=0x7f96f019a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.719+0000 7f96f546e640 1 --2- 172.21.15.42:0/2971842950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f019a8c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96e0006f10 tx=0x7f96e0032670 comp rx=0 tx=0).stop 2024-09-21T17:40:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.719+0000 7f96f546e640 1 -- 172.21.15.42:0/2971842950 shutdown_connections 2024-09-21T17:40:46.221 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.719+0000 7f96f546e640 1 --2- 172.21.15.42:0/2971842950 >> v2:172.21.15.42:6800/475923179 conn(0x7f96d803f7b0 0x7f96d8041c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:46.221 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.719+0000 7f96f546e640 1 --2- 172.21.15.42:0/2971842950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f0106940 0x7f96f019a8c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:46.221 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.719+0000 7f96f546e640 1 -- 172.21.15.42:0/2971842950 >> 172.21.15.42:0/2971842950 conn(0x7f96f0102210 msgr2=0x7f96f0102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:46.221 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.720+0000 7f96f546e640 1 -- 172.21.15.42:0/2971842950 shutdown_connections 2024-09-21T17:40:46.221 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:45.720+0000 7f96f546e640 1 -- 172.21.15.42:0/2971842950 wait complete. 2024-09-21T17:40:46.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:46 smithi042 ceph-mon[29361]: mgrmap e9: y(active, since 4s) 2024-09-21T17:40:46.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:46 smithi042 ceph-mon[29361]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:40:46.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:46 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:46.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:46 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:40:47.382 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T17:40:47.382 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.612+0000 7f338cc4c640 1 Processor -- start 2024-09-21T17:40:47.382 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.612+0000 7f338cc4c640 1 -- start start 2024-09-21T17:40:47.382 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.612+0000 7f338cc4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f3388109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:47.382 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.612+0000 7f338cc4c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3388109a70 con 0x7f338807a440 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.612+0000 7f338659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f3388109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.612+0000 7f338659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f3388109530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56736/0 (socket says 172.21.15.42:56736) 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.612+0000 7f338659c640 1 -- 172.21.15.42:0/2532278690 learned_addr learned my addr 172.21.15.42:0/2532278690 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.612+0000 7f338659c640 1 -- 172.21.15.42:0/2532278690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3388109bf0 con 0x7f338807a440 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.613+0000 7f338659c640 1 --2- 172.21.15.42:0/2532278690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f3388109530 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3378009820 tx=0x7f337802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8d85978a48dbbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.613+0000 7f3385d9b640 1 -- 172.21.15.42:0/2532278690 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3378037070 con 0x7f338807a440 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.613+0000 7f3385d9b640 1 -- 172.21.15.42:0/2532278690 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f33780328a0 con 0x7f338807a440 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.613+0000 7f3385d9b640 1 -- 172.21.15.42:0/2532278690 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3378030710 con 0x7f338807a440 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.614+0000 7f338cc4c640 1 -- 172.21.15.42:0/2532278690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 msgr2=0x7f3388109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.614+0000 7f338cc4c640 1 --2- 172.21.15.42:0/2532278690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f3388109530 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3378009820 tx=0x7f337802a300 comp rx=0 tx=0).stop 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.614+0000 7f338cc4c640 1 -- 172.21.15.42:0/2532278690 shutdown_connections 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.614+0000 7f338cc4c640 1 --2- 172.21.15.42:0/2532278690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f3388109530 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.614+0000 7f338cc4c640 1 -- 172.21.15.42:0/2532278690 >> 172.21.15.42:0/2532278690 conn(0x7f3388101160 msgr2=0x7f3388103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.614+0000 7f338cc4c640 1 -- 172.21.15.42:0/2532278690 shutdown_connections 2024-09-21T17:40:47.383 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.614+0000 7f338cc4c640 1 -- 172.21.15.42:0/2532278690 wait complete. 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.615+0000 7f338cc4c640 1 Processor -- start 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.615+0000 7f338cc4c640 1 -- start start 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.615+0000 7f338cc4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f338819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.615+0000 7f338cc4c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f338810acb0 con 0x7f338807a440 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.615+0000 7f338659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f338819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.615+0000 7f338659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f338819cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56738/0 (socket says 172.21.15.42:56738) 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.615+0000 7f338659c640 1 -- 172.21.15.42:0/4008476142 learned_addr learned my addr 172.21.15.42:0/4008476142 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.615+0000 7f338659c640 1 -- 172.21.15.42:0/4008476142 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338819d070 con 0x7f338807a440 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.616+0000 7f338659c640 1 --2- 172.21.15.42:0/4008476142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f338819cb10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3378030460 tx=0x7f3378030730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.616+0000 7f337ffff640 1 -- 172.21.15.42:0/4008476142 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3378037040 con 0x7f338807a440 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.616+0000 7f337ffff640 1 -- 172.21.15.42:0/4008476142 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f3378040070 con 0x7f338807a440 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.616+0000 7f338cc4c640 1 -- 172.21.15.42:0/4008476142 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338819d300 con 0x7f338807a440 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.616+0000 7f337ffff640 1 -- 172.21.15.42:0/4008476142 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f337803bdc0 con 0x7f338807a440 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.616+0000 7f338cc4c640 1 -- 172.21.15.42:0/4008476142 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f338819dcc0 con 0x7f338807a440 2024-09-21T17:40:47.384 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.617+0000 7f337ffff640 1 -- 172.21.15.42:0/4008476142 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 51807+0+0 (secure 0 0 0) 0x7f3378045460 con 0x7f338807a440 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.617+0000 7f338cc4c640 1 -- 172.21.15.42:0/4008476142 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33881075a0 con 0x7f338807a440 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.617+0000 7f337ffff640 1 --2- 172.21.15.42:0/4008476142 >> v2:172.21.15.42:6800/475923179 conn(0x7f337403f820 0x7f3374041ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.617+0000 7f337ffff640 1 -- 172.21.15.42:0/4008476142 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f3378073ea0 con 0x7f338807a440 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.617+0000 7f337dd9b640 1 --2- 172.21.15.42:0/4008476142 >> v2:172.21.15.42:6800/475923179 conn(0x7f337403f820 0x7f3374041ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.618+0000 7f337dd9b640 1 --2- 172.21.15.42:0/4008476142 >> v2:172.21.15.42:6800/475923179 conn(0x7f337403f820 0x7f3374041ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f33700098c0 tx=0x7f3370006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.622+0000 7f337ffff640 1 -- 172.21.15.42:0/4008476142 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f3378043c60 con 0x7f338807a440 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.812+0000 7f338cc4c640 1 -- 172.21.15.42:0/4008476142 --> v2:172.21.15.42:6800/475923179 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f33881022d0 con 0x7f337403f820 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.813+0000 7f337ffff640 1 -- 172.21.15.42:0/4008476142 <== mgr.14118 v2:172.21.15.42:6800/475923179 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f33881022d0 con 0x7f337403f820 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.815+0000 7f338cc4c640 1 -- 172.21.15.42:0/4008476142 >> v2:172.21.15.42:6800/475923179 conn(0x7f337403f820 msgr2=0x7f3374041ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.815+0000 7f338cc4c640 1 --2- 172.21.15.42:0/4008476142 >> v2:172.21.15.42:6800/475923179 conn(0x7f337403f820 0x7f3374041ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f33700098c0 tx=0x7f3370006db0 comp rx=0 tx=0).stop 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.815+0000 7f338cc4c640 1 -- 172.21.15.42:0/4008476142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 msgr2=0x7f338819cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.815+0000 7f338cc4c640 1 --2- 172.21.15.42:0/4008476142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f338819cb10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3378030460 tx=0x7f3378030730 comp rx=0 tx=0).stop 2024-09-21T17:40:47.385 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.815+0000 7f338cc4c640 1 -- 172.21.15.42:0/4008476142 shutdown_connections 2024-09-21T17:40:47.386 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.815+0000 7f338cc4c640 1 --2- 172.21.15.42:0/4008476142 >> v2:172.21.15.42:6800/475923179 conn(0x7f337403f820 0x7f3374041ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:47.386 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.815+0000 7f338cc4c640 1 --2- 172.21.15.42:0/4008476142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f338807a440 0x7f338819cb10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:47.386 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.815+0000 7f338cc4c640 1 -- 172.21.15.42:0/4008476142 >> 172.21.15.42:0/4008476142 conn(0x7f3388101160 msgr2=0x7f3388101bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:47.386 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.815+0000 7f338cc4c640 1 -- 172.21.15.42:0/4008476142 shutdown_connections 2024-09-21T17:40:47.386 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:46.815+0000 7f338cc4c640 1 -- 172.21.15.42:0/4008476142 wait complete. 2024-09-21T17:40:47.386 INFO:teuthology.orchestra.run.smithi042.stdout:Generating ssh key... 2024-09-21T17:40:47.777 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:47 smithi042 ceph-mon[29361]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:40:48.606 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: Generating public/private rsa key pair. 2024-09-21T17:40:48.606 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: Your identification has been saved in /tmp/tmpm7sgsq7p/key 2024-09-21T17:40:48.606 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: Your public key has been saved in /tmp/tmpm7sgsq7p/key.pub 2024-09-21T17:40:48.606 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: The key fingerprint is: 2024-09-21T17:40:48.606 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: SHA256:2mx5/vg2LEo4xD3Zg+FnH9se74Ig3/KZTAP6KnOED/4 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: The key's randomart image is: 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: +---[RSA 3072]----+ 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: | | 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: | | 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: | . | 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: | . o = | 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: | o.S * . | 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: | .o=o*.+ + | 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: | .++Bo.+=.o | 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: | ++o+++*=.o | 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: | =Eo+BB..oo| 2024-09-21T17:40:48.607 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:40:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: +----[SHA256]-----+ 2024-09-21T17:40:48.880 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.797+0000 7f498d1ab640 1 Processor -- start 2024-09-21T17:40:48.880 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.797+0000 7f498d1ab640 1 -- start start 2024-09-21T17:40:48.880 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.797+0000 7f498d1ab640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f4988106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:48.880 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.797+0000 7f498d1ab640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4988107350 con 0x7f4988106960 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.797+0000 7f4986d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f4988106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.797+0000 7f4986d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f4988106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56740/0 (socket says 172.21.15.42:56740) 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.797+0000 7f4986d9d640 1 -- 172.21.15.42:0/1520696258 learned_addr learned my addr 172.21.15.42:0/1520696258 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.797+0000 7f4986d9d640 1 -- 172.21.15.42:0/1520696258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49881074d0 con 0x7f4988106960 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.798+0000 7f4986d9d640 1 --2- 172.21.15.42:0/1520696258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f4988106d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4978009820 tx=0x7f497802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1beee692530bfc27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.798+0000 7f4985d9b640 1 -- 172.21.15.42:0/1520696258 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4978037070 con 0x7f4988106960 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.798+0000 7f4985d9b640 1 -- 172.21.15.42:0/1520696258 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f49780328a0 con 0x7f4988106960 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.798+0000 7f4985d9b640 1 -- 172.21.15.42:0/1520696258 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4978030690 con 0x7f4988106960 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.799+0000 7f498d1ab640 1 -- 172.21.15.42:0/1520696258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 msgr2=0x7f4988106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.799+0000 7f498d1ab640 1 --2- 172.21.15.42:0/1520696258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f4988106d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4978009820 tx=0x7f497802a270 comp rx=0 tx=0).stop 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.799+0000 7f498d1ab640 1 -- 172.21.15.42:0/1520696258 shutdown_connections 2024-09-21T17:40:48.881 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.799+0000 7f498d1ab640 1 --2- 172.21.15.42:0/1520696258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f4988106d60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.799+0000 7f498d1ab640 1 -- 172.21.15.42:0/1520696258 >> 172.21.15.42:0/1520696258 conn(0x7f4988102250 msgr2=0x7f4988104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.799+0000 7f498d1ab640 1 -- 172.21.15.42:0/1520696258 shutdown_connections 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.799+0000 7f498d1ab640 1 -- 172.21.15.42:0/1520696258 wait complete. 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.800+0000 7f498d1ab640 1 Processor -- start 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.800+0000 7f498d1ab640 1 -- start start 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.800+0000 7f498d1ab640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f498819cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.800+0000 7f498d1ab640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f498810ade0 con 0x7f4988106960 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.801+0000 7f4986d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f498819cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.801+0000 7f4986d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f498819cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56748/0 (socket says 172.21.15.42:56748) 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.801+0000 7f4986d9d640 1 -- 172.21.15.42:0/4273516005 learned_addr learned my addr 172.21.15.42:0/4273516005 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.801+0000 7f4986d9d640 1 -- 172.21.15.42:0/4273516005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498819d030 con 0x7f4988106960 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.801+0000 7f4986d9d640 1 --2- 172.21.15.42:0/4273516005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f498819cad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4978000c00 tx=0x7f4978032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:48.882 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.801+0000 7f496ffff640 1 -- 172.21.15.42:0/4273516005 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4978037040 con 0x7f4988106960 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.801+0000 7f496ffff640 1 -- 172.21.15.42:0/4273516005 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f4978040070 con 0x7f4988106960 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.801+0000 7f496ffff640 1 -- 172.21.15.42:0/4273516005 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f497803be40 con 0x7f4988106960 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.801+0000 7f498d1ab640 1 -- 172.21.15.42:0/4273516005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f498819d2c0 con 0x7f4988106960 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.801+0000 7f498d1ab640 1 -- 172.21.15.42:0/4273516005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f498819dc80 con 0x7f4988106960 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.802+0000 7f496ffff640 1 -- 172.21.15.42:0/4273516005 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 51807+0+0 (secure 0 0 0) 0x7f4978045460 con 0x7f4988106960 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.802+0000 7f498d1ab640 1 -- 172.21.15.42:0/4273516005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4988106de0 con 0x7f4988106960 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.803+0000 7f496ffff640 1 --2- 172.21.15.42:0/4273516005 >> v2:172.21.15.42:6800/475923179 conn(0x7f497003f8c0 0x7f4970041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.803+0000 7f496ffff640 1 -- 172.21.15.42:0/4273516005 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f4978073e80 con 0x7f4988106960 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.803+0000 7f498659c640 1 --2- 172.21.15.42:0/4273516005 >> v2:172.21.15.42:6800/475923179 conn(0x7f497003f8c0 0x7f4970041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.803+0000 7f498659c640 1 --2- 172.21.15.42:0/4273516005 >> v2:172.21.15.42:6800/475923179 conn(0x7f497003f8c0 0x7f4970041d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f497c0098c0 tx=0x7f497c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.807+0000 7f496ffff640 1 -- 172.21.15.42:0/4273516005 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f497803b430 con 0x7f4988106960 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:47.999+0000 7f498d1ab640 1 -- 172.21.15.42:0/4273516005 --> v2:172.21.15.42:6800/475923179 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f498819e4d0 con 0x7f497003f8c0 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:48.327+0000 7f496ffff640 1 -- 172.21.15.42:0/4273516005 <== mgr.14118 v2:172.21.15.42:6800/475923179 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f498819e4d0 con 0x7f497003f8c0 2024-09-21T17:40:48.883 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:48.329+0000 7f498d1ab640 1 -- 172.21.15.42:0/4273516005 >> v2:172.21.15.42:6800/475923179 conn(0x7f497003f8c0 msgr2=0x7f4970041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:48.884 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:48.329+0000 7f498d1ab640 1 --2- 172.21.15.42:0/4273516005 >> v2:172.21.15.42:6800/475923179 conn(0x7f497003f8c0 0x7f4970041d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f497c0098c0 tx=0x7f497c006db0 comp rx=0 tx=0).stop 2024-09-21T17:40:48.884 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:48.329+0000 7f498d1ab640 1 -- 172.21.15.42:0/4273516005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 msgr2=0x7f498819cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:48.884 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:48.329+0000 7f498d1ab640 1 --2- 172.21.15.42:0/4273516005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f498819cad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4978000c00 tx=0x7f4978032740 comp rx=0 tx=0).stop 2024-09-21T17:40:48.884 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:48.329+0000 7f498d1ab640 1 -- 172.21.15.42:0/4273516005 shutdown_connections 2024-09-21T17:40:48.884 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:48.329+0000 7f498d1ab640 1 --2- 172.21.15.42:0/4273516005 >> v2:172.21.15.42:6800/475923179 conn(0x7f497003f8c0 0x7f4970041d80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:48.884 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:48.329+0000 7f498d1ab640 1 --2- 172.21.15.42:0/4273516005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4988106960 0x7f498819cad0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:48.884 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:48.329+0000 7f498d1ab640 1 -- 172.21.15.42:0/4273516005 >> 172.21.15.42:0/4273516005 conn(0x7f4988102250 msgr2=0x7f4988102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:48.884 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:48.329+0000 7f498d1ab640 1 -- 172.21.15.42:0/4273516005 shutdown_connections 2024-09-21T17:40:48.884 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:48.329+0000 7f498d1ab640 1 -- 172.21.15.42:0/4273516005 wait complete. 2024-09-21T17:40:49.482 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:49 smithi042 ceph-mon[29361]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:40:49.482 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:49 smithi042 ceph-mon[29361]: Generating ssh key... 2024-09-21T17:40:49.482 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:49 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:49.482 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:49 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:50.012 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfqBKM7Vo1QRQAN0zmQ0OZgzouR3vA1iJ0XUJwqaVlv5R7C/b5EpCvm+kWjs4p0Xw7eagF2GwbiQUoMiKNm939CCZXlWIeECfQMkkIIBGt0sShCzVwZLuysV7WhRnY1pIvzUQrnkPdNiAr3OlD+8Y7hmj6kNHfZB+Ao/0+eq1n+AVGwK7hsV0NHDH7WwLYZqZIta/WTRy38XIHZNFwSl5RKH40TbUv/qRQksnZXONfsNkk+aO/u5/6c4MgN2aF5Xf8B2a/MBAeeGx2iN6uvy9JqJfAQ0303lLAwrNkwUvPyQzuru3PqlGCeRSVxC97o6FMYz8AMNMeIIK/XfjzYiYmhnQaiovVRX+9Mv3nZ92eWU310j6Oc2nblxtqfaLgQAHhGmvaQhDQs9v55RJOaeinqJjEWzCZdOMhRQ2CYQPjcwCAszuhIw06jAQ9/CM3ufKQOiTAVv6ZEet4trclXTE7Qxb0SJuo2Jhyj8MlHxjw89KV3dJChZOfPeqyvU3PE6E= ceph-6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:40:50.013 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.276+0000 7f595c9f0640 1 Processor -- start 2024-09-21T17:40:50.013 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.276+0000 7f595c9f0640 1 -- start start 2024-09-21T17:40:50.013 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.277+0000 7f595c9f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f5958109520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:50.013 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.277+0000 7f595c9f0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5958109a60 con 0x7f595807a440 2024-09-21T17:40:50.013 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.277+0000 7f595659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f5958109520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:50.013 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.277+0000 7f595659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f5958109520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56764/0 (socket says 172.21.15.42:56764) 2024-09-21T17:40:50.013 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.277+0000 7f595659c640 1 -- 172.21.15.42:0/4120206057 learned_addr learned my addr 172.21.15.42:0/4120206057 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:50.013 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.277+0000 7f595659c640 1 -- 172.21.15.42:0/4120206057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5958109be0 con 0x7f595807a440 2024-09-21T17:40:50.013 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.278+0000 7f595659c640 1 --2- 172.21.15.42:0/4120206057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f5958109520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5950009820 tx=0x7f595002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3568f4f4a5b0a642 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:50.013 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.278+0000 7f595559a640 1 -- 172.21.15.42:0/4120206057 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5950037070 con 0x7f595807a440 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.278+0000 7f595559a640 1 -- 172.21.15.42:0/4120206057 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f59500328a0 con 0x7f595807a440 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.278+0000 7f595559a640 1 -- 172.21.15.42:0/4120206057 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5950030710 con 0x7f595807a440 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.279+0000 7f595c9f0640 1 -- 172.21.15.42:0/4120206057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 msgr2=0x7f5958109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.279+0000 7f595c9f0640 1 --2- 172.21.15.42:0/4120206057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f5958109520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5950009820 tx=0x7f595002a300 comp rx=0 tx=0).stop 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.279+0000 7f595c9f0640 1 -- 172.21.15.42:0/4120206057 shutdown_connections 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.279+0000 7f595c9f0640 1 --2- 172.21.15.42:0/4120206057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f5958109520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.279+0000 7f595c9f0640 1 -- 172.21.15.42:0/4120206057 >> 172.21.15.42:0/4120206057 conn(0x7f59581011b0 msgr2=0x7f59581035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.279+0000 7f595c9f0640 1 -- 172.21.15.42:0/4120206057 shutdown_connections 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.279+0000 7f595c9f0640 1 -- 172.21.15.42:0/4120206057 wait complete. 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.280+0000 7f595c9f0640 1 Processor -- start 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.280+0000 7f595c9f0640 1 -- start start 2024-09-21T17:40:50.014 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.280+0000 7f595c9f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f595819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.280+0000 7f595c9f0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f595810aca0 con 0x7f595807a440 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.280+0000 7f595659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f595819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.280+0000 7f595659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f595819a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56776/0 (socket says 172.21.15.42:56776) 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.280+0000 7f595659c640 1 -- 172.21.15.42:0/4075395455 learned_addr learned my addr 172.21.15.42:0/4075395455 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.280+0000 7f595659c640 1 -- 172.21.15.42:0/4075395455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595819ae20 con 0x7f595807a440 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.280+0000 7f595659c640 1 --2- 172.21.15.42:0/4075395455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f595819a8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5950030460 tx=0x7f5950030710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.281+0000 7f594f7fe640 1 -- 172.21.15.42:0/4075395455 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5950037040 con 0x7f595807a440 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.281+0000 7f594f7fe640 1 -- 172.21.15.42:0/4075395455 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f5950040070 con 0x7f595807a440 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.281+0000 7f594f7fe640 1 -- 172.21.15.42:0/4075395455 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595003be30 con 0x7f595807a440 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.281+0000 7f595c9f0640 1 -- 172.21.15.42:0/4075395455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595819b0b0 con 0x7f595807a440 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.281+0000 7f595c9f0640 1 -- 172.21.15.42:0/4075395455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595819ba70 con 0x7f595807a440 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.282+0000 7f594f7fe640 1 -- 172.21.15.42:0/4075395455 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 51807+0+0 (secure 0 0 0) 0x7f5950030af0 con 0x7f595807a440 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.282+0000 7f595c9f0640 1 -- 172.21.15.42:0/4075395455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5958107590 con 0x7f595807a440 2024-09-21T17:40:50.015 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.282+0000 7f594f7fe640 1 --2- 172.21.15.42:0/4075395455 >> v2:172.21.15.42:6800/475923179 conn(0x7f594403f870 0x7f5944041d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.282+0000 7f594f7fe640 1 -- 172.21.15.42:0/4075395455 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f5950073e70 con 0x7f595807a440 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.282+0000 7f5955d9b640 1 --2- 172.21.15.42:0/4075395455 >> v2:172.21.15.42:6800/475923179 conn(0x7f594403f870 0x7f5944041d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.283+0000 7f5955d9b640 1 --2- 172.21.15.42:0/4075395455 >> v2:172.21.15.42:6800/475923179 conn(0x7f594403f870 0x7f5944041d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f59400098c0 tx=0x7f5940006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.287+0000 7f594f7fe640 1 -- 172.21.15.42:0/4075395455 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f59500313a0 con 0x7f595807a440 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.480+0000 7f595c9f0640 1 -- 172.21.15.42:0/4075395455 --> v2:172.21.15.42:6800/475923179 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f59581023b0 con 0x7f594403f870 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.481+0000 7f594f7fe640 1 -- 172.21.15.42:0/4075395455 <== mgr.14118 v2:172.21.15.42:6800/475923179 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f59581023b0 con 0x7f594403f870 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.483+0000 7f595c9f0640 1 -- 172.21.15.42:0/4075395455 >> v2:172.21.15.42:6800/475923179 conn(0x7f594403f870 msgr2=0x7f5944041d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.483+0000 7f595c9f0640 1 --2- 172.21.15.42:0/4075395455 >> v2:172.21.15.42:6800/475923179 conn(0x7f594403f870 0x7f5944041d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f59400098c0 tx=0x7f5940006db0 comp rx=0 tx=0).stop 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.483+0000 7f595c9f0640 1 -- 172.21.15.42:0/4075395455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 msgr2=0x7f595819a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.483+0000 7f595c9f0640 1 --2- 172.21.15.42:0/4075395455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f595819a8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5950030460 tx=0x7f5950030710 comp rx=0 tx=0).stop 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.484+0000 7f595c9f0640 1 -- 172.21.15.42:0/4075395455 shutdown_connections 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.484+0000 7f595c9f0640 1 --2- 172.21.15.42:0/4075395455 >> v2:172.21.15.42:6800/475923179 conn(0x7f594403f870 0x7f5944041d30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.484+0000 7f595c9f0640 1 --2- 172.21.15.42:0/4075395455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595807a440 0x7f595819a8c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:50.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.484+0000 7f595c9f0640 1 -- 172.21.15.42:0/4075395455 >> 172.21.15.42:0/4075395455 conn(0x7f59581011b0 msgr2=0x7f5958101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:50.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.484+0000 7f595c9f0640 1 -- 172.21.15.42:0/4075395455 shutdown_connections 2024-09-21T17:40:50.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:49.484+0000 7f595c9f0640 1 -- 172.21.15.42:0/4075395455 wait complete. 2024-09-21T17:40:50.017 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T17:40:50.017 INFO:teuthology.orchestra.run.smithi042.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T17:40:50.017 INFO:teuthology.orchestra.run.smithi042.stdout:Adding host smithi042... 2024-09-21T17:40:50.590 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:50 smithi042 ceph-mon[29361]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:40:51.602 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:51 smithi042 ceph-mon[29361]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi042", "addr": "172.21.15.42", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:40:52.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:52 smithi042 ceph-mon[29361]: Deploying cephadm binary to smithi042 2024-09-21T17:40:54.904 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Added host 'smithi042' with addr '172.21.15.42' 2024-09-21T17:40:54.904 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.384+0000 7fad1943a640 1 Processor -- start 2024-09-21T17:40:54.904 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.385+0000 7fad1943a640 1 -- start start 2024-09-21T17:40:54.904 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.385+0000 7fad1943a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1407b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:54.904 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.385+0000 7fad1943a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fad1407d150 con 0x7fad1407cca0 2024-09-21T17:40:54.904 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.385+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1407b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:54.904 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.385+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1407b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56780/0 (socket says 172.21.15.42:56780) 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.385+0000 7fad12ffd640 1 -- 172.21.15.42:0/1342707788 learned_addr learned my addr 172.21.15.42:0/1342707788 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.385+0000 7fad12ffd640 1 -- 172.21.15.42:0/1342707788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1407b840 con 0x7fad1407cca0 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.386+0000 7fad12ffd640 1 --2- 172.21.15.42:0/1342707788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1407b300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fad04009820 tx=0x7fad0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd695b552a33f6b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.386+0000 7fad11ffb640 1 -- 172.21.15.42:0/1342707788 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad04037070 con 0x7fad1407cca0 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.386+0000 7fad11ffb640 1 -- 172.21.15.42:0/1342707788 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fad040328a0 con 0x7fad1407cca0 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.386+0000 7fad11ffb640 1 -- 172.21.15.42:0/1342707788 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad04030690 con 0x7fad1407cca0 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.387+0000 7fad1943a640 1 -- 172.21.15.42:0/1342707788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 msgr2=0x7fad1407b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.387+0000 7fad1943a640 1 --2- 172.21.15.42:0/1342707788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1407b300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fad04009820 tx=0x7fad0402a270 comp rx=0 tx=0).stop 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.387+0000 7fad1943a640 1 -- 172.21.15.42:0/1342707788 shutdown_connections 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.387+0000 7fad1943a640 1 --2- 172.21.15.42:0/1342707788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1407b300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.387+0000 7fad1943a640 1 -- 172.21.15.42:0/1342707788 >> 172.21.15.42:0/1342707788 conn(0x7fad14102250 msgr2=0x7fad14104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.387+0000 7fad1943a640 1 -- 172.21.15.42:0/1342707788 shutdown_connections 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.387+0000 7fad1943a640 1 -- 172.21.15.42:0/1342707788 wait complete. 2024-09-21T17:40:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.388+0000 7fad1943a640 1 Processor -- start 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.388+0000 7fad1943a640 1 -- start start 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.388+0000 7fad1943a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1419caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.388+0000 7fad1943a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fad1410ce90 con 0x7fad1407cca0 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.388+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1419caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.388+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1419caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56796/0 (socket says 172.21.15.42:56796) 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.388+0000 7fad12ffd640 1 -- 172.21.15.42:0/2645460277 learned_addr learned my addr 172.21.15.42:0/2645460277 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.389+0000 7fad12ffd640 1 -- 172.21.15.42:0/2645460277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1419d000 con 0x7fad1407cca0 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.389+0000 7fad12ffd640 1 --2- 172.21.15.42:0/2645460277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1419caa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fad04000c00 tx=0x7fad04032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.389+0000 7facfbfff640 1 -- 172.21.15.42:0/2645460277 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad04037040 con 0x7fad1407cca0 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.389+0000 7facfbfff640 1 -- 172.21.15.42:0/2645460277 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fad04040070 con 0x7fad1407cca0 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.389+0000 7fad1943a640 1 -- 172.21.15.42:0/2645460277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1419d290 con 0x7fad1407cca0 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.389+0000 7facfbfff640 1 -- 172.21.15.42:0/2645460277 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0403be40 con 0x7fad1407cca0 2024-09-21T17:40:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.389+0000 7fad1943a640 1 -- 172.21.15.42:0/2645460277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1419dc50 con 0x7fad1407cca0 2024-09-21T17:40:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.390+0000 7facfbfff640 1 -- 172.21.15.42:0/2645460277 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 51807+0+0 (secure 0 0 0) 0x7fad04045460 con 0x7fad1407cca0 2024-09-21T17:40:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.390+0000 7fad1943a640 1 -- 172.21.15.42:0/2645460277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1407b380 con 0x7fad1407cca0 2024-09-21T17:40:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.390+0000 7facfbfff640 1 --2- 172.21.15.42:0/2645460277 >> v2:172.21.15.42:6800/475923179 conn(0x7facfc03f8c0 0x7facfc041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.390+0000 7facfbfff640 1 -- 172.21.15.42:0/2645460277 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fad04073e00 con 0x7fad1407cca0 2024-09-21T17:40:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.390+0000 7fad127fc640 1 --2- 172.21.15.42:0/2645460277 >> v2:172.21.15.42:6800/475923179 conn(0x7facfc03f8c0 0x7facfc041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.391+0000 7fad127fc640 1 --2- 172.21.15.42:0/2645460277 >> v2:172.21.15.42:6800/475923179 conn(0x7facfc03f8c0 0x7facfc041d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fad080098c0 tx=0x7fad08006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.395+0000 7facfbfff640 1 -- 172.21.15.42:0/2645460277 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fad0403b430 con 0x7fad1407cca0 2024-09-21T17:40:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:50.587+0000 7fad1943a640 1 -- 172.21.15.42:0/2645460277 --> v2:172.21.15.42:6800/475923179 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi042", "addr": "172.21.15.42", "target": ["mon-mgr", ""]}) -- 0x7fad1419e4a0 con 0x7facfc03f8c0 2024-09-21T17:40:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:54.419+0000 7facfbfff640 1 -- 172.21.15.42:0/2645460277 <== mgr.14118 v2:172.21.15.42:6800/475923179 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fad1419e4a0 con 0x7facfc03f8c0 2024-09-21T17:40:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:54.421+0000 7fad1943a640 1 -- 172.21.15.42:0/2645460277 >> v2:172.21.15.42:6800/475923179 conn(0x7facfc03f8c0 msgr2=0x7facfc041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:54.421+0000 7fad1943a640 1 --2- 172.21.15.42:0/2645460277 >> v2:172.21.15.42:6800/475923179 conn(0x7facfc03f8c0 0x7facfc041d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fad080098c0 tx=0x7fad08006db0 comp rx=0 tx=0).stop 2024-09-21T17:40:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:54.421+0000 7fad1943a640 1 -- 172.21.15.42:0/2645460277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 msgr2=0x7fad1419caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:54.421+0000 7fad1943a640 1 --2- 172.21.15.42:0/2645460277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1419caa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fad04000c00 tx=0x7fad04032740 comp rx=0 tx=0).stop 2024-09-21T17:40:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:54.421+0000 7fad1943a640 1 -- 172.21.15.42:0/2645460277 shutdown_connections 2024-09-21T17:40:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:54.421+0000 7fad1943a640 1 --2- 172.21.15.42:0/2645460277 >> v2:172.21.15.42:6800/475923179 conn(0x7facfc03f8c0 0x7facfc041d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:54.421+0000 7fad1943a640 1 --2- 172.21.15.42:0/2645460277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1407cca0 0x7fad1419caa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:54.421+0000 7fad1943a640 1 -- 172.21.15.42:0/2645460277 >> 172.21.15.42:0/2645460277 conn(0x7fad14102250 msgr2=0x7fad14102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:54.422+0000 7fad1943a640 1 -- 172.21.15.42:0/2645460277 shutdown_connections 2024-09-21T17:40:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:54.422+0000 7fad1943a640 1 -- 172.21.15.42:0/2645460277 wait complete. 2024-09-21T17:40:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:Deploying unmanaged mon service... 2024-09-21T17:40:55.550 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:55 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:55.550 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:55 smithi042 ceph-mon[29361]: Added host smithi042 2024-09-21T17:40:55.550 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:55 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:40:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.304+0000 7f0bb4a27640 1 Processor -- start 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.304+0000 7f0bb4a27640 1 -- start start 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.304+0000 7f0bb4a27640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0105c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.304+0000 7f0bb4a27640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0106250 con 0x7f0bb0105860 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.305+0000 7f0bae59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.305+0000 7f0bae59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0105c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51422/0 (socket says 172.21.15.42:51422) 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.305+0000 7f0bae59c640 1 -- 172.21.15.42:0/3083871969 learned_addr learned my addr 172.21.15.42:0/3083871969 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.305+0000 7f0bae59c640 1 -- 172.21.15.42:0/3083871969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb01063d0 con 0x7f0bb0105860 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.306+0000 7f0bae59c640 1 --2- 172.21.15.42:0/3083871969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0105c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009820 tx=0x7f0ba002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89c0054f147063f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.306+0000 7f0badd9b640 1 -- 172.21.15.42:0/3083871969 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba0037070 con 0x7f0bb0105860 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.306+0000 7f0badd9b640 1 -- 172.21.15.42:0/3083871969 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f0ba00328a0 con 0x7f0bb0105860 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.306+0000 7f0badd9b640 1 -- 172.21.15.42:0/3083871969 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba0030690 con 0x7f0bb0105860 2024-09-21T17:40:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.307+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3083871969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 msgr2=0x7f0bb0105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.307+0000 7f0bb4a27640 1 --2- 172.21.15.42:0/3083871969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0105c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009820 tx=0x7f0ba002a270 comp rx=0 tx=0).stop 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.307+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3083871969 shutdown_connections 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.307+0000 7f0bb4a27640 1 --2- 172.21.15.42:0/3083871969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0105c60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.307+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3083871969 >> 172.21.15.42:0/3083871969 conn(0x7f0bb01011b0 msgr2=0x7f0bb01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.307+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3083871969 shutdown_connections 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.307+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3083871969 wait complete. 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.308+0000 7f0bb4a27640 1 Processor -- start 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.308+0000 7f0bb4a27640 1 -- start start 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.308+0000 7f0bb4a27640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0103340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.308+0000 7f0bb4a27640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0109ce0 con 0x7f0bb0105860 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.308+0000 7f0bae59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0103340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.308+0000 7f0bae59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0103340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51426/0 (socket says 172.21.15.42:51426) 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.308+0000 7f0bae59c640 1 -- 172.21.15.42:0/3709962903 learned_addr learned my addr 172.21.15.42:0/3709962903 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.308+0000 7f0bae59c640 1 -- 172.21.15.42:0/3709962903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb01038a0 con 0x7f0bb0105860 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.309+0000 7f0bae59c640 1 --2- 172.21.15.42:0/3709962903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0103340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0000c00 tx=0x7f0ba0032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.309+0000 7f0ba77fe640 1 -- 172.21.15.42:0/3709962903 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba0037040 con 0x7f0bb0105860 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.309+0000 7f0ba77fe640 1 -- 172.21.15.42:0/3709962903 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f0ba0040070 con 0x7f0bb0105860 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.309+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3709962903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb0101c90 con 0x7f0bb0105860 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.309+0000 7f0ba77fe640 1 -- 172.21.15.42:0/3709962903 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba003be40 con 0x7f0bb0105860 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.309+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3709962903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb0102210 con 0x7f0bb0105860 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.310+0000 7f0ba77fe640 1 -- 172.21.15.42:0/3709962903 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 51807+0+0 (secure 0 0 0) 0x7f0ba0045460 con 0x7f0bb0105860 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.310+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3709962903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb0105ce0 con 0x7f0bb0105860 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.310+0000 7f0ba77fe640 1 --2- 172.21.15.42:0/3709962903 >> v2:172.21.15.42:6800/475923179 conn(0x7f0b9c03f8c0 0x7f0b9c041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.310+0000 7f0ba77fe640 1 -- 172.21.15.42:0/3709962903 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f0ba0073f80 con 0x7f0bb0105860 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.310+0000 7f0ba7fff640 1 --2- 172.21.15.42:0/3709962903 >> v2:172.21.15.42:6800/475923179 conn(0x7f0b9c03f8c0 0x7f0b9c041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.311+0000 7f0ba7fff640 1 --2- 172.21.15.42:0/3709962903 >> v2:172.21.15.42:6800/475923179 conn(0x7f0b9c03f8c0 0x7f0b9c041d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b980098c0 tx=0x7f0b98006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.315+0000 7f0ba77fe640 1 -- 172.21.15.42:0/3709962903 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f0ba003b430 con 0x7f0bb0105860 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.543+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3709962903 --> v2:172.21.15.42:6800/475923179 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f0bb01028c0 con 0x7f0b9c03f8c0 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.547+0000 7f0ba77fe640 1 -- 172.21.15.42:0/3709962903 <== mgr.14118 v2:172.21.15.42:6800/475923179 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0bb01028c0 con 0x7f0b9c03f8c0 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.549+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3709962903 >> v2:172.21.15.42:6800/475923179 conn(0x7f0b9c03f8c0 msgr2=0x7f0b9c041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.549+0000 7f0bb4a27640 1 --2- 172.21.15.42:0/3709962903 >> v2:172.21.15.42:6800/475923179 conn(0x7f0b9c03f8c0 0x7f0b9c041d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b980098c0 tx=0x7f0b98006db0 comp rx=0 tx=0).stop 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.549+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3709962903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 msgr2=0x7f0bb0103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.549+0000 7f0bb4a27640 1 --2- 172.21.15.42:0/3709962903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0103340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0000c00 tx=0x7f0ba0032740 comp rx=0 tx=0).stop 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.550+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3709962903 shutdown_connections 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.550+0000 7f0bb4a27640 1 --2- 172.21.15.42:0/3709962903 >> v2:172.21.15.42:6800/475923179 conn(0x7f0b9c03f8c0 0x7f0b9c041d80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.550+0000 7f0bb4a27640 1 --2- 172.21.15.42:0/3709962903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb0105860 0x7f0bb0103340 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.550+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3709962903 >> 172.21.15.42:0/3709962903 conn(0x7f0bb01011b0 msgr2=0x7f0bb018f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.550+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3709962903 shutdown_connections 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:55.550+0000 7f0bb4a27640 1 -- 172.21.15.42:0/3709962903 wait complete. 2024-09-21T17:40:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:Deploying unmanaged mgr service... 2024-09-21T17:40:56.650 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:56 smithi042 ceph-mon[29361]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:40:56.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:56 smithi042 ceph-mon[29361]: Saving service mon spec with placement count:5 2024-09-21T17:40:56.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:56 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:58.661 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:58 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:58.661 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:58 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:58.662 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:58 smithi042 ceph-mon[29361]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:40:58.662 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:58 smithi042 ceph-mon[29361]: Saving service mgr spec with placement count:2 2024-09-21T17:40:58.662 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:40:58 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:40:58.668 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.804+0000 7fc0f66b4640 1 Processor -- start 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.804+0000 7fc0f66b4640 1 -- start start 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.804+0000 7fc0f66b4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f007b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.804+0000 7fc0f66b4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f007d190 con 0x7fc0f007cce0 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.804+0000 7fc0effff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f007b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.805+0000 7fc0effff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f007b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51438/0 (socket says 172.21.15.42:51438) 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.805+0000 7fc0effff640 1 -- 172.21.15.42:0/3433267970 learned_addr learned my addr 172.21.15.42:0/3433267970 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.805+0000 7fc0effff640 1 -- 172.21.15.42:0/3433267970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f007b880 con 0x7fc0f007cce0 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.806+0000 7fc0effff640 1 --2- 172.21.15.42:0/3433267970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f007b340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009820 tx=0x7fc0e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979a2e5538498c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.806+0000 7fc0eeffd640 1 -- 172.21.15.42:0/3433267970 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e0037070 con 0x7fc0f007cce0 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.806+0000 7fc0eeffd640 1 -- 172.21.15.42:0/3433267970 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fc0e00328c0 con 0x7fc0f007cce0 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.806+0000 7fc0eeffd640 1 -- 172.21.15.42:0/3433267970 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e0030640 con 0x7fc0f007cce0 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.806+0000 7fc0f66b4640 1 -- 172.21.15.42:0/3433267970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 msgr2=0x7fc0f007b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.806+0000 7fc0f66b4640 1 --2- 172.21.15.42:0/3433267970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f007b340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009820 tx=0x7fc0e002a270 comp rx=0 tx=0).stop 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.806+0000 7fc0f66b4640 1 -- 172.21.15.42:0/3433267970 shutdown_connections 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.806+0000 7fc0f66b4640 1 --2- 172.21.15.42:0/3433267970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f007b340 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.806+0000 7fc0f66b4640 1 -- 172.21.15.42:0/3433267970 >> 172.21.15.42:0/3433267970 conn(0x7fc0f0102250 msgr2=0x7fc0f0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.807+0000 7fc0f66b4640 1 -- 172.21.15.42:0/3433267970 shutdown_connections 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.807+0000 7fc0f66b4640 1 -- 172.21.15.42:0/3433267970 wait complete. 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.807+0000 7fc0f66b4640 1 Processor -- start 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.807+0000 7fc0f66b4640 1 -- start start 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0f66b4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0f66b4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f010cef0 con 0x7fc0f007cce0 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0effff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0effff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f019ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51448/0 (socket says 172.21.15.42:51448) 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0effff640 1 -- 172.21.15.42:0/2930242338 learned_addr learned my addr 172.21.15.42:0/2930242338 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0effff640 1 -- 172.21.15.42:0/2930242338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f019cfa0 con 0x7fc0f007cce0 2024-09-21T17:40:58.670 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0effff640 1 --2- 172.21.15.42:0/2930242338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f019ca40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0000c00 tx=0x7fc0e0030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0ed7fa640 1 -- 172.21.15.42:0/2930242338 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e0037040 con 0x7fc0f007cce0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0ed7fa640 1 -- 172.21.15.42:0/2930242338 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fc0e0040070 con 0x7fc0f007cce0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0f66b4640 1 -- 172.21.15.42:0/2930242338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f019d230 con 0x7fc0f007cce0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0ed7fa640 1 -- 172.21.15.42:0/2930242338 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e003a390 con 0x7fc0f007cce0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.808+0000 7fc0f66b4640 1 -- 172.21.15.42:0/2930242338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f019dbf0 con 0x7fc0f007cce0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.809+0000 7fc0ed7fa640 1 -- 172.21.15.42:0/2930242338 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 51807+0+0 (secure 0 0 0) 0x7fc0e003b430 con 0x7fc0f007cce0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.809+0000 7fc0f66b4640 1 -- 172.21.15.42:0/2930242338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f007b340 con 0x7fc0f007cce0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.810+0000 7fc0ed7fa640 1 --2- 172.21.15.42:0/2930242338 >> v2:172.21.15.42:6800/475923179 conn(0x7fc0d803f8c0 0x7fc0d8041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.810+0000 7fc0ed7fa640 1 -- 172.21.15.42:0/2930242338 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fc0e00740b0 con 0x7fc0f007cce0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.810+0000 7fc0ef7fe640 1 --2- 172.21.15.42:0/2930242338 >> v2:172.21.15.42:6800/475923179 conn(0x7fc0d803f8c0 0x7fc0d8041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.810+0000 7fc0ef7fe640 1 --2- 172.21.15.42:0/2930242338 >> v2:172.21.15.42:6800/475923179 conn(0x7fc0d803f8c0 0x7fc0d8041d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc0e40098c0 tx=0x7fc0e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:57.814+0000 7fc0ed7fa640 1 -- 172.21.15.42:0/2930242338 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fc0e0073e10 con 0x7fc0f007cce0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.022+0000 7fc0f66b4640 1 -- 172.21.15.42:0/2930242338 --> v2:172.21.15.42:6800/475923179 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc0f01033c0 con 0x7fc0d803f8c0 2024-09-21T17:40:58.671 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.028+0000 7fc0ed7fa640 1 -- 172.21.15.42:0/2930242338 <== mgr.14118 v2:172.21.15.42:6800/475923179 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc0f01033c0 con 0x7fc0d803f8c0 2024-09-21T17:40:58.672 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.030+0000 7fc0f66b4640 1 -- 172.21.15.42:0/2930242338 >> v2:172.21.15.42:6800/475923179 conn(0x7fc0d803f8c0 msgr2=0x7fc0d8041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:58.672 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.030+0000 7fc0f66b4640 1 --2- 172.21.15.42:0/2930242338 >> v2:172.21.15.42:6800/475923179 conn(0x7fc0d803f8c0 0x7fc0d8041d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc0e40098c0 tx=0x7fc0e4006db0 comp rx=0 tx=0).stop 2024-09-21T17:40:58.672 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.030+0000 7fc0f66b4640 1 -- 172.21.15.42:0/2930242338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 msgr2=0x7fc0f019ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:40:58.672 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.030+0000 7fc0f66b4640 1 --2- 172.21.15.42:0/2930242338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f019ca40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0000c00 tx=0x7fc0e0030b70 comp rx=0 tx=0).stop 2024-09-21T17:40:58.672 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.030+0000 7fc0f66b4640 1 -- 172.21.15.42:0/2930242338 shutdown_connections 2024-09-21T17:40:58.672 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.030+0000 7fc0f66b4640 1 --2- 172.21.15.42:0/2930242338 >> v2:172.21.15.42:6800/475923179 conn(0x7fc0d803f8c0 0x7fc0d8041d80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:58.672 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.030+0000 7fc0f66b4640 1 --2- 172.21.15.42:0/2930242338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0f007cce0 0x7fc0f019ca40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:40:58.672 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.030+0000 7fc0f66b4640 1 -- 172.21.15.42:0/2930242338 >> 172.21.15.42:0/2930242338 conn(0x7fc0f0102250 msgr2=0x7fc0f0102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:40:58.672 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.031+0000 7fc0f66b4640 1 -- 172.21.15.42:0/2930242338 shutdown_connections 2024-09-21T17:40:58.672 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:58.031+0000 7fc0f66b4640 1 -- 172.21.15.42:0/2930242338 wait complete. 2024-09-21T17:41:00.355 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.085+0000 7f59ad470640 1 Processor -- start 2024-09-21T17:41:00.355 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.085+0000 7f59ad470640 1 -- start start 2024-09-21T17:41:00.355 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.086+0000 7f59ad470640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a807b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:00.355 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.086+0000 7f59ad470640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f59a807b8c0 con 0x7f59a807cd20 2024-09-21T17:41:00.355 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.086+0000 7f59a6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a807b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:00.355 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.086+0000 7f59a6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a807b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51454/0 (socket says 172.21.15.42:51454) 2024-09-21T17:41:00.355 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.086+0000 7f59a6ffd640 1 -- 172.21.15.42:0/3695933219 learned_addr learned my addr 172.21.15.42:0/3695933219 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.086+0000 7f59a6ffd640 1 -- 172.21.15.42:0/3695933219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a807ba40 con 0x7f59a807cd20 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.087+0000 7f59a6ffd640 1 --2- 172.21.15.42:0/3695933219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a807b380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5998009820 tx=0x7f599802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0b15a9f34c0692 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.087+0000 7f59a5ffb640 1 -- 172.21.15.42:0/3695933219 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5998037070 con 0x7f59a807cd20 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.087+0000 7f59a5ffb640 1 -- 172.21.15.42:0/3695933219 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f59980328c0 con 0x7f59a807cd20 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.087+0000 7f59a5ffb640 1 -- 172.21.15.42:0/3695933219 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5998030640 con 0x7f59a807cd20 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.088+0000 7f59ad470640 1 -- 172.21.15.42:0/3695933219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 msgr2=0x7f59a807b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.088+0000 7f59ad470640 1 --2- 172.21.15.42:0/3695933219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a807b380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5998009820 tx=0x7f599802a270 comp rx=0 tx=0).stop 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.088+0000 7f59ad470640 1 -- 172.21.15.42:0/3695933219 shutdown_connections 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.088+0000 7f59ad470640 1 --2- 172.21.15.42:0/3695933219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a807b380 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.088+0000 7f59ad470640 1 -- 172.21.15.42:0/3695933219 >> 172.21.15.42:0/3695933219 conn(0x7f59a8102250 msgr2=0x7f59a8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.088+0000 7f59ad470640 1 -- 172.21.15.42:0/3695933219 shutdown_connections 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.088+0000 7f59ad470640 1 -- 172.21.15.42:0/3695933219 wait complete. 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.088+0000 7f59ad470640 1 Processor -- start 2024-09-21T17:41:00.356 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.089+0000 7f59ad470640 1 -- start start 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.089+0000 7f59ad470640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.089+0000 7f59ad470640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f59a810cf10 con 0x7f59a807cd20 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.089+0000 7f59a6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.089+0000 7f59a6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a819ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51458/0 (socket says 172.21.15.42:51458) 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.089+0000 7f59a6ffd640 1 -- 172.21.15.42:0/2524038018 learned_addr learned my addr 172.21.15.42:0/2524038018 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.089+0000 7f59a6ffd640 1 -- 172.21.15.42:0/2524038018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a819cfa0 con 0x7f59a807cd20 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.089+0000 7f59a6ffd640 1 --2- 172.21.15.42:0/2524038018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a819ca40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5998000c00 tx=0x7f5998030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.090+0000 7f598ffff640 1 -- 172.21.15.42:0/2524038018 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5998037040 con 0x7f59a807cd20 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.090+0000 7f598ffff640 1 -- 172.21.15.42:0/2524038018 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5998040070 con 0x7f59a807cd20 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.090+0000 7f59ad470640 1 -- 172.21.15.42:0/2524038018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a819d230 con 0x7f59a807cd20 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.090+0000 7f598ffff640 1 -- 172.21.15.42:0/2524038018 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599803a390 con 0x7f59a807cd20 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.090+0000 7f59ad470640 1 -- 172.21.15.42:0/2524038018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a819dbf0 con 0x7f59a807cd20 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.091+0000 7f598ffff640 1 -- 172.21.15.42:0/2524038018 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 51807+0+0 (secure 0 0 0) 0x7f599803b430 con 0x7f59a807cd20 2024-09-21T17:41:00.357 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.091+0000 7f59ad470640 1 -- 172.21.15.42:0/2524038018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a807b380 con 0x7f59a807cd20 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.091+0000 7f598ffff640 1 --2- 172.21.15.42:0/2524038018 >> v2:172.21.15.42:6800/475923179 conn(0x7f599003f870 0x7f5990041d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.091+0000 7f598ffff640 1 -- 172.21.15.42:0/2524038018 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f5998074100 con 0x7f59a807cd20 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.091+0000 7f59a67fc640 1 --2- 172.21.15.42:0/2524038018 >> v2:172.21.15.42:6800/475923179 conn(0x7f599003f870 0x7f5990041d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.091+0000 7f59a67fc640 1 --2- 172.21.15.42:0/2524038018 >> v2:172.21.15.42:6800/475923179 conn(0x7f599003f870 0x7f5990041d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f599c0098c0 tx=0x7f599c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.096+0000 7f598ffff640 1 -- 172.21.15.42:0/2524038018 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f5998043360 con 0x7f59a807cd20 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.293+0000 7f59ad470640 1 -- 172.21.15.42:0/2524038018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f59a819e330 con 0x7f59a807cd20 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.296+0000 7f598ffff640 1 -- 172.21.15.42:0/2524038018 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f5998031e10 con 0x7f59a807cd20 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.299+0000 7f59ad470640 1 -- 172.21.15.42:0/2524038018 >> v2:172.21.15.42:6800/475923179 conn(0x7f599003f870 msgr2=0x7f5990041d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.299+0000 7f59ad470640 1 --2- 172.21.15.42:0/2524038018 >> v2:172.21.15.42:6800/475923179 conn(0x7f599003f870 0x7f5990041d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f599c0098c0 tx=0x7f599c006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.299+0000 7f59ad470640 1 -- 172.21.15.42:0/2524038018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 msgr2=0x7f59a819ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.299+0000 7f59ad470640 1 --2- 172.21.15.42:0/2524038018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a819ca40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5998000c00 tx=0x7f5998030b70 comp rx=0 tx=0).stop 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.299+0000 7f59ad470640 1 -- 172.21.15.42:0/2524038018 shutdown_connections 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.299+0000 7f59ad470640 1 --2- 172.21.15.42:0/2524038018 >> v2:172.21.15.42:6800/475923179 conn(0x7f599003f870 0x7f5990041d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:00.358 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.299+0000 7f59ad470640 1 --2- 172.21.15.42:0/2524038018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59a807cd20 0x7f59a819ca40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:00.359 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.299+0000 7f59ad470640 1 -- 172.21.15.42:0/2524038018 >> 172.21.15.42:0/2524038018 conn(0x7f59a8102250 msgr2=0x7f59a8102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:00.359 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.299+0000 7f59ad470640 1 -- 172.21.15.42:0/2524038018 shutdown_connections 2024-09-21T17:41:00.359 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:40:59.299+0000 7f59ad470640 1 -- 172.21.15.42:0/2524038018 wait complete. 2024-09-21T17:41:00.592 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2524038018' entity='client.admin' 2024-09-21T17:41:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.786+0000 7ff460bc7640 1 Processor -- start 2024-09-21T17:41:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.786+0000 7ff460bc7640 1 -- start start 2024-09-21T17:41:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.786+0000 7ff460bc7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.786+0000 7ff460bc7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c107350 con 0x7ff45c106960 2024-09-21T17:41:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.786+0000 7ff45a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.786+0000 7ff45a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51472/0 (socket says 172.21.15.42:51472) 2024-09-21T17:41:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.786+0000 7ff45a59c640 1 -- 172.21.15.42:0/4051109369 learned_addr learned my addr 172.21.15.42:0/4051109369 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.787+0000 7ff45a59c640 1 -- 172.21.15.42:0/4051109369 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c1074d0 con 0x7ff45c106960 2024-09-21T17:41:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.787+0000 7ff45a59c640 1 --2- 172.21.15.42:0/4051109369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c106d60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009820 tx=0x7ff44c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9cc1e9e48af1327 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.788+0000 7ff459d9b640 1 -- 172.21.15.42:0/4051109369 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff44c037070 con 0x7ff45c106960 2024-09-21T17:41:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.788+0000 7ff459d9b640 1 -- 172.21.15.42:0/4051109369 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff44c0328c0 con 0x7ff45c106960 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.788+0000 7ff459d9b640 1 -- 172.21.15.42:0/4051109369 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff44c030640 con 0x7ff45c106960 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.788+0000 7ff460bc7640 1 -- 172.21.15.42:0/4051109369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 msgr2=0x7ff45c106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.788+0000 7ff460bc7640 1 --2- 172.21.15.42:0/4051109369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c106d60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009820 tx=0x7ff44c02a270 comp rx=0 tx=0).stop 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.788+0000 7ff460bc7640 1 -- 172.21.15.42:0/4051109369 shutdown_connections 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.788+0000 7ff460bc7640 1 --2- 172.21.15.42:0/4051109369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c106d60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.788+0000 7ff460bc7640 1 -- 172.21.15.42:0/4051109369 >> 172.21.15.42:0/4051109369 conn(0x7ff45c102250 msgr2=0x7ff45c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.788+0000 7ff460bc7640 1 -- 172.21.15.42:0/4051109369 shutdown_connections 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.788+0000 7ff460bc7640 1 -- 172.21.15.42:0/4051109369 wait complete. 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.789+0000 7ff460bc7640 1 Processor -- start 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.789+0000 7ff460bc7640 1 -- start start 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.789+0000 7ff460bc7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.789+0000 7ff460bc7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c10ade0 con 0x7ff45c106960 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.790+0000 7ff45a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:01.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.790+0000 7ff45a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c19a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51488/0 (socket says 172.21.15.42:51488) 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.790+0000 7ff45a59c640 1 -- 172.21.15.42:0/3696518365 learned_addr learned my addr 172.21.15.42:0/3696518365 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.790+0000 7ff45a59c640 1 -- 172.21.15.42:0/3696518365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c19ada0 con 0x7ff45c106960 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.790+0000 7ff45a59c640 1 --2- 172.21.15.42:0/3696518365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c19a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff44c000c00 tx=0x7ff44c030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.790+0000 7ff453fff640 1 -- 172.21.15.42:0/3696518365 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff44c037040 con 0x7ff45c106960 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.790+0000 7ff453fff640 1 -- 172.21.15.42:0/3696518365 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff44c040070 con 0x7ff45c106960 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.790+0000 7ff460bc7640 1 -- 172.21.15.42:0/3696518365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45c19b030 con 0x7ff45c106960 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.790+0000 7ff453fff640 1 -- 172.21.15.42:0/3696518365 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff44c03a390 con 0x7ff45c106960 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.790+0000 7ff460bc7640 1 -- 172.21.15.42:0/3696518365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45c19b9f0 con 0x7ff45c106960 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.791+0000 7ff453fff640 1 -- 172.21.15.42:0/3696518365 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 51807+0+0 (secure 0 0 0) 0x7ff44c03a610 con 0x7ff45c106960 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.791+0000 7ff460bc7640 1 -- 172.21.15.42:0/3696518365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45c106d60 con 0x7ff45c106960 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.791+0000 7ff453fff640 1 --2- 172.21.15.42:0/3696518365 >> v2:172.21.15.42:6800/475923179 conn(0x7ff44803f870 0x7ff448041d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.791+0000 7ff453fff640 1 -- 172.21.15.42:0/3696518365 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7ff44c0741c0 con 0x7ff45c106960 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.792+0000 7ff451d9b640 1 --2- 172.21.15.42:0/3696518365 >> v2:172.21.15.42:6800/475923179 conn(0x7ff44803f870 0x7ff448041d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.792+0000 7ff451d9b640 1 --2- 172.21.15.42:0/3696518365 >> v2:172.21.15.42:6800/475923179 conn(0x7ff44803f870 0x7ff448041d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff4440098c0 tx=0x7ff444006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:01.581 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.796+0000 7ff453fff640 1 -- 172.21.15.42:0/3696518365 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7ff44c073f20 con 0x7ff45c106960 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.987+0000 7ff460bc7640 1 -- 172.21.15.42:0/3696518365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7ff45c19c1a0 con 0x7ff45c106960 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.989+0000 7ff453fff640 1 -- 172.21.15.42:0/3696518365 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7ff44c03a900 con 0x7ff45c106960 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.991+0000 7ff460bc7640 1 -- 172.21.15.42:0/3696518365 >> v2:172.21.15.42:6800/475923179 conn(0x7ff44803f870 msgr2=0x7ff448041d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.991+0000 7ff460bc7640 1 --2- 172.21.15.42:0/3696518365 >> v2:172.21.15.42:6800/475923179 conn(0x7ff44803f870 0x7ff448041d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff4440098c0 tx=0x7ff444006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.991+0000 7ff460bc7640 1 -- 172.21.15.42:0/3696518365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 msgr2=0x7ff45c19a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.991+0000 7ff460bc7640 1 --2- 172.21.15.42:0/3696518365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c19a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff44c000c00 tx=0x7ff44c030b70 comp rx=0 tx=0).stop 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.992+0000 7ff460bc7640 1 -- 172.21.15.42:0/3696518365 shutdown_connections 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.992+0000 7ff460bc7640 1 --2- 172.21.15.42:0/3696518365 >> v2:172.21.15.42:6800/475923179 conn(0x7ff44803f870 0x7ff448041d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.992+0000 7ff460bc7640 1 --2- 172.21.15.42:0/3696518365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff45c106960 0x7ff45c19a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.992+0000 7ff460bc7640 1 -- 172.21.15.42:0/3696518365 >> 172.21.15.42:0/3696518365 conn(0x7ff45c102250 msgr2=0x7ff45c102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.992+0000 7ff460bc7640 1 -- 172.21.15.42:0/3696518365 shutdown_connections 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:00.992+0000 7ff460bc7640 1 -- 172.21.15.42:0/3696518365 wait complete. 2024-09-21T17:41:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling the dashboard module... 2024-09-21T17:41:02.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:01 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:41:02.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3696518365' entity='client.admin' 2024-09-21T17:41:02.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:01 smithi042 ceph-mon[29361]: from='mgr.14118 172.21.15.42:0/658487716' entity='mgr.y' 2024-09-21T17:41:03.139 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:02 smithi042 ceph-mon[29361]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:03.139 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3392948912' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T17:41:03.139 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:02 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ignoring --setuser ceph since I am not root 2024-09-21T17:41:03.140 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:02 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ignoring --setgroup ceph since I am not root 2024-09-21T17:41:03.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.994+0000 7f8d59bc5640 1 Processor -- start 2024-09-21T17:41:03.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.995+0000 7f8d59bc5640 1 -- start start 2024-09-21T17:41:03.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.995+0000 7f8d59bc5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d54109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:03.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.995+0000 7f8d59bc5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8d54109a70 con 0x7f8d5407ac60 2024-09-21T17:41:03.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.995+0000 7f8d537fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d54109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:03.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.995+0000 7f8d537fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d54109530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59576/0 (socket says 172.21.15.42:59576) 2024-09-21T17:41:03.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.995+0000 7f8d537fe640 1 -- 172.21.15.42:0/3366802959 learned_addr learned my addr 172.21.15.42:0/3366802959 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:03.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.995+0000 7f8d537fe640 1 -- 172.21.15.42:0/3366802959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d54109bf0 con 0x7f8d5407ac60 2024-09-21T17:41:03.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.996+0000 7f8d537fe640 1 --2- 172.21.15.42:0/3366802959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d54109530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009820 tx=0x7f8d4402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189547767eb8a69f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:03.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.996+0000 7f8d52ffd640 1 -- 172.21.15.42:0/3366802959 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d44037070 con 0x7f8d5407ac60 2024-09-21T17:41:03.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.996+0000 7f8d52ffd640 1 -- 172.21.15.42:0/3366802959 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f8d440328c0 con 0x7f8d5407ac60 2024-09-21T17:41:03.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.996+0000 7f8d52ffd640 1 -- 172.21.15.42:0/3366802959 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d440306d0 con 0x7f8d5407ac60 2024-09-21T17:41:03.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.997+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3366802959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 msgr2=0x7f8d54109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:03.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.997+0000 7f8d59bc5640 1 --2- 172.21.15.42:0/3366802959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d54109530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009820 tx=0x7f8d4402a300 comp rx=0 tx=0).stop 2024-09-21T17:41:03.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.997+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3366802959 shutdown_connections 2024-09-21T17:41:03.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.997+0000 7f8d59bc5640 1 --2- 172.21.15.42:0/3366802959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d54109530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:03.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.997+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3366802959 >> 172.21.15.42:0/3366802959 conn(0x7f8d54101140 msgr2=0x7f8d54103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:03.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.997+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3366802959 shutdown_connections 2024-09-21T17:41:03.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.997+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3366802959 wait complete. 2024-09-21T17:41:03.770 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.998+0000 7f8d59bc5640 1 Processor -- start 2024-09-21T17:41:03.770 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.998+0000 7f8d59bc5640 1 -- start start 2024-09-21T17:41:03.770 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.998+0000 7f8d59bc5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d5419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:03.770 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.998+0000 7f8d59bc5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5410acf0 con 0x7f8d5407ac60 2024-09-21T17:41:03.770 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.998+0000 7f8d537fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d5419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:03.770 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.998+0000 7f8d537fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d5419a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59592/0 (socket says 172.21.15.42:59592) 2024-09-21T17:41:03.770 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.998+0000 7f8d537fe640 1 -- 172.21.15.42:0/3392948912 learned_addr learned my addr 172.21.15.42:0/3392948912 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:03.770 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.998+0000 7f8d537fe640 1 -- 172.21.15.42:0/3392948912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5419ad90 con 0x7f8d5407ac60 2024-09-21T17:41:03.770 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.999+0000 7f8d537fe640 1 --2- 172.21.15.42:0/3392948912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d5419a830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d44032b90 tx=0x7f8d44032790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:03.770 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.999+0000 7f8d517fa640 1 -- 172.21.15.42:0/3392948912 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d44037040 con 0x7f8d5407ac60 2024-09-21T17:41:03.770 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.999+0000 7f8d517fa640 1 -- 172.21.15.42:0/3392948912 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f8d44040070 con 0x7f8d5407ac60 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.999+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3392948912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5419b020 con 0x7f8d5407ac60 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.999+0000 7f8d517fa640 1 -- 172.21.15.42:0/3392948912 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d4403be30 con 0x7f8d5407ac60 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:01.999+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3392948912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5419b9e0 con 0x7f8d5407ac60 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.000+0000 7f8d517fa640 1 -- 172.21.15.42:0/3392948912 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 51807+0+0 (secure 0 0 0) 0x7f8d44045460 con 0x7f8d5407ac60 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.000+0000 7f8d517fa640 1 --2- 172.21.15.42:0/3392948912 >> v2:172.21.15.42:6800/475923179 conn(0x7f8d4003f8c0 0x7f8d40041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.000+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3392948912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d54107520 con 0x7f8d5407ac60 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.000+0000 7f8d517fa640 1 -- 172.21.15.42:0/3392948912 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f8d44073fe0 con 0x7f8d5407ac60 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.000+0000 7f8d4affd640 1 --2- 172.21.15.42:0/3392948912 >> v2:172.21.15.42:6800/475923179 conn(0x7f8d4003f8c0 0x7f8d40041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.001+0000 7f8d4affd640 1 --2- 172.21.15.42:0/3392948912 >> v2:172.21.15.42:6800/475923179 conn(0x7f8d4003f8c0 0x7f8d40041d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0098c0 tx=0x7f8d3c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.005+0000 7f8d517fa640 1 -- 172.21.15.42:0/3392948912 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f8d44041270 con 0x7f8d5407ac60 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.250+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3392948912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f8d5419c1e0 con 0x7f8d5407ac60 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.886+0000 7f8d517fa640 1 -- 172.21.15.42:0/3392948912 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v10) ==== 88+0+0 (secure 0 0 0) 0x7f8d44073d40 con 0x7f8d5407ac60 2024-09-21T17:41:03.771 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.888+0000 7f8d517fa640 1 -- 172.21.15.42:0/3392948912 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mgrmap(e 10) ==== 51820+0+0 (secure 0 0 0) 0x7f8d44030c70 con 0x7f8d5407ac60 2024-09-21T17:41:03.772 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.890+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3392948912 >> v2:172.21.15.42:6800/475923179 conn(0x7f8d4003f8c0 msgr2=0x7f8d40041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:03.772 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.890+0000 7f8d59bc5640 1 --2- 172.21.15.42:0/3392948912 >> v2:172.21.15.42:6800/475923179 conn(0x7f8d4003f8c0 0x7f8d40041d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0098c0 tx=0x7f8d3c006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:03.772 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.890+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3392948912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 msgr2=0x7f8d5419a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:03.772 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.890+0000 7f8d59bc5640 1 --2- 172.21.15.42:0/3392948912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d5419a830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d44032b90 tx=0x7f8d44032790 comp rx=0 tx=0).stop 2024-09-21T17:41:03.772 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.890+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3392948912 shutdown_connections 2024-09-21T17:41:03.772 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.890+0000 7f8d59bc5640 1 --2- 172.21.15.42:0/3392948912 >> v2:172.21.15.42:6800/475923179 conn(0x7f8d4003f8c0 0x7f8d40041d80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:03.772 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.890+0000 7f8d59bc5640 1 --2- 172.21.15.42:0/3392948912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d5407ac60 0x7f8d5419a830 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:03.772 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.890+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3392948912 >> 172.21.15.42:0/3392948912 conn(0x7f8d54101140 msgr2=0x7f8d54101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:03.772 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.890+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3392948912 shutdown_connections 2024-09-21T17:41:03.772 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:02.890+0000 7f8d59bc5640 1 -- 172.21.15.42:0/3392948912 wait complete. 2024-09-21T17:41:04.020 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3392948912' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T17:41:04.021 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:03 smithi042 ceph-mon[29361]: mgrmap e10: y(active, since 21s) 2024-09-21T17:41:05.008 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/976154892' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T17:41:05.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-21T17:41:05.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-21T17:41:05.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T17:41:05.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-21T17:41:05.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T17:41:05.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-21T17:41:05.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.224+0000 7f05b525d640 1 Processor -- start 2024-09-21T17:41:05.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.224+0000 7f05b525d640 1 -- start start 2024-09-21T17:41:05.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.224+0000 7f05b525d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0109520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:05.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.224+0000 7f05b525d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05b0109a60 con 0x7f05b007a440 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.224+0000 7f05aed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0109520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.224+0000 7f05aed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0109520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59614/0 (socket says 172.21.15.42:59614) 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.224+0000 7f05aed9d640 1 -- 172.21.15.42:0/2400039023 learned_addr learned my addr 172.21.15.42:0/2400039023 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.225+0000 7f05aed9d640 1 -- 172.21.15.42:0/2400039023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b0109be0 con 0x7f05b007a440 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.225+0000 7f05aed9d640 1 --2- 172.21.15.42:0/2400039023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0109520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009820 tx=0x7f05a002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704686e08b6999ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.226+0000 7f05ae59c640 1 -- 172.21.15.42:0/2400039023 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0037070 con 0x7f05b007a440 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.226+0000 7f05ae59c640 1 -- 172.21.15.42:0/2400039023 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f05a00328c0 con 0x7f05b007a440 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.226+0000 7f05ae59c640 1 -- 172.21.15.42:0/2400039023 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a00306d0 con 0x7f05b007a440 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.226+0000 7f05b525d640 1 -- 172.21.15.42:0/2400039023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 msgr2=0x7f05b0109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.226+0000 7f05b525d640 1 --2- 172.21.15.42:0/2400039023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0109520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009820 tx=0x7f05a002a300 comp rx=0 tx=0).stop 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.226+0000 7f05b525d640 1 -- 172.21.15.42:0/2400039023 shutdown_connections 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.226+0000 7f05b525d640 1 --2- 172.21.15.42:0/2400039023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0109520 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.226+0000 7f05b525d640 1 -- 172.21.15.42:0/2400039023 >> 172.21.15.42:0/2400039023 conn(0x7f05b01011b0 msgr2=0x7f05b01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.226+0000 7f05b525d640 1 -- 172.21.15.42:0/2400039023 shutdown_connections 2024-09-21T17:41:05.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.226+0000 7f05b525d640 1 -- 172.21.15.42:0/2400039023 wait complete. 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.227+0000 7f05b525d640 1 Processor -- start 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.227+0000 7f05b525d640 1 -- start start 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.227+0000 7f05b525d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0106b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.227+0000 7f05b525d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010ace0 con 0x7f05b007a440 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.228+0000 7f05aed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0106b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.228+0000 7f05aed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0106b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59630/0 (socket says 172.21.15.42:59630) 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.228+0000 7f05aed9d640 1 -- 172.21.15.42:0/976154892 learned_addr learned my addr 172.21.15.42:0/976154892 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.228+0000 7f05aed9d640 1 -- 172.21.15.42:0/976154892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b01070d0 con 0x7f05b007a440 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.228+0000 7f05aed9d640 1 --2- 172.21.15.42:0/976154892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0106b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f05a0000c00 tx=0x7f05a0030a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.228+0000 7f05acd99640 1 -- 172.21.15.42:0/976154892 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0037040 con 0x7f05b007a440 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.228+0000 7f05acd99640 1 -- 172.21.15.42:0/976154892 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f05a0040070 con 0x7f05b007a440 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.228+0000 7f05acd99640 1 -- 172.21.15.42:0/976154892 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a003be20 con 0x7f05b007a440 2024-09-21T17:41:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.228+0000 7f05b525d640 1 -- 172.21.15.42:0/976154892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b01054c0 con 0x7f05b007a440 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.228+0000 7f05b525d640 1 -- 172.21.15.42:0/976154892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b0105a40 con 0x7f05b007a440 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.229+0000 7f05b525d640 1 -- 172.21.15.42:0/976154892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b0107300 con 0x7f05b007a440 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.230+0000 7f05acd99640 1 -- 172.21.15.42:0/976154892 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 10) ==== 51820+0+0 (secure 0 0 0) 0x7f05a003b430 con 0x7f05b007a440 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.230+0000 7f05acd99640 1 --2- 172.21.15.42:0/976154892 >> v2:172.21.15.42:6800/475923179 conn(0x7f059c03f8c0 0x7f059c041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.230+0000 7f05a7fff640 1 -- 172.21.15.42:0/976154892 >> v2:172.21.15.42:6800/475923179 conn(0x7f059c03f8c0 msgr2=0x7f059c041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/475923179 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.230+0000 7f05acd99640 1 -- 172.21.15.42:0/976154892 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f05a0074080 con 0x7f05b007a440 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.230+0000 7f05a7fff640 1 --2- 172.21.15.42:0/976154892 >> v2:172.21.15.42:6800/475923179 conn(0x7f059c03f8c0 0x7f059c041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.234+0000 7f05acd99640 1 -- 172.21.15.42:0/976154892 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f05a0043360 con 0x7f05b007a440 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.431+0000 7f05a7fff640 1 -- 172.21.15.42:0/976154892 >> v2:172.21.15.42:6800/475923179 conn(0x7f059c03f8c0 msgr2=0x7f059c041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/475923179 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.431+0000 7f05a7fff640 1 --2- 172.21.15.42:0/976154892 >> v2:172.21.15.42:6800/475923179 conn(0x7f059c03f8c0 0x7f059c041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.473+0000 7f05b525d640 1 -- 172.21.15.42:0/976154892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f05b0105fd0 con 0x7f05b007a440 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.474+0000 7f05acd99640 1 -- 172.21.15.42:0/976154892 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v10) ==== 56+0+89 (secure 0 0 0) 0x7f05a0030de0 con 0x7f05b007a440 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.476+0000 7f05b525d640 1 -- 172.21.15.42:0/976154892 >> v2:172.21.15.42:6800/475923179 conn(0x7f059c03f8c0 msgr2=0x7f059c041d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.476+0000 7f05b525d640 1 --2- 172.21.15.42:0/976154892 >> v2:172.21.15.42:6800/475923179 conn(0x7f059c03f8c0 0x7f059c041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.476+0000 7f05b525d640 1 -- 172.21.15.42:0/976154892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 msgr2=0x7f05b0106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:05.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.476+0000 7f05b525d640 1 --2- 172.21.15.42:0/976154892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0106b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f05a0000c00 tx=0x7f05a0030a60 comp rx=0 tx=0).stop 2024-09-21T17:41:05.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.476+0000 7f05b525d640 1 -- 172.21.15.42:0/976154892 shutdown_connections 2024-09-21T17:41:05.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.476+0000 7f05b525d640 1 --2- 172.21.15.42:0/976154892 >> v2:172.21.15.42:6800/475923179 conn(0x7f059c03f8c0 0x7f059c041d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:05.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.476+0000 7f05b525d640 1 --2- 172.21.15.42:0/976154892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b007a440 0x7f05b0106b70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:05.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.476+0000 7f05b525d640 1 -- 172.21.15.42:0/976154892 >> 172.21.15.42:0/976154892 conn(0x7f05b01011b0 msgr2=0x7f05b0101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:05.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.476+0000 7f05b525d640 1 -- 172.21.15.42:0/976154892 shutdown_connections 2024-09-21T17:41:05.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:04.476+0000 7f05b525d640 1 -- 172.21.15.42:0/976154892 wait complete. 2024-09-21T17:41:05.020 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for the mgr to restart... 2024-09-21T17:41:05.020 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr epoch 10... 2024-09-21T17:41:08.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:08 smithi042 ceph-mon[29361]: Active manager daemon y restarted 2024-09-21T17:41:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:08 smithi042 ceph-mon[29361]: Activating manager daemon y 2024-09-21T17:41:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:08 smithi042 ceph-mon[29361]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T17:41:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:08 smithi042 ceph-mon[29361]: mgrmap e11: y(active, starting, since 0.00331894s) 2024-09-21T17:41:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:08 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:41:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:08 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T17:41:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:08 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T17:41:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:08 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T17:41:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:08 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T17:41:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:08 smithi042 ceph-mon[29361]: Manager daemon y is now available 2024-09-21T17:41:09.481 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:09.481 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T17:41:09.481 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T17:41:09.481 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-mon[29361]: mgrmap e12: y(active, since 1.00742s) 2024-09-21T17:41:09.740 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-21T17:41:09.740 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-21T17:41:09.740 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T17:41:09.740 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-21T17:41:09.740 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.432+0000 7f1da69f5640 1 Processor -- start 2024-09-21T17:41:09.740 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.433+0000 7f1da69f5640 1 -- start start 2024-09-21T17:41:09.740 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.433+0000 7f1da69f5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:09.740 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.433+0000 7f1da69f5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1da0109a70 con 0x7f1da007a440 2024-09-21T17:41:09.740 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.433+0000 7f1d9ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:09.740 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.433+0000 7f1d9ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0109530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59640/0 (socket says 172.21.15.42:59640) 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.433+0000 7f1d9ffff640 1 -- 172.21.15.42:0/2352949473 learned_addr learned my addr 172.21.15.42:0/2352949473 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.434+0000 7f1d9ffff640 1 -- 172.21.15.42:0/2352949473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da0109bf0 con 0x7f1da007a440 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.434+0000 7f1d9ffff640 1 --2- 172.21.15.42:0/2352949473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0109530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009820 tx=0x7f1d9002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad63f75e46b2b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.435+0000 7f1d9effd640 1 -- 172.21.15.42:0/2352949473 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d90037070 con 0x7f1da007a440 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.435+0000 7f1d9effd640 1 -- 172.21.15.42:0/2352949473 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f1d900328c0 con 0x7f1da007a440 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.435+0000 7f1d9effd640 1 -- 172.21.15.42:0/2352949473 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d900306d0 con 0x7f1da007a440 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.436+0000 7f1da69f5640 1 -- 172.21.15.42:0/2352949473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 msgr2=0x7f1da0109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.436+0000 7f1da69f5640 1 --2- 172.21.15.42:0/2352949473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0109530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009820 tx=0x7f1d9002a300 comp rx=0 tx=0).stop 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.436+0000 7f1da69f5640 1 -- 172.21.15.42:0/2352949473 shutdown_connections 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.436+0000 7f1da69f5640 1 --2- 172.21.15.42:0/2352949473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0109530 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.436+0000 7f1da69f5640 1 -- 172.21.15.42:0/2352949473 >> 172.21.15.42:0/2352949473 conn(0x7f1da0101160 msgr2=0x7f1da0103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.436+0000 7f1da69f5640 1 -- 172.21.15.42:0/2352949473 shutdown_connections 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.436+0000 7f1da69f5640 1 -- 172.21.15.42:0/2352949473 wait complete. 2024-09-21T17:41:09.741 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.436+0000 7f1da69f5640 1 Processor -- start 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.437+0000 7f1da69f5640 1 -- start start 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.437+0000 7f1da69f5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0106b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.437+0000 7f1da69f5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1da010acf0 con 0x7f1da007a440 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.437+0000 7f1d9ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.437+0000 7f1d9ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59642/0 (socket says 172.21.15.42:59642) 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.437+0000 7f1d9ffff640 1 -- 172.21.15.42:0/2407687164 learned_addr learned my addr 172.21.15.42:0/2407687164 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.437+0000 7f1d9ffff640 1 -- 172.21.15.42:0/2407687164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da01070e0 con 0x7f1da007a440 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.438+0000 7f1d9ffff640 1 --2- 172.21.15.42:0/2407687164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0106b80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d90000c00 tx=0x7f1d90030a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.438+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d90037040 con 0x7f1da007a440 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.438+0000 7f1da69f5640 1 -- 172.21.15.42:0/2407687164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da01054d0 con 0x7f1da007a440 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.438+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f1d90040070 con 0x7f1da007a440 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.438+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d9003bda0 con 0x7f1da007a440 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.438+0000 7f1da69f5640 1 -- 172.21.15.42:0/2407687164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da0105a50 con 0x7f1da007a440 2024-09-21T17:41:09.742 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.439+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 10) ==== 51820+0+0 (secure 0 0 0) 0x7f1d90045460 con 0x7f1da007a440 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.439+0000 7f1d9d7fa640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 0x7f1d88041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.439+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 --> v2:172.21.15.42:6800/475923179 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1d88042450 con 0x7f1d8803f8c0 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.439+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f1d90073f80 con 0x7f1da007a440 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.439+0000 7f1d9f7fe640 1 -- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 msgr2=0x7f1d88041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/475923179 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.439+0000 7f1d9f7fe640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 0x7f1d88041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.640+0000 7f1d9f7fe640 1 -- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 msgr2=0x7f1d88041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/475923179 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:05.640+0000 7f1d9f7fe640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 0x7f1d88041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:06.041+0000 7f1d9f7fe640 1 -- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 msgr2=0x7f1d88041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/475923179 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:06.041+0000 7f1d9f7fe640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 0x7f1d88041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:06.842+0000 7f1d9f7fe640 1 -- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 msgr2=0x7f1d88041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/475923179 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:06.842+0000 7f1d9f7fe640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 0x7f1d88041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:08.166+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mgrmap(e 11) ==== 51622+0+0 (secure 0 0 0) 0x7f1d90042d20 con 0x7f1da007a440 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:08.166+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 msgr2=0x7f1d88041d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T17:41:09.743 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:08.166+0000 7f1d9d7fa640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 0x7f1d88041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.168+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 12) ==== 51714+0+0 (secure 0 0 0) 0x7f1d90045750 con 0x7f1da007a440 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.168+0000 7f1d9d7fa640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/92962027 conn(0x7f1d880432f0 0x7f1d880456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.168+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 --> v2:172.21.15.42:6800/92962027 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1d90037e50 con 0x7f1d880432f0 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.170+0000 7f1d9f7fe640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/92962027 conn(0x7f1d880432f0 0x7f1d880456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.170+0000 7f1d9f7fe640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/92962027 conn(0x7f1d880432f0 0x7f1d880456e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1d94003980 tx=0x7f1d94006e10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.171+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f1d90037e50 con 0x7f1d880432f0 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.178+0000 7f1da69f5640 1 -- 172.21.15.42:0/2407687164 --> v2:172.21.15.42:6800/92962027 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f1da0107310 con 0x7f1d880432f0 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.179+0000 7f1d9d7fa640 1 -- 172.21.15.42:0/2407687164 <== mgr.14152 v2:172.21.15.42:6800/92962027 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f1da0107310 con 0x7f1d880432f0 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.179+0000 7f1da69f5640 1 -- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/92962027 conn(0x7f1d880432f0 msgr2=0x7f1d880456e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.179+0000 7f1da69f5640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/92962027 conn(0x7f1d880432f0 0x7f1d880456e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1d94003980 tx=0x7f1d94006e10 comp rx=0 tx=0).stop 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.179+0000 7f1da69f5640 1 -- 172.21.15.42:0/2407687164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 msgr2=0x7f1da0106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.179+0000 7f1da69f5640 1 --2- 172.21.15.42:0/2407687164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0106b80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d90000c00 tx=0x7f1d90030a60 comp rx=0 tx=0).stop 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.179+0000 7f1da69f5640 1 -- 172.21.15.42:0/2407687164 shutdown_connections 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.179+0000 7f1da69f5640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/92962027 conn(0x7f1d880432f0 0x7f1d880456e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:09.744 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.179+0000 7f1da69f5640 1 --2- 172.21.15.42:0/2407687164 >> v2:172.21.15.42:6800/475923179 conn(0x7f1d8803f8c0 0x7f1d88041d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:09.745 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.179+0000 7f1da69f5640 1 --2- 172.21.15.42:0/2407687164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da007a440 0x7f1da0106b80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:09.745 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.179+0000 7f1da69f5640 1 -- 172.21.15.42:0/2407687164 >> 172.21.15.42:0/2407687164 conn(0x7f1da0101160 msgr2=0x7f1da0101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:09.745 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.179+0000 7f1da69f5640 1 -- 172.21.15.42:0/2407687164 shutdown_connections 2024-09-21T17:41:09.745 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:09.180+0000 7f1da69f5640 1 -- 172.21.15.42:0/2407687164 wait complete. 2024-09-21T17:41:09.745 INFO:teuthology.orchestra.run.smithi042.stdout:mgr epoch 10 is available 2024-09-21T17:41:09.745 INFO:teuthology.orchestra.run.smithi042.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T17:41:10.044 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: 2024-09-21T17:41:09.812+0000 7f87bc590640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:17:41:09] ENGINE Error in HTTPServer.serve 2024-09-21T17:41:10.044 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: Traceback (most recent call last): 2024-09-21T17:41:10.044 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T17:41:10.044 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self._connections.run(self.expiration_interval) 2024-09-21T17:41:10.044 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self._run(expiration_interval) 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: s = self.context.wrap_socket( 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: return self.sslsocket_class._create( 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self.do_handshake() 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self._sslobj.do_handshake() 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T17:41:10.045 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:09 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:10 smithi042 ceph-mon[29361]: [21/Sep/2024:17:41:09] ENGINE Bus STARTING 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:10 smithi042 ceph-mon[29361]: [21/Sep/2024:17:41:09] ENGINE Serving on http://172.21.15.42:8765 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:10 smithi042 ceph-mon[29361]: [21/Sep/2024:17:41:09] ENGINE Serving on https://172.21.15.42:7150 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:10 smithi042 ceph-mon[29361]: [21/Sep/2024:17:41:09] ENGINE Bus STARTED 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:10 smithi042 ceph-mon[29361]: [21/Sep/2024:17:41:09] ENGINE Error in HTTPServer.serve 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout: Traceback (most recent call last): 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._connections.run(self.expiration_interval) 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._run(expiration_interval) 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T17:41:10.395 INFO:journalctl@ceph.mon.a.smithi042.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T17:41:10.396 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T17:41:10.396 INFO:journalctl@ceph.mon.a.smithi042.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T17:41:10.396 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T17:41:10.396 INFO:journalctl@ceph.mon.a.smithi042.stdout: s = self.context.wrap_socket( 2024-09-21T17:41:10.396 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T17:41:10.396 INFO:journalctl@ceph.mon.a.smithi042.stdout: return self.sslsocket_class._create( 2024-09-21T17:41:10.396 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T17:41:10.396 INFO:journalctl@ceph.mon.a.smithi042.stdout: self.do_handshake() 2024-09-21T17:41:10.396 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T17:41:10.396 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._sslobj.do_handshake() 2024-09-21T17:41:10.396 INFO:journalctl@ceph.mon.a.smithi042.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T17:41:11.481 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:11 smithi042 ceph-mon[29361]: mgrmap e13: y(active, since 2s) 2024-09-21T17:41:11.481 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:11 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:11.481 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:11 smithi042 ceph-mon[29361]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:11.482 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:11 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:12.756 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFEDCCAvigAwIBAgIURON9iAzC4FcuAoIaSjTgbD5CN5MwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTE3NDExMloXDTM0\nMDkyMjE3NDExMlowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjQyMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA2YsIyf5fFhoOzioHa+wItcu7Vqm5cbg0zUw+\nJx3uJ6zc4/Uxv/JcbFw+d5yOtLGY7DpUidd7Z7R6bc25AbB3xv2ldhBNs3+9cVNj\n3uy+BDvVOXvzydoclgBK4xBtltvZ0HQwOUaHhjxES7HLI30auYa2Ym3xLDx5ntYW\ns01zQyoRdECeKFV9lXzAA0zFpX9yGIfr8K+obMlzqjadlL1B3PY3fabNdvjgTyCx\nhiHKxrf+138y0NRBjqZlzJBM2BhJnLxK5JjrHMEjNgSLxCj5bVOYx9zAPzT+b7l5\nCfR0dovt7OoaLVDwO18N+HqK1KxntTWgkloH9jDlWoI6pCJzP7NAZkyfjVAIpq6y\nlxVoKjqQvNkuFTGcukI4cNjNQi2Y2akMgNQj1vHCNfTFYTaurdPBNrnXEOspsRBE\ns/aLlYBuWAOJXK8aRBoAJTBhk0gjNNTdABM6/z4LZPy6ApY3fwcEw8ALx71Tk2ta\n0q0jZiAChnYts8huoyCLJTf9MTA8LqIIUbZCPi6D1XbCnndjiLsH0cON9QDNZJ2t\nOjODrwjKfBIEoA38990znpnjfDpkkN+9tDAqzrSz+xxOTG3ct75WK+fHOYpPuSCw\nK06m91C1L0tWzmbHVWlqoC6tHhoNI6SPBNEDu7zEBK8zITepgtrk1wsFwNABR0Y3\nxjDGI7sCAwEAAaNUMFIwQgYDVR0RBDswOYIec21pdGhpMDQyLmZyb250LnNlcGlh\nLmNlcGguY29tghFkYXNoYm9hcmRfc2VydmVyc4cErBUPKjAMBgNVHRMBAf8EAjAA\nMA0GCSqGSIb3DQEBCwUAA4ICAQCPuKcOzr533X2havDZ5ejcLm094cB1VOJzs/ET\nh4DxpfeiQ2ZC/Gh6zzZtv8j58qvnRDRPZW4mJJqhcoRTCtiryvoTxW8HhhZXTEbd\n1Gw5YNmij/xnvAxzu+90qhcW7a1YqDwQw3hgAP75C1OLAlJMcmQpBnffCH5pSCWB\n2gmawDyrOyv9PXgrVdTHQiPFYr2DG7wwqTZpxDArRj8bQLCR8JG0r2Q6QQTBtTUT\n+7WnaunwX95bq2IbbHg7v4hwWuIMzmW44mcr21M18HfYE2hOGUi1YuuCkM9A2oBA\np7+YqoPIAiWrF9Oj/oho5U0JIeZNSf1zQgAftjCIyZl/o6cG6CIz0J5pFq5SVEW6\n6vv/H9wQXPb4wqrjtFK92DGHv+TZEezZmsFIe7aoaNE5GBG5sItEdYA/7SLyqhZp\nV0VeO63xwhw67XQAZVxe+V1f5IuVkCx+71qLTmo8DNlo1tioLmdOff7aWZOCsVsd\nBDGfpYTgmR/P4eC2S+PAioY57hSr6xuI2oKIIrymO1HIV5f4VJb5t/aczrNnhEuY\nZWgzSSoRgamN5EzrANUS1iq/vdUPtoT6Tm7IoOTZdYK/68PY5ytF4B/Y+C6afxR3\nJcZKsuSnyKb8dFO3t67GPd5GOVoVedpqdh05hzpcKZw+qUiKzQ7Xli92I/8GpOB9\nC6F5xg==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEA2YsIyf5fFhoOzioHa+wItcu7Vqm5cbg0zUw+Jx3uJ6zc4/Ux\nv/JcbFw+d5yOtLGY7DpUidd7Z7R6bc25AbB3xv2ldhBNs3+9cVNj3uy+BDvVOXvz\nydoclgBK4xBtltvZ0HQwOUaHhjxES7HLI30auYa2Ym3xLDx5ntYWs01zQyoRdECe\nKFV9lXzAA0zFpX9yGIfr8K+obMlzqjadlL1B3PY3fabNdvjgTyCxhiHKxrf+138y\n0NRBjqZlzJBM2BhJnLxK5JjrHMEjNgSLxCj5bVOYx9zAPzT+b7l5CfR0dovt7Ooa\nLVDwO18N+HqK1KxntTWgkloH9jDlWoI6pCJzP7NAZkyfjVAIpq6ylxVoKjqQvNku\nFTGcukI4cNjNQi2Y2akMgNQj1vHCNfTFYTaurdPBNrnXEOspsRBEs/aLlYBuWAOJ\nXK8aRBoAJTBhk0gjNNTdABM6/z4LZPy6ApY3fwcEw8ALx71Tk2ta0q0jZiAChnYt\ns8huoyCLJTf9MTA8LqIIUbZCPi6D1XbCnndjiLsH0cON9QDNZJ2tOjODrwjKfBIE\noA38990znpnjfDpkkN+9tDAqzrSz+xxOTG3ct75WK+fHOYpPuSCwK06m91C1L0tW\nzmbHVWlqoC6tHhoNI6SPBNEDu7zEBK8zITepgtrk1wsFwNABR0Y3xjDGI7sCAwEA\nAQKCAgAO/ENaOsINETV04TNKrWM6NrMMeLuUCFbmz3o2kpq9s+wxbcoECWtxcXdC\nIRA5hURd/XSmXCgdkDKgzruQULonhIB53gykMUf4/wARsqgyPXbmM1IrVPGEKbf+\n5TpPWoyqDd7miyO5zPv9ZN1z7+G/5vY4WI909yN/nArLRioK9eJm6i6a46y3d/T4\nJTk2Oc2/v9kyZr9I4yWrE4EOZm0bjgBrkOp1aBZ3jO59qWVBBBqzeIklFoH/lBnO\nGiCZAC9N8zCLh7cmb22AApcoJ5RrAgezuNKrZ/ig9JtQYr0FD4WPvN6ZwYoS5Oze\n8X4PwWKReoS5oCcNP/gEoJTuior6t0IjqhYqpNBXxBGo53t/jbsb/gVUoejyAwzx\n75Mx2cyycrQqkU6TdYcYQZB40UBq0DVVz0O08uiXvCXRhlxMonW7KQ1EFL8SADEi\ne7276Dn2JXV1XaBH0U6DJcAO06e2KUQ+DaLinTtRMswcqrdMXNKFABKpDFWWhNyt\nnCWcuj3qkR0P4GYwia+rfj6fySfZM8rIPOkA3vKQ2LxQRyiwhc1poGDZtUBMGcGD\nD7Pb0irL2u6lRACXik4A9/ntXJfUVnu2nOjJ8e3TRpsEYyymiVaic8ILYfOI4P2P\nVGi9hB4UZEk8OXfc9JhgwwwYP/V+0thTVTPQ8yc/+Mb4G962zQKCAQEA/foh1KoZ\n8nmjyYK6w7ilzVVy4mV8R64e5PVxJGRajKET3gTD+OAJ3iCDNFp/641zkJxwyuJM\nT0g1zoLARgR7uMgRZqfwpdy93JXrc50babrG3FeAtAvA9g9uQNKy+Mo26eZzjAm/\nTMpVJyRPvFH+pqgFlLypTXcYcz4staj9mnxufL9vCggxuI3tYZfPlios4DatwxAT\n367HGDIim05NScTSsuFNEDHj6LzUr/zvWhWU+tAV4tviI0t/nDrHwduVySMgQACp\nqsy99x3NIZwC56dHUZIdrwvAlIVbpEwZz9H1nmB00Ddgh+drc9a+7LIFKLwf/hTG\nRKhmUn+5uQ7xHwKCAQEA20acsMm3lYdEMonTlAmQjH7tPfW6C39pGDIvrVBpdTdi\nBjJWRszJwOTviBhoWto6T9ZgOapiwYDCznFOUwA5sNU4wq3s3y8ipiTAI1YqlJy/\njBCi1jPW9SVrKkx/sJAjV03tp5thbuyC5xy2U4RdSdcnVhr7gp1UnEcTK8Ec4eWy\npdvPyrPbar/TuuJkgvFD1Oue5tGIjp9vX7SXaW2CuKV2sCwjGOYFk7BFUo5tdaM4\nPrjtV41FJh4YxqcpdXh5hdNZMbDLi0Jhk+ETkXBcm8vwviuaoYI0UPjesrFuKx9W\nJsCb0JfShMUonh9vs2fWl4bsGPuhfTALDgiw+zot5QKCAQBUuuYedMFDS6GA0MRO\nF4P5BNDXBtR3dXeJGvksEu7Ci9p870oR9WxVVrNu++JBS2eKjyZyCR08NfL9elF7\nCnPcKaLkhJKcQxB0Tu/GGlvS4iUFzYt6hZFShcNajPB4X74COofB6F6R186gyFRx\nl0lFgDicbnRtC5Z0nAF+eWph57FUnOkGh8VOtMrFDEiM6HUgOB2wPeTjcwOo5tD0\nzyKpwagpVVDIXlySgKzUKaYQf7K8Gj+y93hyHfXswQ9zdTZ7a+SOdaok+TlHAAI3\nfDzb28rHQ9/zThBpfDQek+TomDtBIxzVeiQSMvp+It5/SMS/2kMyGOwsa6H3U/U5\n7+oxAoIBAHjGRs20/TIV5AE2GtxB/GT2EDP9YXCtx7P1CH+cd8mBLLOfDBhI+aMO\nNcSvNOM9qbqJqEx6xZQxGJtemzZqPFxixLWt2HcBXkNGoLGV5zQdtf8utpHm0bIK\n3yDYK8iTS3Ptz0Vu9taC3ILxNJeBo2RlZhwuFnPVtmGxYCTMY90kiCaEkMnkEKmW\naMdZpOTegG8JLGeT53Qu6sg7Dt6Z29NaB6p3VQmEwHOdNkGHg1C1Cui5MLj1ba3W\nC+126wXxynVkeI8/Ao18jYRHB2EnE0sYpEwKdkwZDDnBKeAgjD6iLvB/TBMzXFeW\nxI17YSneurqRLP+BsWvjh2M+dESbweUCggEAZa/lLEmnBOEIdsKnmabfMQ0RwXjH\nr5giCsZcjpN55S3wK1AtBQ4U8tpXpfrXBa1bcd9QFLUZyAyfcVV2LkkyN/miKcq5\nwWLLqKePi2XSNzvj9OQ/Be6Fkcn38oXozjvPwkg6dyEd4MRn+vxnSm9IzybBKEQA\niYRKjYS8X0Cv82G6kXp0CaQe9Y++X4hEMjUcGTtxzHjvBT6wSzcgvVx1P9RwYI/j\nc9AYEkk4zfdlUyZRxls2gtFtAz0WrMJgf31xHoaPU7JsOmMpbUO128oXz7NZ7cqv\nGpmA52iACnsZDIFNDzyFEWFqTHOqym+hSpmi0ajaRryOqNQa7MdzfSqOkw==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.710+0000 7f78a499b640 1 Processor -- start 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.710+0000 7f78a499b640 1 -- start start 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.710+0000 7f78a499b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0105c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.710+0000 7f78a499b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78a0106250 con 0x7f78a0105860 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.711+0000 7f789e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.711+0000 7f789e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0105c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59698/0 (socket says 172.21.15.42:59698) 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.711+0000 7f789e59c640 1 -- 172.21.15.42:0/2867295154 learned_addr learned my addr 172.21.15.42:0/2867295154 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.711+0000 7f789e59c640 1 -- 172.21.15.42:0/2867295154 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a01063d0 con 0x7f78a0105860 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.712+0000 7f789e59c640 1 --2- 172.21.15.42:0/2867295154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0105c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7890009820 tx=0x7f789002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6001aea0a02804 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.712+0000 7f789d59a640 1 -- 172.21.15.42:0/2867295154 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7890037070 con 0x7f78a0105860 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.712+0000 7f789d59a640 1 -- 172.21.15.42:0/2867295154 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f78900328c0 con 0x7f78a0105860 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.712+0000 7f789d59a640 1 -- 172.21.15.42:0/2867295154 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7890030640 con 0x7f78a0105860 2024-09-21T17:41:12.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.712+0000 7f78a499b640 1 -- 172.21.15.42:0/2867295154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 msgr2=0x7f78a0105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.712+0000 7f78a499b640 1 --2- 172.21.15.42:0/2867295154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0105c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7890009820 tx=0x7f789002a270 comp rx=0 tx=0).stop 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.713+0000 7f78a499b640 1 -- 172.21.15.42:0/2867295154 shutdown_connections 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.713+0000 7f78a499b640 1 --2- 172.21.15.42:0/2867295154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0105c60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.713+0000 7f78a499b640 1 -- 172.21.15.42:0/2867295154 >> 172.21.15.42:0/2867295154 conn(0x7f78a01011b0 msgr2=0x7f78a01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.713+0000 7f78a499b640 1 -- 172.21.15.42:0/2867295154 shutdown_connections 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.713+0000 7f78a499b640 1 -- 172.21.15.42:0/2867295154 wait complete. 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.713+0000 7f78a499b640 1 Processor -- start 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.713+0000 7f78a499b640 1 -- start start 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f78a499b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0079fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f78a499b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78a0109ce0 con 0x7f78a0105860 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f789e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0079fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f789e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0079fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59706/0 (socket says 172.21.15.42:59706) 2024-09-21T17:41:12.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f789e59c640 1 -- 172.21.15.42:0/2818593002 learned_addr learned my addr 172.21.15.42:0/2818593002 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f789e59c640 1 -- 172.21.15.42:0/2818593002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a007a4f0 con 0x7f78a0105860 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f789e59c640 1 --2- 172.21.15.42:0/2818593002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0079fb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7890000c00 tx=0x7f7890030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f788f7fe640 1 -- 172.21.15.42:0/2818593002 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7890037040 con 0x7f78a0105860 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f788f7fe640 1 -- 172.21.15.42:0/2818593002 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7890040070 con 0x7f78a0105860 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f78a499b640 1 -- 172.21.15.42:0/2818593002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a019f970 con 0x7f78a0105860 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f788f7fe640 1 -- 172.21.15.42:0/2818593002 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789003a390 con 0x7f78a0105860 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.714+0000 7f78a499b640 1 -- 172.21.15.42:0/2818593002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a019fd10 con 0x7f78a0105860 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.715+0000 7f788f7fe640 1 -- 172.21.15.42:0/2818593002 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 51820+0+0 (secure 0 0 0) 0x7f789003a5c0 con 0x7f78a0105860 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.715+0000 7f78a499b640 1 -- 172.21.15.42:0/2818593002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a0105c60 con 0x7f78a0105860 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.716+0000 7f788f7fe640 1 --2- 172.21.15.42:0/2818593002 >> v2:172.21.15.42:6800/92962027 conn(0x7f788803f910 0x7f7888041dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.716+0000 7f788f7fe640 1 -- 172.21.15.42:0/2818593002 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f78900745c0 con 0x7f78a0105860 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.716+0000 7f789dd9b640 1 --2- 172.21.15.42:0/2818593002 >> v2:172.21.15.42:6800/92962027 conn(0x7f788803f910 0x7f7888041dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.716+0000 7f789dd9b640 1 --2- 172.21.15.42:0/2818593002 >> v2:172.21.15.42:6800/92962027 conn(0x7f788803f910 0x7f7888041dd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f78940098c0 tx=0x7f7894006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.721+0000 7f788f7fe640 1 -- 172.21.15.42:0/2818593002 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f789003a8b0 con 0x7f78a0105860 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:10.933+0000 7f78a499b640 1 -- 172.21.15.42:0/2818593002 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}) -- 0x7f78a0102320 con 0x7f788803f910 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:12.082+0000 7f788f7fe640 1 -- 172.21.15.42:0/2818593002 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5166 (secure 0 0 0) 0x7f78a0102320 con 0x7f788803f910 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:12.085+0000 7f78a499b640 1 -- 172.21.15.42:0/2818593002 >> v2:172.21.15.42:6800/92962027 conn(0x7f788803f910 msgr2=0x7f7888041dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:12.085+0000 7f78a499b640 1 --2- 172.21.15.42:0/2818593002 >> v2:172.21.15.42:6800/92962027 conn(0x7f788803f910 0x7f7888041dd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f78940098c0 tx=0x7f7894006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:12.085+0000 7f78a499b640 1 -- 172.21.15.42:0/2818593002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 msgr2=0x7f78a0079fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:12.085+0000 7f78a499b640 1 --2- 172.21.15.42:0/2818593002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0079fb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7890000c00 tx=0x7f7890030b70 comp rx=0 tx=0).stop 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:12.085+0000 7f78a499b640 1 -- 172.21.15.42:0/2818593002 shutdown_connections 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:12.085+0000 7f78a499b640 1 --2- 172.21.15.42:0/2818593002 >> v2:172.21.15.42:6800/92962027 conn(0x7f788803f910 0x7f7888041dd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:12.085+0000 7f78a499b640 1 --2- 172.21.15.42:0/2818593002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a0105860 0x7f78a0079fb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:12.085+0000 7f78a499b640 1 -- 172.21.15.42:0/2818593002 >> 172.21.15.42:0/2818593002 conn(0x7f78a01011b0 msgr2=0x7f78a0101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:12.085+0000 7f78a499b640 1 -- 172.21.15.42:0/2818593002 shutdown_connections 2024-09-21T17:41:12.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:12.085+0000 7f78a499b640 1 -- 172.21.15.42:0/2818593002 wait complete. 2024-09-21T17:41:13.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.172+0000 7f64fa5a8640 1 Processor -- start 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.172+0000 7f64fa5a8640 1 -- start start 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.173+0000 7f64fa5a8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f4109520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.173+0000 7f64fa5a8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f64f4109a60 con 0x7f64f407a440 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.173+0000 7f64f3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f4109520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.173+0000 7f64f3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f4109520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36496/0 (socket says 172.21.15.42:36496) 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.173+0000 7f64f3fff640 1 -- 172.21.15.42:0/147911913 learned_addr learned my addr 172.21.15.42:0/147911913 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.173+0000 7f64f3fff640 1 -- 172.21.15.42:0/147911913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f4109be0 con 0x7f64f407a440 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.174+0000 7f64f3fff640 1 --2- 172.21.15.42:0/147911913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f4109520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009820 tx=0x7f64e402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b482c09c165e4771 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.174+0000 7f64f2ffd640 1 -- 172.21.15.42:0/147911913 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e4037070 con 0x7f64f407a440 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.174+0000 7f64f2ffd640 1 -- 172.21.15.42:0/147911913 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f64e40328c0 con 0x7f64f407a440 2024-09-21T17:41:13.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.174+0000 7f64f2ffd640 1 -- 172.21.15.42:0/147911913 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e40306d0 con 0x7f64f407a440 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.175+0000 7f64fa5a8640 1 -- 172.21.15.42:0/147911913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 msgr2=0x7f64f4109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.175+0000 7f64fa5a8640 1 --2- 172.21.15.42:0/147911913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f4109520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009820 tx=0x7f64e402a300 comp rx=0 tx=0).stop 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.175+0000 7f64fa5a8640 1 -- 172.21.15.42:0/147911913 shutdown_connections 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.175+0000 7f64fa5a8640 1 --2- 172.21.15.42:0/147911913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f4109520 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.175+0000 7f64fa5a8640 1 -- 172.21.15.42:0/147911913 >> 172.21.15.42:0/147911913 conn(0x7f64f41011b0 msgr2=0x7f64f41035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.175+0000 7f64fa5a8640 1 -- 172.21.15.42:0/147911913 shutdown_connections 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.175+0000 7f64fa5a8640 1 -- 172.21.15.42:0/147911913 wait complete. 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.176+0000 7f64fa5a8640 1 Processor -- start 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.176+0000 7f64fa5a8640 1 -- start start 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.176+0000 7f64fa5a8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f419a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.176+0000 7f64fa5a8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f64f410ace0 con 0x7f64f407a440 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.176+0000 7f64f3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f419a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:13.914 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.176+0000 7f64f3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f419a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36512/0 (socket says 172.21.15.42:36512) 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.176+0000 7f64f3fff640 1 -- 172.21.15.42:0/4033835059 learned_addr learned my addr 172.21.15.42:0/4033835059 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.177+0000 7f64f3fff640 1 -- 172.21.15.42:0/4033835059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f419adb0 con 0x7f64f407a440 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.177+0000 7f64f3fff640 1 --2- 172.21.15.42:0/4033835059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f419a850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f64e4032b90 tx=0x7f64e4032790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.177+0000 7f64f17fa640 1 -- 172.21.15.42:0/4033835059 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e4037040 con 0x7f64f407a440 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.177+0000 7f64f17fa640 1 -- 172.21.15.42:0/4033835059 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f64e4040070 con 0x7f64f407a440 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.177+0000 7f64fa5a8640 1 -- 172.21.15.42:0/4033835059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f419b040 con 0x7f64f407a440 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.177+0000 7f64f17fa640 1 -- 172.21.15.42:0/4033835059 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e403be30 con 0x7f64f407a440 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.177+0000 7f64fa5a8640 1 -- 172.21.15.42:0/4033835059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f419ba00 con 0x7f64f407a440 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.178+0000 7f64f17fa640 1 -- 172.21.15.42:0/4033835059 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 51820+0+0 (secure 0 0 0) 0x7f64e403b430 con 0x7f64f407a440 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.178+0000 7f64fa5a8640 1 -- 172.21.15.42:0/4033835059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f4107510 con 0x7f64f407a440 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.179+0000 7f64f17fa640 1 --2- 172.21.15.42:0/4033835059 >> v2:172.21.15.42:6800/92962027 conn(0x7f64dc03f910 0x7f64dc041dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.179+0000 7f64f17fa640 1 -- 172.21.15.42:0/4033835059 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f64e4074370 con 0x7f64f407a440 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.179+0000 7f64f37fe640 1 --2- 172.21.15.42:0/4033835059 >> v2:172.21.15.42:6800/92962027 conn(0x7f64dc03f910 0x7f64dc041dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:13.915 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.179+0000 7f64f37fe640 1 --2- 172.21.15.42:0/4033835059 >> v2:172.21.15.42:6800/92962027 conn(0x7f64dc03f910 0x7f64dc041dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f64e80098c0 tx=0x7f64e8006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.183+0000 7f64f17fa640 1 -- 172.21.15.42:0/4033835059 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f64e4043360 con 0x7f64f407a440 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.386+0000 7f64fa5a8640 1 -- 172.21.15.42:0/4033835059 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}) -- 0x7f64f41022f0 con 0x7f64dc03f910 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.389+0000 7f64f17fa640 1 -- 172.21.15.42:0/4033835059 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f64f41022f0 con 0x7f64dc03f910 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.391+0000 7f64fa5a8640 1 -- 172.21.15.42:0/4033835059 >> v2:172.21.15.42:6800/92962027 conn(0x7f64dc03f910 msgr2=0x7f64dc041dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.391+0000 7f64fa5a8640 1 --2- 172.21.15.42:0/4033835059 >> v2:172.21.15.42:6800/92962027 conn(0x7f64dc03f910 0x7f64dc041dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f64e80098c0 tx=0x7f64e8006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.391+0000 7f64fa5a8640 1 -- 172.21.15.42:0/4033835059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 msgr2=0x7f64f419a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.391+0000 7f64fa5a8640 1 --2- 172.21.15.42:0/4033835059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f419a850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f64e4032b90 tx=0x7f64e4032790 comp rx=0 tx=0).stop 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.391+0000 7f64fa5a8640 1 -- 172.21.15.42:0/4033835059 shutdown_connections 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.391+0000 7f64fa5a8640 1 --2- 172.21.15.42:0/4033835059 >> v2:172.21.15.42:6800/92962027 conn(0x7f64dc03f910 0x7f64dc041dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.391+0000 7f64fa5a8640 1 --2- 172.21.15.42:0/4033835059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64f407a440 0x7f64f419a850 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.391+0000 7f64fa5a8640 1 -- 172.21.15.42:0/4033835059 >> 172.21.15.42:0/4033835059 conn(0x7f64f41011b0 msgr2=0x7f64f4101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.391+0000 7f64fa5a8640 1 -- 172.21.15.42:0/4033835059 shutdown_connections 2024-09-21T17:41:13.916 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:13.391+0000 7f64fa5a8640 1 -- 172.21.15.42:0/4033835059 wait complete. 2024-09-21T17:41:14.584 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:14 smithi042 ceph-mon[29361]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:14.584 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:14 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:15.128 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T17:41:15.128 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.365+0000 7f2370e41640 1 Processor -- start 2024-09-21T17:41:15.128 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.365+0000 7f2370e41640 1 -- start start 2024-09-21T17:41:15.128 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.365+0000 7f2370e41640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.365+0000 7f2370e41640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f236c107350 con 0x7f236c106960 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.365+0000 7f236a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.365+0000 7f236a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36518/0 (socket says 172.21.15.42:36518) 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.365+0000 7f236a59c640 1 -- 172.21.15.42:0/2804527669 learned_addr learned my addr 172.21.15.42:0/2804527669 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.365+0000 7f236a59c640 1 -- 172.21.15.42:0/2804527669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c1074d0 con 0x7f236c106960 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.366+0000 7f236a59c640 1 --2- 172.21.15.42:0/2804527669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c106d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f235c009820 tx=0x7f235c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e02d17a1e03a3f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.366+0000 7f236959a640 1 -- 172.21.15.42:0/2804527669 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f235c037070 con 0x7f236c106960 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.366+0000 7f236959a640 1 -- 172.21.15.42:0/2804527669 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f235c0328c0 con 0x7f236c106960 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.366+0000 7f236959a640 1 -- 172.21.15.42:0/2804527669 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f235c030640 con 0x7f236c106960 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.367+0000 7f2370e41640 1 -- 172.21.15.42:0/2804527669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 msgr2=0x7f236c106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.367+0000 7f2370e41640 1 --2- 172.21.15.42:0/2804527669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c106d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f235c009820 tx=0x7f235c02a270 comp rx=0 tx=0).stop 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.367+0000 7f2370e41640 1 -- 172.21.15.42:0/2804527669 shutdown_connections 2024-09-21T17:41:15.129 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.367+0000 7f2370e41640 1 --2- 172.21.15.42:0/2804527669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c106d60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.367+0000 7f2370e41640 1 -- 172.21.15.42:0/2804527669 >> 172.21.15.42:0/2804527669 conn(0x7f236c102250 msgr2=0x7f236c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.367+0000 7f2370e41640 1 -- 172.21.15.42:0/2804527669 shutdown_connections 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.367+0000 7f2370e41640 1 -- 172.21.15.42:0/2804527669 wait complete. 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.368+0000 7f2370e41640 1 Processor -- start 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.368+0000 7f2370e41640 1 -- start start 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.368+0000 7f2370e41640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.368+0000 7f2370e41640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f236c10ade0 con 0x7f236c106960 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.368+0000 7f236a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.368+0000 7f236a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c19a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36526/0 (socket says 172.21.15.42:36526) 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.368+0000 7f236a59c640 1 -- 172.21.15.42:0/2358578120 learned_addr learned my addr 172.21.15.42:0/2358578120 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.369+0000 7f236a59c640 1 -- 172.21.15.42:0/2358578120 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c19ada0 con 0x7f236c106960 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.369+0000 7f236a59c640 1 --2- 172.21.15.42:0/2358578120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c19a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f235c000c00 tx=0x7f235c030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:15.130 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.369+0000 7f23637fe640 1 -- 172.21.15.42:0/2358578120 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f235c037040 con 0x7f236c106960 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.369+0000 7f23637fe640 1 -- 172.21.15.42:0/2358578120 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f235c040070 con 0x7f236c106960 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.369+0000 7f2370e41640 1 -- 172.21.15.42:0/2358578120 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c19b030 con 0x7f236c106960 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.369+0000 7f23637fe640 1 -- 172.21.15.42:0/2358578120 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f235c03a390 con 0x7f236c106960 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.369+0000 7f2370e41640 1 -- 172.21.15.42:0/2358578120 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c19b9f0 con 0x7f236c106960 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.370+0000 7f23637fe640 1 -- 172.21.15.42:0/2358578120 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 51820+0+0 (secure 0 0 0) 0x7f235c03b430 con 0x7f236c106960 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.370+0000 7f2370e41640 1 -- 172.21.15.42:0/2358578120 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236c106d60 con 0x7f236c106960 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.370+0000 7f23637fe640 1 --2- 172.21.15.42:0/2358578120 >> v2:172.21.15.42:6800/92962027 conn(0x7f235803f8c0 0x7f2358041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.371+0000 7f23637fe640 1 -- 172.21.15.42:0/2358578120 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f235c074500 con 0x7f236c106960 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.371+0000 7f2369d9b640 1 --2- 172.21.15.42:0/2358578120 >> v2:172.21.15.42:6800/92962027 conn(0x7f235803f8c0 0x7f2358041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.371+0000 7f2369d9b640 1 --2- 172.21.15.42:0/2358578120 >> v2:172.21.15.42:6800/92962027 conn(0x7f235803f8c0 0x7f2358041d80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f23540098c0 tx=0x7f2354006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.375+0000 7f23637fe640 1 -- 172.21.15.42:0/2358578120 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f235c043360 con 0x7f236c106960 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.581+0000 7f2370e41640 1 -- 172.21.15.42:0/2358578120 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}) -- 0x7f236c1033a0 con 0x7f235803f8c0 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.585+0000 7f23637fe640 1 -- 172.21.15.42:0/2358578120 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f236c1033a0 con 0x7f235803f8c0 2024-09-21T17:41:15.131 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.587+0000 7f2370e41640 1 -- 172.21.15.42:0/2358578120 >> v2:172.21.15.42:6800/92962027 conn(0x7f235803f8c0 msgr2=0x7f2358041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:15.132 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.587+0000 7f2370e41640 1 --2- 172.21.15.42:0/2358578120 >> v2:172.21.15.42:6800/92962027 conn(0x7f235803f8c0 0x7f2358041d80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f23540098c0 tx=0x7f2354006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:15.132 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.587+0000 7f2370e41640 1 -- 172.21.15.42:0/2358578120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 msgr2=0x7f236c19a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:15.132 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.587+0000 7f2370e41640 1 --2- 172.21.15.42:0/2358578120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c19a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f235c000c00 tx=0x7f235c030b70 comp rx=0 tx=0).stop 2024-09-21T17:41:15.132 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.587+0000 7f2370e41640 1 -- 172.21.15.42:0/2358578120 shutdown_connections 2024-09-21T17:41:15.132 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.587+0000 7f2370e41640 1 --2- 172.21.15.42:0/2358578120 >> v2:172.21.15.42:6800/92962027 conn(0x7f235803f8c0 0x7f2358041d80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:15.132 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.587+0000 7f2370e41640 1 --2- 172.21.15.42:0/2358578120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c106960 0x7f236c19a840 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:15.132 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.587+0000 7f2370e41640 1 -- 172.21.15.42:0/2358578120 >> 172.21.15.42:0/2358578120 conn(0x7f236c102250 msgr2=0x7f236c102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:15.132 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.587+0000 7f2370e41640 1 -- 172.21.15.42:0/2358578120 shutdown_connections 2024-09-21T17:41:15.132 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:14.587+0000 7f2370e41640 1 -- 172.21.15.42:0/2358578120 wait complete. 2024-09-21T17:41:15.132 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial admin user... 2024-09-21T17:41:15.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:15 smithi042 ceph-mon[29361]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:15.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:16.611 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:16 smithi042 ceph-mon[29361]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:16.611 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:16.618 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$aq9BFV1PSPK9eAUlqIVHPebgXsx64w7aObwwCawfYXXDGi0bapqx.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726940476, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.539+0000 7fc19d07d640 1 Processor -- start 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.539+0000 7fc19d07d640 1 -- start start 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.539+0000 7fc19d07d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc198106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.539+0000 7fc19d07d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc198107350 con 0x7fc198106960 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.539+0000 7fc196d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc198106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.539+0000 7fc196d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc198106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36534/0 (socket says 172.21.15.42:36534) 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.539+0000 7fc196d9d640 1 -- 172.21.15.42:0/105594224 learned_addr learned my addr 172.21.15.42:0/105594224 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.540+0000 7fc196d9d640 1 -- 172.21.15.42:0/105594224 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1981074d0 con 0x7fc198106960 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.540+0000 7fc196d9d640 1 --2- 172.21.15.42:0/105594224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc198106d60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc188009820 tx=0x7fc18802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabe2682a8afac25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.541+0000 7fc195d9b640 1 -- 172.21.15.42:0/105594224 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc188037070 con 0x7fc198106960 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.541+0000 7fc195d9b640 1 -- 172.21.15.42:0/105594224 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fc1880328c0 con 0x7fc198106960 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.541+0000 7fc195d9b640 1 -- 172.21.15.42:0/105594224 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc188030640 con 0x7fc198106960 2024-09-21T17:41:16.619 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.541+0000 7fc19d07d640 1 -- 172.21.15.42:0/105594224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 msgr2=0x7fc198106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.541+0000 7fc19d07d640 1 --2- 172.21.15.42:0/105594224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc198106d60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc188009820 tx=0x7fc18802a270 comp rx=0 tx=0).stop 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.541+0000 7fc19d07d640 1 -- 172.21.15.42:0/105594224 shutdown_connections 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.541+0000 7fc19d07d640 1 --2- 172.21.15.42:0/105594224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc198106d60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.541+0000 7fc19d07d640 1 -- 172.21.15.42:0/105594224 >> 172.21.15.42:0/105594224 conn(0x7fc198102250 msgr2=0x7fc198104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.541+0000 7fc19d07d640 1 -- 172.21.15.42:0/105594224 shutdown_connections 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.541+0000 7fc19d07d640 1 -- 172.21.15.42:0/105594224 wait complete. 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.542+0000 7fc19d07d640 1 Processor -- start 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.542+0000 7fc19d07d640 1 -- start start 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.543+0000 7fc19d07d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc19807c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.543+0000 7fc19d07d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc19810ade0 con 0x7fc198106960 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.543+0000 7fc196d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc19807c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.543+0000 7fc196d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc19807c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36542/0 (socket says 172.21.15.42:36542) 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.543+0000 7fc196d9d640 1 -- 172.21.15.42:0/196282786 learned_addr learned my addr 172.21.15.42:0/196282786 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:16.620 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.543+0000 7fc196d9d640 1 -- 172.21.15.42:0/196282786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19807cef0 con 0x7fc198106960 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.543+0000 7fc196d9d640 1 --2- 172.21.15.42:0/196282786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc19807c990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc188000c00 tx=0x7fc188030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.543+0000 7fc17ffff640 1 -- 172.21.15.42:0/196282786 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc188037040 con 0x7fc198106960 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.544+0000 7fc17ffff640 1 -- 172.21.15.42:0/196282786 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fc188040070 con 0x7fc198106960 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.544+0000 7fc19d07d640 1 -- 172.21.15.42:0/196282786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19807b2e0 con 0x7fc198106960 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.544+0000 7fc17ffff640 1 -- 172.21.15.42:0/196282786 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18803a390 con 0x7fc198106960 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.544+0000 7fc19d07d640 1 -- 172.21.15.42:0/196282786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19807b860 con 0x7fc198106960 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.545+0000 7fc17ffff640 1 -- 172.21.15.42:0/196282786 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 51820+0+0 (secure 0 0 0) 0x7fc18803a610 con 0x7fc198106960 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.545+0000 7fc19d07d640 1 -- 172.21.15.42:0/196282786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc198106d60 con 0x7fc198106960 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.545+0000 7fc17ffff640 1 --2- 172.21.15.42:0/196282786 >> v2:172.21.15.42:6800/92962027 conn(0x7fc18003f8c0 0x7fc180041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.545+0000 7fc17ffff640 1 -- 172.21.15.42:0/196282786 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fc1880745e0 con 0x7fc198106960 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.545+0000 7fc19659c640 1 --2- 172.21.15.42:0/196282786 >> v2:172.21.15.42:6800/92962027 conn(0x7fc18003f8c0 0x7fc180041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.546+0000 7fc19659c640 1 --2- 172.21.15.42:0/196282786 >> v2:172.21.15.42:6800/92962027 conn(0x7fc18003f8c0 0x7fc180041d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0098c0 tx=0x7fc18c006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.550+0000 7fc17ffff640 1 -- 172.21.15.42:0/196282786 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fc1880313a0 con 0x7fc198106960 2024-09-21T17:41:16.621 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:15.756+0000 7fc19d07d640 1 -- 172.21.15.42:0/196282786 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fc19807bd90 con 0x7fc18003f8c0 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.005+0000 7fc17ffff640 1 -- 172.21.15.42:0/196282786 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fc19807bd90 con 0x7fc18003f8c0 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.007+0000 7fc19d07d640 1 -- 172.21.15.42:0/196282786 >> v2:172.21.15.42:6800/92962027 conn(0x7fc18003f8c0 msgr2=0x7fc180041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.007+0000 7fc19d07d640 1 --2- 172.21.15.42:0/196282786 >> v2:172.21.15.42:6800/92962027 conn(0x7fc18003f8c0 0x7fc180041d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0098c0 tx=0x7fc18c006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.007+0000 7fc19d07d640 1 -- 172.21.15.42:0/196282786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 msgr2=0x7fc19807c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.007+0000 7fc19d07d640 1 --2- 172.21.15.42:0/196282786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc19807c990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc188000c00 tx=0x7fc188030b70 comp rx=0 tx=0).stop 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.008+0000 7fc19d07d640 1 -- 172.21.15.42:0/196282786 shutdown_connections 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.008+0000 7fc19d07d640 1 --2- 172.21.15.42:0/196282786 >> v2:172.21.15.42:6800/92962027 conn(0x7fc18003f8c0 0x7fc180041d80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.008+0000 7fc19d07d640 1 --2- 172.21.15.42:0/196282786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc198106960 0x7fc19807c990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.008+0000 7fc19d07d640 1 -- 172.21.15.42:0/196282786 >> 172.21.15.42:0/196282786 conn(0x7fc198102250 msgr2=0x7fc198102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.008+0000 7fc19d07d640 1 -- 172.21.15.42:0/196282786 shutdown_connections 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.008+0000 7fc19d07d640 1 -- 172.21.15.42:0/196282786 wait complete. 2024-09-21T17:41:16.622 INFO:teuthology.orchestra.run.smithi042.stdout:Fetching dashboard port number... 2024-09-21T17:41:17.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T17:41:17.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.973+0000 7fec37d4c640 1 Processor -- start 2024-09-21T17:41:17.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.973+0000 7fec37d4c640 1 -- start start 2024-09-21T17:41:17.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.973+0000 7fec37d4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec30106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.973+0000 7fec37d4c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fec30107350 con 0x7fec30106960 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.973+0000 7fec35ae8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec30106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.973+0000 7fec35ae8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec30106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36556/0 (socket says 172.21.15.42:36556) 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.973+0000 7fec35ae8640 1 -- 172.21.15.42:0/3625467938 learned_addr learned my addr 172.21.15.42:0/3625467938 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.973+0000 7fec35ae8640 1 -- 172.21.15.42:0/3625467938 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec301074d0 con 0x7fec30106960 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.974+0000 7fec35ae8640 1 --2- 172.21.15.42:0/3625467938 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec30106d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009820 tx=0x7fec2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547400d7c5f823aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.974+0000 7fec34ae6640 1 -- 172.21.15.42:0/3625467938 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec2c037070 con 0x7fec30106960 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.974+0000 7fec34ae6640 1 -- 172.21.15.42:0/3625467938 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fec2c0328c0 con 0x7fec30106960 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.974+0000 7fec34ae6640 1 -- 172.21.15.42:0/3625467938 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec2c030640 con 0x7fec30106960 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.975+0000 7fec37d4c640 1 -- 172.21.15.42:0/3625467938 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 msgr2=0x7fec30106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.975+0000 7fec37d4c640 1 --2- 172.21.15.42:0/3625467938 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec30106d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009820 tx=0x7fec2c02a270 comp rx=0 tx=0).stop 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.975+0000 7fec37d4c640 1 -- 172.21.15.42:0/3625467938 shutdown_connections 2024-09-21T17:41:17.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.975+0000 7fec37d4c640 1 --2- 172.21.15.42:0/3625467938 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec30106d60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.975+0000 7fec37d4c640 1 -- 172.21.15.42:0/3625467938 >> 172.21.15.42:0/3625467938 conn(0x7fec30102250 msgr2=0x7fec30104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.975+0000 7fec37d4c640 1 -- 172.21.15.42:0/3625467938 shutdown_connections 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.975+0000 7fec37d4c640 1 -- 172.21.15.42:0/3625467938 wait complete. 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.976+0000 7fec37d4c640 1 Processor -- start 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.976+0000 7fec37d4c640 1 -- start start 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.976+0000 7fec37d4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec3007c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.976+0000 7fec37d4c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fec3010ade0 con 0x7fec30106960 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.976+0000 7fec35ae8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec3007c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.976+0000 7fec35ae8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec3007c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36564/0 (socket says 172.21.15.42:36564) 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.976+0000 7fec35ae8640 1 -- 172.21.15.42:0/2289588904 learned_addr learned my addr 172.21.15.42:0/2289588904 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.976+0000 7fec35ae8640 1 -- 172.21.15.42:0/2289588904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3007cef0 con 0x7fec30106960 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.977+0000 7fec35ae8640 1 --2- 172.21.15.42:0/2289588904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec3007c990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fec2c02a830 tx=0x7fec2c030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.977+0000 7fec22ffd640 1 -- 172.21.15.42:0/2289588904 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec2c037040 con 0x7fec30106960 2024-09-21T17:41:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.977+0000 7fec22ffd640 1 -- 172.21.15.42:0/2289588904 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fec2c040070 con 0x7fec30106960 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.977+0000 7fec37d4c640 1 -- 172.21.15.42:0/2289588904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec3007b2e0 con 0x7fec30106960 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.977+0000 7fec22ffd640 1 -- 172.21.15.42:0/2289588904 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec2c03be40 con 0x7fec30106960 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.977+0000 7fec37d4c640 1 -- 172.21.15.42:0/2289588904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec3007b860 con 0x7fec30106960 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.978+0000 7fec22ffd640 1 -- 172.21.15.42:0/2289588904 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 51820+0+0 (secure 0 0 0) 0x7fec2c03b430 con 0x7fec30106960 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.978+0000 7fec37d4c640 1 -- 172.21.15.42:0/2289588904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec30106d60 con 0x7fec30106960 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.978+0000 7fec22ffd640 1 --2- 172.21.15.42:0/2289588904 >> v2:172.21.15.42:6800/92962027 conn(0x7fec1c03f910 0x7fec1c041dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.978+0000 7fec22ffd640 1 -- 172.21.15.42:0/2289588904 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fec2c074480 con 0x7fec30106960 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.978+0000 7fec352e7640 1 --2- 172.21.15.42:0/2289588904 >> v2:172.21.15.42:6800/92962027 conn(0x7fec1c03f910 0x7fec1c041dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.979+0000 7fec352e7640 1 --2- 172.21.15.42:0/2289588904 >> v2:172.21.15.42:6800/92962027 conn(0x7fec1c03f910 0x7fec1c041dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec240098c0 tx=0x7fec24006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:16.983+0000 7fec22ffd640 1 -- 172.21.15.42:0/2289588904 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fec2c043360 con 0x7fec30106960 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.172+0000 7fec37d4c640 1 -- 172.21.15.42:0/2289588904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fec3007bd90 con 0x7fec30106960 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.173+0000 7fec22ffd640 1 -- 172.21.15.42:0/2289588904 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fec2c0328c0 con 0x7fec30106960 2024-09-21T17:41:17.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.175+0000 7fec37d4c640 1 -- 172.21.15.42:0/2289588904 >> v2:172.21.15.42:6800/92962027 conn(0x7fec1c03f910 msgr2=0x7fec1c041dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:17.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.175+0000 7fec37d4c640 1 --2- 172.21.15.42:0/2289588904 >> v2:172.21.15.42:6800/92962027 conn(0x7fec1c03f910 0x7fec1c041dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec240098c0 tx=0x7fec24006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:17.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.175+0000 7fec37d4c640 1 -- 172.21.15.42:0/2289588904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 msgr2=0x7fec3007c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:17.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.175+0000 7fec37d4c640 1 --2- 172.21.15.42:0/2289588904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec3007c990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fec2c02a830 tx=0x7fec2c030bc0 comp rx=0 tx=0).stop 2024-09-21T17:41:17.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.175+0000 7fec37d4c640 1 -- 172.21.15.42:0/2289588904 shutdown_connections 2024-09-21T17:41:17.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.175+0000 7fec37d4c640 1 --2- 172.21.15.42:0/2289588904 >> v2:172.21.15.42:6800/92962027 conn(0x7fec1c03f910 0x7fec1c041dd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:17.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.175+0000 7fec37d4c640 1 --2- 172.21.15.42:0/2289588904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec30106960 0x7fec3007c990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:17.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.175+0000 7fec37d4c640 1 -- 172.21.15.42:0/2289588904 >> 172.21.15.42:0/2289588904 conn(0x7fec30102250 msgr2=0x7fec30102c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:17.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.175+0000 7fec37d4c640 1 -- 172.21.15.42:0/2289588904 shutdown_connections 2024-09-21T17:41:17.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:17.175+0000 7fec37d4c640 1 -- 172.21.15.42:0/2289588904 wait complete. 2024-09-21T17:41:17.699 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T17:41:17.699 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-21T17:41:17.707 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T17:41:17.707 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-21T17:41:17.707 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-21T17:41:17.707 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T17:41:17.708 INFO:teuthology.orchestra.run.smithi042.stdout:Ceph Dashboard is now available at: 2024-09-21T17:41:17.708 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:41:17.709 INFO:teuthology.orchestra.run.smithi042.stdout: URL: https://smithi042.front.sepia.ceph.com:8443/ 2024-09-21T17:41:17.709 INFO:teuthology.orchestra.run.smithi042.stdout: User: admin 2024-09-21T17:41:17.709 INFO:teuthology.orchestra.run.smithi042.stdout: Password: 7gpidmq542 2024-09-21T17:41:17.709 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:41:17.709 INFO:teuthology.orchestra.run.smithi042.stdout:Saving cluster configuration to /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config directory 2024-09-21T17:41:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2289588904' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T17:41:18.965 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.109+0000 7fa45edd5640 1 Processor -- start 2024-09-21T17:41:19.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.110+0000 7fa45edd5640 1 -- start start 2024-09-21T17:41:19.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.110+0000 7fa45edd5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa458106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:19.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.110+0000 7fa45edd5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa458107350 con 0x7fa458106960 2024-09-21T17:41:19.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.110+0000 7fa45cb71640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa458106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:19.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.110+0000 7fa45cb71640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa458106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36578/0 (socket says 172.21.15.42:36578) 2024-09-21T17:41:19.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.110+0000 7fa45cb71640 1 -- 172.21.15.42:0/2405102582 learned_addr learned my addr 172.21.15.42:0/2405102582 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:19.016 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.110+0000 7fa45cb71640 1 -- 172.21.15.42:0/2405102582 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4581074d0 con 0x7fa458106960 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.111+0000 7fa45cb71640 1 --2- 172.21.15.42:0/2405102582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa458106d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009820 tx=0x7fa44c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42eca8ebf2daa1d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.111+0000 7fa4577fe640 1 -- 172.21.15.42:0/2405102582 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa44c037070 con 0x7fa458106960 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.111+0000 7fa4577fe640 1 -- 172.21.15.42:0/2405102582 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fa44c0328c0 con 0x7fa458106960 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.111+0000 7fa4577fe640 1 -- 172.21.15.42:0/2405102582 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa44c030640 con 0x7fa458106960 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.112+0000 7fa45edd5640 1 -- 172.21.15.42:0/2405102582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 msgr2=0x7fa458106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.112+0000 7fa45edd5640 1 --2- 172.21.15.42:0/2405102582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa458106d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009820 tx=0x7fa44c02a270 comp rx=0 tx=0).stop 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.112+0000 7fa45edd5640 1 -- 172.21.15.42:0/2405102582 shutdown_connections 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.112+0000 7fa45edd5640 1 --2- 172.21.15.42:0/2405102582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa458106d60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.112+0000 7fa45edd5640 1 -- 172.21.15.42:0/2405102582 >> 172.21.15.42:0/2405102582 conn(0x7fa458102250 msgr2=0x7fa458104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.112+0000 7fa45edd5640 1 -- 172.21.15.42:0/2405102582 shutdown_connections 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.112+0000 7fa45edd5640 1 -- 172.21.15.42:0/2405102582 wait complete. 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.112+0000 7fa45edd5640 1 Processor -- start 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.112+0000 7fa45edd5640 1 -- start start 2024-09-21T17:41:19.017 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.113+0000 7fa45edd5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa45819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:19.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.113+0000 7fa45edd5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa45810ade0 con 0x7fa458106960 2024-09-21T17:41:19.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.113+0000 7fa45cb71640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa45819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:19.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.113+0000 7fa45cb71640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa45819a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36590/0 (socket says 172.21.15.42:36590) 2024-09-21T17:41:19.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.113+0000 7fa45cb71640 1 -- 172.21.15.42:0/632500871 learned_addr learned my addr 172.21.15.42:0/632500871 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:19.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.113+0000 7fa45cb71640 1 -- 172.21.15.42:0/632500871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45819ad90 con 0x7fa458106960 2024-09-21T17:41:19.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.113+0000 7fa45cb71640 1 --2- 172.21.15.42:0/632500871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa45819a830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa44c000c00 tx=0x7fa44c030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:19.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.113+0000 7fa455ffb640 1 -- 172.21.15.42:0/632500871 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa44c037040 con 0x7fa458106960 2024-09-21T17:41:19.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.113+0000 7fa455ffb640 1 -- 172.21.15.42:0/632500871 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fa44c040070 con 0x7fa458106960 2024-09-21T17:41:19.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.113+0000 7fa45edd5640 1 -- 172.21.15.42:0/632500871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45819b020 con 0x7fa458106960 2024-09-21T17:41:19.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.113+0000 7fa455ffb640 1 -- 172.21.15.42:0/632500871 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa44c03a390 con 0x7fa458106960 2024-09-21T17:41:19.018 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.114+0000 7fa45edd5640 1 -- 172.21.15.42:0/632500871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa45819b9e0 con 0x7fa458106960 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.115+0000 7fa45edd5640 1 -- 172.21.15.42:0/632500871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa458106d60 con 0x7fa458106960 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.115+0000 7fa455ffb640 1 -- 172.21.15.42:0/632500871 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 51820+0+0 (secure 0 0 0) 0x7fa44c03b430 con 0x7fa458106960 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.115+0000 7fa455ffb640 1 --2- 172.21.15.42:0/632500871 >> v2:172.21.15.42:6800/92962027 conn(0x7fa44803f910 0x7fa448041dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.115+0000 7fa455ffb640 1 -- 172.21.15.42:0/632500871 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fa44c0744e0 con 0x7fa458106960 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.115+0000 7fa457fff640 1 --2- 172.21.15.42:0/632500871 >> v2:172.21.15.42:6800/92962027 conn(0x7fa44803f910 0x7fa448041dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.115+0000 7fa457fff640 1 --2- 172.21.15.42:0/632500871 >> v2:172.21.15.42:6800/92962027 conn(0x7fa44803f910 0x7fa448041dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa4440098c0 tx=0x7fa444006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.119+0000 7fa455ffb640 1 -- 172.21.15.42:0/632500871 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fa44c043360 con 0x7fa458106960 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.403+0000 7fa45edd5640 1 -- 172.21.15.42:0/632500871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fa45819c1e0 con 0x7fa458106960 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.406+0000 7fa455ffb640 1 -- 172.21.15.42:0/632500871 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fa44c031e10 con 0x7fa458106960 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.408+0000 7fa45edd5640 1 -- 172.21.15.42:0/632500871 >> v2:172.21.15.42:6800/92962027 conn(0x7fa44803f910 msgr2=0x7fa448041dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.408+0000 7fa45edd5640 1 --2- 172.21.15.42:0/632500871 >> v2:172.21.15.42:6800/92962027 conn(0x7fa44803f910 0x7fa448041dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa4440098c0 tx=0x7fa444006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:19.019 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.408+0000 7fa45edd5640 1 -- 172.21.15.42:0/632500871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 msgr2=0x7fa45819a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.408+0000 7fa45edd5640 1 --2- 172.21.15.42:0/632500871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa45819a830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa44c000c00 tx=0x7fa44c030b70 comp rx=0 tx=0).stop 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.408+0000 7fa45edd5640 1 -- 172.21.15.42:0/632500871 shutdown_connections 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.408+0000 7fa45edd5640 1 --2- 172.21.15.42:0/632500871 >> v2:172.21.15.42:6800/92962027 conn(0x7fa44803f910 0x7fa448041dd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.408+0000 7fa45edd5640 1 --2- 172.21.15.42:0/632500871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa458106960 0x7fa45819a830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.408+0000 7fa45edd5640 1 -- 172.21.15.42:0/632500871 >> 172.21.15.42:0/632500871 conn(0x7fa458102250 msgr2=0x7fa458102c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.408+0000 7fa45edd5640 1 -- 172.21.15.42:0/632500871 shutdown_connections 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-21T17:41:18.408+0000 7fa45edd5640 1 -- 172.21.15.42:0/632500871 wait complete. 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout: sudo /sbin/cephadm shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout: sudo /sbin/cephadm shell 2024-09-21T17:41:19.020 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:41:19.021 INFO:teuthology.orchestra.run.smithi042.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T17:41:19.021 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:41:19.021 INFO:teuthology.orchestra.run.smithi042.stdout: ceph telemetry on 2024-09-21T17:41:19.021 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:41:19.021 INFO:teuthology.orchestra.run.smithi042.stdout:For more information see: 2024-09-21T17:41:19.021 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:41:19.021 INFO:teuthology.orchestra.run.smithi042.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T17:41:19.021 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:41:19.021 INFO:teuthology.orchestra.run.smithi042.stdout:Bootstrap complete. 2024-09-21T17:41:19.022 INFO:tasks.cephadm:Fetching config... 2024-09-21T17:41:19.022 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:41:19.023 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T17:41:19.039 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T17:41:19.039 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:41:19.039 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T17:41:19.096 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T17:41:19.096 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:41:19.096 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T17:41:19.163 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T17:41:19.163 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:41:19.164 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T17:41:19.220 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T17:41:19.220 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfqBKM7Vo1QRQAN0zmQ0OZgzouR3vA1iJ0XUJwqaVlv5R7C/b5EpCvm+kWjs4p0Xw7eagF2GwbiQUoMiKNm939CCZXlWIeECfQMkkIIBGt0sShCzVwZLuysV7WhRnY1pIvzUQrnkPdNiAr3OlD+8Y7hmj6kNHfZB+Ao/0+eq1n+AVGwK7hsV0NHDH7WwLYZqZIta/WTRy38XIHZNFwSl5RKH40TbUv/qRQksnZXONfsNkk+aO/u5/6c4MgN2aF5Xf8B2a/MBAeeGx2iN6uvy9JqJfAQ0303lLAwrNkwUvPyQzuru3PqlGCeRSVxC97o6FMYz8AMNMeIIK/XfjzYiYmhnQaiovVRX+9Mv3nZ92eWU310j6Oc2nblxtqfaLgQAHhGmvaQhDQs9v55RJOaeinqJjEWzCZdOMhRQ2CYQPjcwCAszuhIw06jAQ9/CM3ufKQOiTAVv6ZEet4trclXTE7Qxb0SJuo2Jhyj8MlHxjw89KV3dJChZOfPeqyvU3PE6E= ceph-6e3cf65a-7840-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T17:41:19.296 INFO:teuthology.orchestra.run.smithi042.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfqBKM7Vo1QRQAN0zmQ0OZgzouR3vA1iJ0XUJwqaVlv5R7C/b5EpCvm+kWjs4p0Xw7eagF2GwbiQUoMiKNm939CCZXlWIeECfQMkkIIBGt0sShCzVwZLuysV7WhRnY1pIvzUQrnkPdNiAr3OlD+8Y7hmj6kNHfZB+Ao/0+eq1n+AVGwK7hsV0NHDH7WwLYZqZIta/WTRy38XIHZNFwSl5RKH40TbUv/qRQksnZXONfsNkk+aO/u5/6c4MgN2aF5Xf8B2a/MBAeeGx2iN6uvy9JqJfAQ0303lLAwrNkwUvPyQzuru3PqlGCeRSVxC97o6FMYz8AMNMeIIK/XfjzYiYmhnQaiovVRX+9Mv3nZ92eWU310j6Oc2nblxtqfaLgQAHhGmvaQhDQs9v55RJOaeinqJjEWzCZdOMhRQ2CYQPjcwCAszuhIw06jAQ9/CM3ufKQOiTAVv6ZEet4trclXTE7Qxb0SJuo2Jhyj8MlHxjw89KV3dJChZOfPeqyvU3PE6E= ceph-6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:19.322 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfqBKM7Vo1QRQAN0zmQ0OZgzouR3vA1iJ0XUJwqaVlv5R7C/b5EpCvm+kWjs4p0Xw7eagF2GwbiQUoMiKNm939CCZXlWIeECfQMkkIIBGt0sShCzVwZLuysV7WhRnY1pIvzUQrnkPdNiAr3OlD+8Y7hmj6kNHfZB+Ao/0+eq1n+AVGwK7hsV0NHDH7WwLYZqZIta/WTRy38XIHZNFwSl5RKH40TbUv/qRQksnZXONfsNkk+aO/u5/6c4MgN2aF5Xf8B2a/MBAeeGx2iN6uvy9JqJfAQ0303lLAwrNkwUvPyQzuru3PqlGCeRSVxC97o6FMYz8AMNMeIIK/XfjzYiYmhnQaiovVRX+9Mv3nZ92eWU310j6Oc2nblxtqfaLgQAHhGmvaQhDQs9v55RJOaeinqJjEWzCZdOMhRQ2CYQPjcwCAszuhIw06jAQ9/CM3ufKQOiTAVv6ZEet4trclXTE7Qxb0SJuo2Jhyj8MlHxjw89KV3dJChZOfPeqyvU3PE6E= ceph-6e3cf65a-7840-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T17:41:19.440 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfqBKM7Vo1QRQAN0zmQ0OZgzouR3vA1iJ0XUJwqaVlv5R7C/b5EpCvm+kWjs4p0Xw7eagF2GwbiQUoMiKNm939CCZXlWIeECfQMkkIIBGt0sShCzVwZLuysV7WhRnY1pIvzUQrnkPdNiAr3OlD+8Y7hmj6kNHfZB+Ao/0+eq1n+AVGwK7hsV0NHDH7WwLYZqZIta/WTRy38XIHZNFwSl5RKH40TbUv/qRQksnZXONfsNkk+aO/u5/6c4MgN2aF5Xf8B2a/MBAeeGx2iN6uvy9JqJfAQ0303lLAwrNkwUvPyQzuru3PqlGCeRSVxC97o6FMYz8AMNMeIIK/XfjzYiYmhnQaiovVRX+9Mv3nZ92eWU310j6Oc2nblxtqfaLgQAHhGmvaQhDQs9v55RJOaeinqJjEWzCZdOMhRQ2CYQPjcwCAszuhIw06jAQ9/CM3ufKQOiTAVv6ZEet4trclXTE7Qxb0SJuo2Jhyj8MlHxjw89KV3dJChZOfPeqyvU3PE6E= ceph-6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:19.453 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T17:41:19.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/632500871' entity='client.admin' 2024-09-21T17:41:19.709 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:41:20.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.176+0000 7f5ad2af3640 1 -- 172.21.15.42:0/3126052587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5acc102420 msgr2=0x7f5acc102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:20.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.176+0000 7f5ad2af3640 1 --2- 172.21.15.42:0/3126052587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5acc102420 0x7f5acc102820 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009880 tx=0x7f5ac002a5d0 comp rx=0 tx=0).stop 2024-09-21T17:41:20.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.176+0000 7f5ad2af3640 1 -- 172.21.15.42:0/3126052587 shutdown_connections 2024-09-21T17:41:20.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.176+0000 7f5ad2af3640 1 --2- 172.21.15.42:0/3126052587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5acc102420 0x7f5acc102820 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:20.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.176+0000 7f5ad2af3640 1 -- 172.21.15.42:0/3126052587 >> 172.21.15.42:0/3126052587 conn(0x7f5acc0fdcd0 msgr2=0x7f5acc100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:20.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.176+0000 7f5ad2af3640 1 -- 172.21.15.42:0/3126052587 shutdown_connections 2024-09-21T17:41:20.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.176+0000 7f5ad2af3640 1 -- 172.21.15.42:0/3126052587 wait complete. 2024-09-21T17:41:20.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.177+0000 7f5ad2af3640 1 Processor -- start 2024-09-21T17:41:20.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.177+0000 7f5ad2af3640 1 -- start start 2024-09-21T17:41:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.177+0000 7f5ad2af3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5acc102420 0x7f5acc076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.177+0000 7f5ad2af3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc107b30 con 0x7f5acc102420 2024-09-21T17:41:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.177+0000 7f5ad088f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5acc102420 0x7f5acc076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.177+0000 7f5ad088f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5acc102420 0x7f5acc076bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36610/0 (socket says 172.21.15.42:36610) 2024-09-21T17:41:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.177+0000 7f5ad088f640 1 -- 172.21.15.42:0/4100652000 learned_addr learned my addr 172.21.15.42:0/4100652000 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.178+0000 7f5ad088f640 1 -- 172.21.15.42:0/4100652000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc077150 con 0x7f5acc102420 2024-09-21T17:41:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.178+0000 7f5ad088f640 1 --2- 172.21.15.42:0/4100652000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5acc102420 0x7f5acc076bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00057c0 tx=0x7f5ac00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.178+0000 7f5ac9ffb640 1 -- 172.21.15.42:0/4100652000 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ac003f070 con 0x7f5acc102420 2024-09-21T17:41:20.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.178+0000 7f5ac9ffb640 1 -- 172.21.15.42:0/4100652000 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5ac0003ba0 con 0x7f5acc102420 2024-09-21T17:41:20.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.178+0000 7f5ad2af3640 1 -- 172.21.15.42:0/4100652000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5acc075540 con 0x7f5acc102420 2024-09-21T17:41:20.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.178+0000 7f5ac9ffb640 1 -- 172.21.15.42:0/4100652000 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ac0035030 con 0x7f5acc102420 2024-09-21T17:41:20.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.178+0000 7f5ad2af3640 1 -- 172.21.15.42:0/4100652000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5acc075ac0 con 0x7f5acc102420 2024-09-21T17:41:20.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.179+0000 7f5ac9ffb640 1 -- 172.21.15.42:0/4100652000 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 51820+0+0 (secure 0 0 0) 0x7f5ac0042070 con 0x7f5acc102420 2024-09-21T17:41:20.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.179+0000 7f5ad2af3640 1 -- 172.21.15.42:0/4100652000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5acc1082b0 con 0x7f5acc102420 2024-09-21T17:41:20.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.179+0000 7f5ac9ffb640 1 --2- 172.21.15.42:0/4100652000 >> v2:172.21.15.42:6800/92962027 conn(0x7f5abc03f800 0x7f5abc041cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:20.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.179+0000 7f5ac9ffb640 1 -- 172.21.15.42:0/4100652000 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f5ac0075b30 con 0x7f5acc102420 2024-09-21T17:41:20.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.180+0000 7f5acbfff640 1 --2- 172.21.15.42:0/4100652000 >> v2:172.21.15.42:6800/92962027 conn(0x7f5abc03f800 0x7f5abc041cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:20.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.180+0000 7f5acbfff640 1 --2- 172.21.15.42:0/4100652000 >> v2:172.21.15.42:6800/92962027 conn(0x7f5abc03f800 0x7f5abc041cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80098c0 tx=0x7f5ab8006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:20.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.184+0000 7f5ac9ffb640 1 -- 172.21.15.42:0/4100652000 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f5ac0036260 con 0x7f5acc102420 2024-09-21T17:41:20.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.374+0000 7f5ad2af3640 1 -- 172.21.15.42:0/4100652000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f5acc075e80 con 0x7f5acc102420 2024-09-21T17:41:20.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.376+0000 7f5ac9ffb640 1 -- 172.21.15.42:0/4100652000 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f5ac004ad50 con 0x7f5acc102420 2024-09-21T17:41:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.379+0000 7f5ad2af3640 1 -- 172.21.15.42:0/4100652000 >> v2:172.21.15.42:6800/92962027 conn(0x7f5abc03f800 msgr2=0x7f5abc041cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.379+0000 7f5ad2af3640 1 --2- 172.21.15.42:0/4100652000 >> v2:172.21.15.42:6800/92962027 conn(0x7f5abc03f800 0x7f5abc041cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80098c0 tx=0x7f5ab8006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.379+0000 7f5ad2af3640 1 -- 172.21.15.42:0/4100652000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5acc102420 msgr2=0x7f5acc076bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.379+0000 7f5ad2af3640 1 --2- 172.21.15.42:0/4100652000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5acc102420 0x7f5acc076bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00057c0 tx=0x7f5ac00048f0 comp rx=0 tx=0).stop 2024-09-21T17:41:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.379+0000 7f5ad2af3640 1 -- 172.21.15.42:0/4100652000 shutdown_connections 2024-09-21T17:41:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.379+0000 7f5ad2af3640 1 --2- 172.21.15.42:0/4100652000 >> v2:172.21.15.42:6800/92962027 conn(0x7f5abc03f800 0x7f5abc041cc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.379+0000 7f5ad2af3640 1 --2- 172.21.15.42:0/4100652000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5acc102420 0x7f5acc076bf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.379+0000 7f5ad2af3640 1 -- 172.21.15.42:0/4100652000 >> 172.21.15.42:0/4100652000 conn(0x7f5acc0fdcd0 msgr2=0x7f5acc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.379+0000 7f5ad2af3640 1 -- 172.21.15.42:0/4100652000 shutdown_connections 2024-09-21T17:41:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:20.379+0000 7f5ad2af3640 1 -- 172.21.15.42:0/4100652000 wait complete. 2024-09-21T17:41:20.958 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T17:41:20.958 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T17:41:21.402 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:41:21.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4100652000' entity='client.admin' 2024-09-21T17:41:21.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:21 smithi042 ceph-mon[29361]: mgrmap e14: y(active, since 12s) 2024-09-21T17:41:21.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:21.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:21.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"} : dispatch 2024-09-21T17:41:21.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:21.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:21.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.152+0000 7fcbf3522640 1 -- 172.21.15.42:0/1538320783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbec101330 msgr2=0x7fcbec101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.152+0000 7fcbf3522640 1 --2- 172.21.15.42:0/1538320783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbec101330 0x7fcbec101730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009880 tx=0x7fcbe402a5d0 comp rx=0 tx=0).stop 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.152+0000 7fcbf3522640 1 -- 172.21.15.42:0/1538320783 shutdown_connections 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.152+0000 7fcbf3522640 1 --2- 172.21.15.42:0/1538320783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbec101330 0x7fcbec101730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.152+0000 7fcbf3522640 1 -- 172.21.15.42:0/1538320783 >> 172.21.15.42:0/1538320783 conn(0x7fcbec0fcc20 msgr2=0x7fcbec0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.152+0000 7fcbf3522640 1 -- 172.21.15.42:0/1538320783 shutdown_connections 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.152+0000 7fcbf3522640 1 -- 172.21.15.42:0/1538320783 wait complete. 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.153+0000 7fcbf3522640 1 Processor -- start 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.153+0000 7fcbf3522640 1 -- start start 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.154+0000 7fcbf3522640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbec101330 0x7fcbec06b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.154+0000 7fcbf3522640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec106a40 con 0x7fcbec101330 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.154+0000 7fcbf12be640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbec101330 0x7fcbec06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.154+0000 7fcbf12be640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbec101330 0x7fcbec06b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46638/0 (socket says 172.21.15.42:46638) 2024-09-21T17:41:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.154+0000 7fcbf12be640 1 -- 172.21.15.42:0/1041449417 learned_addr learned my addr 172.21.15.42:0/1041449417 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.154+0000 7fcbf12be640 1 -- 172.21.15.42:0/1041449417 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec06bbf0 con 0x7fcbec101330 2024-09-21T17:41:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.154+0000 7fcbf12be640 1 --2- 172.21.15.42:0/1041449417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbec101330 0x7fcbec06b690 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4005ab0 tx=0x7fcbe40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.154+0000 7fcbea7fc640 1 -- 172.21.15.42:0/1041449417 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe403f070 con 0x7fcbec101330 2024-09-21T17:41:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.154+0000 7fcbf3522640 1 -- 172.21.15.42:0/1041449417 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec19a0a0 con 0x7fcbec101330 2024-09-21T17:41:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.155+0000 7fcbf3522640 1 -- 172.21.15.42:0/1041449417 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbec19a570 con 0x7fcbec101330 2024-09-21T17:41:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.155+0000 7fcbea7fc640 1 -- 172.21.15.42:0/1041449417 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fcbe4003ba0 con 0x7fcbec101330 2024-09-21T17:41:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.155+0000 7fcbea7fc640 1 -- 172.21.15.42:0/1041449417 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe4035030 con 0x7fcbec101330 2024-09-21T17:41:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.156+0000 7fcbf3522640 1 -- 172.21.15.42:0/1041449417 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd80050b0 con 0x7fcbec101330 2024-09-21T17:41:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.156+0000 7fcbea7fc640 1 -- 172.21.15.42:0/1041449417 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7fcbe4042070 con 0x7fcbec101330 2024-09-21T17:41:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.156+0000 7fcbea7fc640 1 --2- 172.21.15.42:0/1041449417 >> v2:172.21.15.42:6800/92962027 conn(0x7fcbd403f8f0 0x7fcbd4041db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.156+0000 7fcbea7fc640 1 -- 172.21.15.42:0/1041449417 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fcbe4074e30 con 0x7fcbec101330 2024-09-21T17:41:22.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.156+0000 7fcbf0abd640 1 --2- 172.21.15.42:0/1041449417 >> v2:172.21.15.42:6800/92962027 conn(0x7fcbd403f8f0 0x7fcbd4041db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:22.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.157+0000 7fcbf0abd640 1 --2- 172.21.15.42:0/1041449417 >> v2:172.21.15.42:6800/92962027 conn(0x7fcbd403f8f0 0x7fcbd4041db0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00098c0 tx=0x7fcbe0006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:22.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.162+0000 7fcbea7fc640 1 -- 172.21.15.42:0/1041449417 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fcbe4040260 con 0x7fcbec101330 2024-09-21T17:41:22.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.356+0000 7fcbf3522640 1 -- 172.21.15.42:0/1041449417 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fcbd8000bf0 con 0x7fcbd403f8f0 2024-09-21T17:41:22.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.359+0000 7fcbea7fc640 1 -- 172.21.15.42:0/1041449417 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcbd8000bf0 con 0x7fcbd403f8f0 2024-09-21T17:41:22.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.363+0000 7fcbf3522640 1 -- 172.21.15.42:0/1041449417 >> v2:172.21.15.42:6800/92962027 conn(0x7fcbd403f8f0 msgr2=0x7fcbd4041db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:22.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.363+0000 7fcbf3522640 1 --2- 172.21.15.42:0/1041449417 >> v2:172.21.15.42:6800/92962027 conn(0x7fcbd403f8f0 0x7fcbd4041db0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00098c0 tx=0x7fcbe0006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:22.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.363+0000 7fcbf3522640 1 -- 172.21.15.42:0/1041449417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbec101330 msgr2=0x7fcbec06b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:22.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.363+0000 7fcbf3522640 1 --2- 172.21.15.42:0/1041449417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbec101330 0x7fcbec06b690 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4005ab0 tx=0x7fcbe40048f0 comp rx=0 tx=0).stop 2024-09-21T17:41:22.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.363+0000 7fcbf3522640 1 -- 172.21.15.42:0/1041449417 shutdown_connections 2024-09-21T17:41:22.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.363+0000 7fcbf3522640 1 --2- 172.21.15.42:0/1041449417 >> v2:172.21.15.42:6800/92962027 conn(0x7fcbd403f8f0 0x7fcbd4041db0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:22.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.363+0000 7fcbf3522640 1 --2- 172.21.15.42:0/1041449417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbec101330 0x7fcbec06b690 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:22.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.363+0000 7fcbf3522640 1 -- 172.21.15.42:0/1041449417 >> 172.21.15.42:0/1041449417 conn(0x7fcbec0fcc20 msgr2=0x7fcbec0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:22.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.363+0000 7fcbf3522640 1 -- 172.21.15.42:0/1041449417 shutdown_connections 2024-09-21T17:41:22.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:22.363+0000 7fcbf3522640 1 -- 172.21.15.42:0/1041449417 wait complete. 2024-09-21T17:41:23.588 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:23.588 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:23.588 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:23.588 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:23.588 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:41:23.588 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T17:41:23.588 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: Updating smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:41:23.589 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:41:23.589 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: Updating smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T17:41:23.589 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:23.589 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:23.589 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:23.590 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2024-09-21T17:41:23.590 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:41:23.590 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2024-09-21T17:41:23.609 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:41:23.609 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:41:23.667 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2024-09-21T17:41:23.668 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch host add smithi162 2024-09-21T17:41:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:41:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.353+0000 7f9652bf8640 1 -- 172.21.15.42:0/3390962784 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f964c103540 msgr2=0x7f964c103920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.353+0000 7f9652bf8640 1 --2- 172.21.15.42:0/3390962784 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f964c103540 0x7f964c103920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f963c009880 tx=0x7f963c02a5d0 comp rx=0 tx=0).stop 2024-09-21T17:41:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.353+0000 7f9652bf8640 1 -- 172.21.15.42:0/3390962784 shutdown_connections 2024-09-21T17:41:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.353+0000 7f9652bf8640 1 --2- 172.21.15.42:0/3390962784 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f964c103540 0x7f964c103920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.353+0000 7f9652bf8640 1 -- 172.21.15.42:0/3390962784 >> 172.21.15.42:0/3390962784 conn(0x7f964c078280 msgr2=0x7f964c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.353+0000 7f9652bf8640 1 -- 172.21.15.42:0/3390962784 shutdown_connections 2024-09-21T17:41:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.353+0000 7f9652bf8640 1 -- 172.21.15.42:0/3390962784 wait complete. 2024-09-21T17:41:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.353+0000 7f9652bf8640 1 Processor -- start 2024-09-21T17:41:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.354+0000 7f9652bf8640 1 -- start start 2024-09-21T17:41:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.354+0000 7f9652bf8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f964c197780 0x7f964c197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.354+0000 7f9652bf8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f964c10c140 con 0x7f964c197780 2024-09-21T17:41:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.354+0000 7f9650994640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f964c197780 0x7f964c197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.354+0000 7f9650994640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f964c197780 0x7f964c197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46658/0 (socket says 172.21.15.42:46658) 2024-09-21T17:41:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.354+0000 7f9650994640 1 -- 172.21.15.42:0/2004172572 learned_addr learned my addr 172.21.15.42:0/2004172572 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.354+0000 7f9650994640 1 -- 172.21.15.42:0/2004172572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c1980a0 con 0x7f964c197780 2024-09-21T17:41:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.354+0000 7f9650994640 1 --2- 172.21.15.42:0/2004172572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f964c197780 0x7f964c197b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f963c005ab0 tx=0x7f963c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.355+0000 7f9649ffb640 1 -- 172.21.15.42:0/2004172572 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f963c03f070 con 0x7f964c197780 2024-09-21T17:41:24.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.355+0000 7f9649ffb640 1 -- 172.21.15.42:0/2004172572 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f963c003a70 con 0x7f964c197780 2024-09-21T17:41:24.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.355+0000 7f9652bf8640 1 -- 172.21.15.42:0/2004172572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964c198330 con 0x7f964c197780 2024-09-21T17:41:24.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.355+0000 7f9649ffb640 1 -- 172.21.15.42:0/2004172572 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f963c035030 con 0x7f964c197780 2024-09-21T17:41:24.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.355+0000 7f9652bf8640 1 -- 172.21.15.42:0/2004172572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964c19d260 con 0x7f964c197780 2024-09-21T17:41:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.356+0000 7f9649ffb640 1 -- 172.21.15.42:0/2004172572 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7f963c042070 con 0x7f964c197780 2024-09-21T17:41:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.356+0000 7f9649ffb640 1 --2- 172.21.15.42:0/2004172572 >> v2:172.21.15.42:6800/92962027 conn(0x7f963803f8a0 0x7f9638041d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.356+0000 7f9649ffb640 1 -- 172.21.15.42:0/2004172572 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f963c075aa0 con 0x7f964c197780 2024-09-21T17:41:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.356+0000 7f9652bf8640 1 -- 172.21.15.42:0/2004172572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964c06ac90 con 0x7f964c197780 2024-09-21T17:41:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.356+0000 7f964bfff640 1 --2- 172.21.15.42:0/2004172572 >> v2:172.21.15.42:6800/92962027 conn(0x7f963803f8a0 0x7f9638041d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.357+0000 7f964bfff640 1 --2- 172.21.15.42:0/2004172572 >> v2:172.21.15.42:6800/92962027 conn(0x7f963803f8a0 0x7f9638041d60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96340098c0 tx=0x7f9634006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.361+0000 7f9649ffb640 1 -- 172.21.15.42:0/2004172572 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f963c036260 con 0x7f964c197780 2024-09-21T17:41:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:24.553+0000 7f9652bf8640 1 -- 172.21.15.42:0/2004172572 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}) -- 0x7f964c1039a0 con 0x7f963803f8a0 2024-09-21T17:41:25.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:25 smithi042 ceph-mon[29361]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:26.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:26 smithi042 ceph-mon[29361]: Deploying cephadm binary to smithi162 2024-09-21T17:41:28.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:28.300+0000 7f9649ffb640 1 -- 172.21.15.42:0/2004172572 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f964c1039a0 con 0x7f963803f8a0 2024-09-21T17:41:28.303 INFO:teuthology.orchestra.run.smithi042.stdout:Added host 'smithi162' with addr '172.21.15.162' 2024-09-21T17:41:28.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:28.303+0000 7f9652bf8640 1 -- 172.21.15.42:0/2004172572 >> v2:172.21.15.42:6800/92962027 conn(0x7f963803f8a0 msgr2=0x7f9638041d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:28.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:28.303+0000 7f9652bf8640 1 --2- 172.21.15.42:0/2004172572 >> v2:172.21.15.42:6800/92962027 conn(0x7f963803f8a0 0x7f9638041d60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96340098c0 tx=0x7f9634006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:28.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:28.303+0000 7f9652bf8640 1 -- 172.21.15.42:0/2004172572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f964c197780 msgr2=0x7f964c197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:28.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:28.303+0000 7f9652bf8640 1 --2- 172.21.15.42:0/2004172572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f964c197780 0x7f964c197b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f963c005ab0 tx=0x7f963c0048f0 comp rx=0 tx=0).stop 2024-09-21T17:41:28.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:28.303+0000 7f9652bf8640 1 -- 172.21.15.42:0/2004172572 shutdown_connections 2024-09-21T17:41:28.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:28.303+0000 7f9652bf8640 1 --2- 172.21.15.42:0/2004172572 >> v2:172.21.15.42:6800/92962027 conn(0x7f963803f8a0 0x7f9638041d60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:28.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:28.303+0000 7f9652bf8640 1 --2- 172.21.15.42:0/2004172572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f964c197780 0x7f964c197b60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:28.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:28.303+0000 7f9652bf8640 1 -- 172.21.15.42:0/2004172572 >> 172.21.15.42:0/2004172572 conn(0x7f964c103540 msgr2=0x7f964c106cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:28.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:28.303+0000 7f9652bf8640 1 -- 172.21.15.42:0/2004172572 shutdown_connections 2024-09-21T17:41:28.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:28.303+0000 7f9652bf8640 1 -- 172.21.15.42:0/2004172572 wait complete. 2024-09-21T17:41:28.953 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T17:41:29.201 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:41:29.561 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:29 smithi042 ceph-mon[29361]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:29.561 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:29 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:29.561 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:29 smithi042 ceph-mon[29361]: Added host smithi162 2024-09-21T17:41:29.561 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:29 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:29.561 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:29 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:29.561 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:29 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:29.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.641+0000 7efd0ebf5640 1 -- 172.21.15.42:0/3081730555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd081016a0 msgr2=0x7efd08101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:29.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.641+0000 7efd0ebf5640 1 --2- 172.21.15.42:0/3081730555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd081016a0 0x7efd08101a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009880 tx=0x7efcfc02a5d0 comp rx=0 tx=0).stop 2024-09-21T17:41:29.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.642+0000 7efd0ebf5640 1 -- 172.21.15.42:0/3081730555 shutdown_connections 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.642+0000 7efd0ebf5640 1 --2- 172.21.15.42:0/3081730555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd081016a0 0x7efd08101a80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.642+0000 7efd0ebf5640 1 -- 172.21.15.42:0/3081730555 >> 172.21.15.42:0/3081730555 conn(0x7efd080fd0f0 msgr2=0x7efd080ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.642+0000 7efd0ebf5640 1 -- 172.21.15.42:0/3081730555 shutdown_connections 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.642+0000 7efd0ebf5640 1 -- 172.21.15.42:0/3081730555 wait complete. 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.642+0000 7efd0ebf5640 1 Processor -- start 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.642+0000 7efd0ebf5640 1 -- start start 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.642+0000 7efd0ebf5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd081016a0 0x7efd081984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.642+0000 7efd0ebf5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efd0810b000 con 0x7efd081016a0 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.643+0000 7efd0c991640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd081016a0 0x7efd081984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.643+0000 7efd0c991640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd081016a0 0x7efd081984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46672/0 (socket says 172.21.15.42:46672) 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.643+0000 7efd0c991640 1 -- 172.21.15.42:0/849161503 learned_addr learned my addr 172.21.15.42:0/849161503 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.643+0000 7efd0c991640 1 -- 172.21.15.42:0/849161503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0806bce0 con 0x7efd081016a0 2024-09-21T17:41:29.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.643+0000 7efd0c991640 1 --2- 172.21.15.42:0/849161503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd081016a0 0x7efd081984b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0099a0 tx=0x7efcfc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:29.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.643+0000 7efd05ffb640 1 -- 172.21.15.42:0/849161503 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcfc03f070 con 0x7efd081016a0 2024-09-21T17:41:29.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.643+0000 7efd05ffb640 1 -- 172.21.15.42:0/849161503 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7efcfc003a70 con 0x7efd081016a0 2024-09-21T17:41:29.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.643+0000 7efd0ebf5640 1 -- 172.21.15.42:0/849161503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd081989f0 con 0x7efd081016a0 2024-09-21T17:41:29.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.643+0000 7efd05ffb640 1 -- 172.21.15.42:0/849161503 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcfc035030 con 0x7efd081016a0 2024-09-21T17:41:29.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.643+0000 7efd0ebf5640 1 -- 172.21.15.42:0/849161503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd08198fd0 con 0x7efd081016a0 2024-09-21T17:41:29.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.644+0000 7efd05ffb640 1 -- 172.21.15.42:0/849161503 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7efcfc042070 con 0x7efd081016a0 2024-09-21T17:41:29.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.644+0000 7efd0ebf5640 1 -- 172.21.15.42:0/849161503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd081992b0 con 0x7efd081016a0 2024-09-21T17:41:29.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.645+0000 7efd05ffb640 1 --2- 172.21.15.42:0/849161503 >> v2:172.21.15.42:6800/92962027 conn(0x7efcf803f8f0 0x7efcf8041db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:29.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.645+0000 7efd05ffb640 1 -- 172.21.15.42:0/849161503 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7efcfc074c30 con 0x7efd081016a0 2024-09-21T17:41:29.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.645+0000 7efd07fff640 1 --2- 172.21.15.42:0/849161503 >> v2:172.21.15.42:6800/92962027 conn(0x7efcf803f8f0 0x7efcf8041db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:29.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.645+0000 7efd07fff640 1 --2- 172.21.15.42:0/849161503 >> v2:172.21.15.42:6800/92962027 conn(0x7efcf803f8f0 0x7efcf8041db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efcf40098c0 tx=0x7efcf4006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:29.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.649+0000 7efd05ffb640 1 -- 172.21.15.42:0/849161503 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7efcfc036df0 con 0x7efd081016a0 2024-09-21T17:41:29.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.848+0000 7efd0ebf5640 1 -- 172.21.15.42:0/849161503 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd08101b00 con 0x7efcf803f8f0 2024-09-21T17:41:29.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.849+0000 7efd05ffb640 1 -- 172.21.15.42:0/849161503 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7efd08101b00 con 0x7efcf803f8f0 2024-09-21T17:41:29.852 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:41:29.852 INFO:teuthology.orchestra.run.smithi042.stdout:[{"addr": "172.21.15.42", "hostname": "smithi042", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}] 2024-09-21T17:41:29.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.852+0000 7efd0ebf5640 1 -- 172.21.15.42:0/849161503 >> v2:172.21.15.42:6800/92962027 conn(0x7efcf803f8f0 msgr2=0x7efcf8041db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:29.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.852+0000 7efd0ebf5640 1 --2- 172.21.15.42:0/849161503 >> v2:172.21.15.42:6800/92962027 conn(0x7efcf803f8f0 0x7efcf8041db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efcf40098c0 tx=0x7efcf4006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.852+0000 7efd0ebf5640 1 -- 172.21.15.42:0/849161503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd081016a0 msgr2=0x7efd081984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.852+0000 7efd0ebf5640 1 --2- 172.21.15.42:0/849161503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd081016a0 0x7efd081984b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0099a0 tx=0x7efcfc0048f0 comp rx=0 tx=0).stop 2024-09-21T17:41:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.852+0000 7efd0ebf5640 1 -- 172.21.15.42:0/849161503 shutdown_connections 2024-09-21T17:41:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.852+0000 7efd0ebf5640 1 --2- 172.21.15.42:0/849161503 >> v2:172.21.15.42:6800/92962027 conn(0x7efcf803f8f0 0x7efcf8041db0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.852+0000 7efd0ebf5640 1 --2- 172.21.15.42:0/849161503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd081016a0 0x7efd081984b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.852+0000 7efd0ebf5640 1 -- 172.21.15.42:0/849161503 >> 172.21.15.42:0/849161503 conn(0x7efd080fd0f0 msgr2=0x7efd08103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.852+0000 7efd0ebf5640 1 -- 172.21.15.42:0/849161503 shutdown_connections 2024-09-21T17:41:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:29.852+0000 7efd0ebf5640 1 -- 172.21.15.42:0/849161503 wait complete. 2024-09-21T17:41:30.377 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T17:41:30.377 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd crush tunables default 2024-09-21T17:41:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:41:30.976 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:30 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:30.976 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:30 smithi042 ceph-mon[29361]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T17:41:31.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.057+0000 7fc248872640 1 -- 172.21.15.42:0/1492673551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2441084b0 msgr2=0x7fc244108890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.057+0000 7fc248872640 1 --2- 172.21.15.42:0/1492673551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2441084b0 0x7fc244108890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc234009880 tx=0x7fc23402a670 comp rx=0 tx=0).stop 2024-09-21T17:41:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.057+0000 7fc248872640 1 -- 172.21.15.42:0/1492673551 shutdown_connections 2024-09-21T17:41:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.057+0000 7fc248872640 1 --2- 172.21.15.42:0/1492673551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2441084b0 0x7fc244108890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.057+0000 7fc248872640 1 -- 172.21.15.42:0/1492673551 >> 172.21.15.42:0/1492673551 conn(0x7fc244078210 msgr2=0x7fc244078620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.057+0000 7fc248872640 1 -- 172.21.15.42:0/1492673551 shutdown_connections 2024-09-21T17:41:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.057+0000 7fc248872640 1 -- 172.21.15.42:0/1492673551 wait complete. 2024-09-21T17:41:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.058+0000 7fc248872640 1 Processor -- start 2024-09-21T17:41:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.058+0000 7fc248872640 1 -- start start 2024-09-21T17:41:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.058+0000 7fc248872640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2441084b0 0x7fc244197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.058+0000 7fc248872640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc24410c0e0 con 0x7fc2441084b0 2024-09-21T17:41:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.058+0000 7fc24259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2441084b0 0x7fc244197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.058+0000 7fc24259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2441084b0 0x7fc244197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46694/0 (socket says 172.21.15.42:46694) 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.058+0000 7fc24259c640 1 -- 172.21.15.42:0/4035779213 learned_addr learned my addr 172.21.15.42:0/4035779213 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.059+0000 7fc24259c640 1 -- 172.21.15.42:0/4035779213 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc244197bc0 con 0x7fc2441084b0 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.059+0000 7fc24259c640 1 --2- 172.21.15.42:0/4035779213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2441084b0 0x7fc244197680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc234005ab0 tx=0x7fc2340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.059+0000 7fc23b7fe640 1 -- 172.21.15.42:0/4035779213 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc23403f070 con 0x7fc2441084b0 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.059+0000 7fc23b7fe640 1 -- 172.21.15.42:0/4035779213 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fc234003a70 con 0x7fc2441084b0 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.059+0000 7fc248872640 1 -- 172.21.15.42:0/4035779213 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc244197eb0 con 0x7fc2441084b0 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.059+0000 7fc23b7fe640 1 -- 172.21.15.42:0/4035779213 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234035030 con 0x7fc2441084b0 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.059+0000 7fc248872640 1 -- 172.21.15.42:0/4035779213 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24419cf60 con 0x7fc2441084b0 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.060+0000 7fc23b7fe640 1 -- 172.21.15.42:0/4035779213 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7fc234042070 con 0x7fc2441084b0 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.060+0000 7fc248872640 1 -- 172.21.15.42:0/4035779213 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc244103a50 con 0x7fc2441084b0 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.060+0000 7fc23b7fe640 1 --2- 172.21.15.42:0/4035779213 >> v2:172.21.15.42:6800/92962027 conn(0x7fc23003f8f0 0x7fc230041db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.060+0000 7fc23b7fe640 1 -- 172.21.15.42:0/4035779213 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fc234074c10 con 0x7fc2441084b0 2024-09-21T17:41:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.060+0000 7fc23bfff640 1 --2- 172.21.15.42:0/4035779213 >> v2:172.21.15.42:6800/92962027 conn(0x7fc23003f8f0 0x7fc230041db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:31.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.061+0000 7fc23bfff640 1 --2- 172.21.15.42:0/4035779213 >> v2:172.21.15.42:6800/92962027 conn(0x7fc23003f8f0 0x7fc230041db0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0098c0 tx=0x7fc22c006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:31.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.065+0000 7fc23b7fe640 1 -- 172.21.15.42:0/4035779213 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fc234041e00 con 0x7fc2441084b0 2024-09-21T17:41:31.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.259+0000 7fc248872640 1 -- 172.21.15.42:0/4035779213 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fc244108910 con 0x7fc2441084b0 2024-09-21T17:41:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.708+0000 7fc23b7fe640 1 -- 172.21.15.42:0/4035779213 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fc2340035f0 con 0x7fc2441084b0 2024-09-21T17:41:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-09-21T17:41:31.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.711+0000 7fc248872640 1 -- 172.21.15.42:0/4035779213 >> v2:172.21.15.42:6800/92962027 conn(0x7fc23003f8f0 msgr2=0x7fc230041db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:31.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.711+0000 7fc248872640 1 --2- 172.21.15.42:0/4035779213 >> v2:172.21.15.42:6800/92962027 conn(0x7fc23003f8f0 0x7fc230041db0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0098c0 tx=0x7fc22c006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:31.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.711+0000 7fc248872640 1 -- 172.21.15.42:0/4035779213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2441084b0 msgr2=0x7fc244197680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:31.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.711+0000 7fc248872640 1 --2- 172.21.15.42:0/4035779213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2441084b0 0x7fc244197680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc234005ab0 tx=0x7fc2340048f0 comp rx=0 tx=0).stop 2024-09-21T17:41:31.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.711+0000 7fc248872640 1 -- 172.21.15.42:0/4035779213 shutdown_connections 2024-09-21T17:41:31.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.711+0000 7fc248872640 1 --2- 172.21.15.42:0/4035779213 >> v2:172.21.15.42:6800/92962027 conn(0x7fc23003f8f0 0x7fc230041db0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:31.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.711+0000 7fc248872640 1 --2- 172.21.15.42:0/4035779213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2441084b0 0x7fc244197680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:31.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.711+0000 7fc248872640 1 -- 172.21.15.42:0/4035779213 >> 172.21.15.42:0/4035779213 conn(0x7fc244078210 msgr2=0x7fc2441047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:31.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.711+0000 7fc248872640 1 -- 172.21.15.42:0/4035779213 shutdown_connections 2024-09-21T17:41:31.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:31.711+0000 7fc248872640 1 -- 172.21.15.42:0/4035779213 wait complete. 2024-09-21T17:41:32.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:31 smithi042 ceph-mon[29361]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:32.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4035779213' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T17:41:32.329 INFO:tasks.cephadm:Adding mon.a on smithi042 2024-09-21T17:41:32.330 INFO:tasks.cephadm:Adding mon.c on smithi042 2024-09-21T17:41:32.330 INFO:tasks.cephadm:Adding mon.b on smithi162 2024-09-21T17:41:32.330 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch apply mon '3;smithi042:172.21.15.42=a;smithi042:[v2:172.21.15.42:3301,v1:172.21.15.42:6790]=c;smithi162:172.21.15.162=b' 2024-09-21T17:41:32.581 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T17:41:32.627 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T17:41:33.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.077+0000 7f5b98978640 1 -- 172.21.15.162:0/3329285205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b94101680 msgr2=0x7f5b94101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:33.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.077+0000 7f5b98978640 1 --2- 172.21.15.162:0/3329285205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b94101680 0x7f5b94101a60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b84009880 tx=0x7f5b8402a5d0 comp rx=0 tx=0).stop 2024-09-21T17:41:33.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.077+0000 7f5b98978640 1 -- 172.21.15.162:0/3329285205 shutdown_connections 2024-09-21T17:41:33.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.077+0000 7f5b98978640 1 --2- 172.21.15.162:0/3329285205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b94101680 0x7f5b94101a60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:33.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.077+0000 7f5b98978640 1 -- 172.21.15.162:0/3329285205 >> 172.21.15.162:0/3329285205 conn(0x7f5b940fd0f0 msgr2=0x7f5b940ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:33.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.077+0000 7f5b98978640 1 -- 172.21.15.162:0/3329285205 shutdown_connections 2024-09-21T17:41:33.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.077+0000 7f5b98978640 1 -- 172.21.15.162:0/3329285205 wait complete. 2024-09-21T17:41:33.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.078+0000 7f5b98978640 1 Processor -- start 2024-09-21T17:41:33.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.078+0000 7f5b98978640 1 -- start start 2024-09-21T17:41:33.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.078+0000 7f5b98978640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b94101680 0x7f5b94197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:33.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.078+0000 7f5b98978640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9410afe0 con 0x7f5b94101680 2024-09-21T17:41:33.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.079+0000 7f5b9259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b94101680 0x7f5b94197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:33.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.079+0000 7f5b9259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b94101680 0x7f5b94197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.162:37738/0 (socket says 172.21.15.162:37738) 2024-09-21T17:41:33.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.079+0000 7f5b9259c640 1 -- 172.21.15.162:0/1485035860 learned_addr learned my addr 172.21.15.162:0/1485035860 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:41:33.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.080+0000 7f5b9259c640 1 -- 172.21.15.162:0/1485035860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b94197c40 con 0x7f5b94101680 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.080+0000 7f5b9259c640 1 --2- 172.21.15.162:0/1485035860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b94101680 0x7f5b94197700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b84005ab0 tx=0x7f5b840048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.080+0000 7f5b837fe640 1 -- 172.21.15.162:0/1485035860 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b8403f070 con 0x7f5b94101680 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.080+0000 7f5b837fe640 1 -- 172.21.15.162:0/1485035860 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5b84003a70 con 0x7f5b94101680 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.080+0000 7f5b98978640 1 -- 172.21.15.162:0/1485035860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b94197f30 con 0x7f5b94101680 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.080+0000 7f5b837fe640 1 -- 172.21.15.162:0/1485035860 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b84035030 con 0x7f5b94101680 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.080+0000 7f5b98978640 1 -- 172.21.15.162:0/1485035860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9419cfe0 con 0x7f5b94101680 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.081+0000 7f5b98978640 1 -- 172.21.15.162:0/1485035860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b94102930 con 0x7f5b94101680 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.081+0000 7f5b837fe640 1 -- 172.21.15.162:0/1485035860 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7f5b84042070 con 0x7f5b94101680 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.081+0000 7f5b837fe640 1 --2- 172.21.15.162:0/1485035860 >> v2:172.21.15.42:6800/92962027 conn(0x7f5b7c03f8a0 0x7f5b7c041d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.081+0000 7f5b837fe640 1 -- 172.21.15.162:0/1485035860 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f5b84074d90 con 0x7f5b94101680 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.082+0000 7f5b91d9b640 1 --2- 172.21.15.162:0/1485035860 >> v2:172.21.15.42:6800/92962027 conn(0x7f5b7c03f8a0 0x7f5b7c041d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.082+0000 7f5b91d9b640 1 --2- 172.21.15.162:0/1485035860 >> v2:172.21.15.42:6800/92962027 conn(0x7f5b7c03f8a0 0x7f5b7c041d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5b880098c0 tx=0x7f5b88006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.087+0000 7f5b837fe640 1 -- 172.21.15.162:0/1485035860 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f5b840372d0 con 0x7f5b94101680 2024-09-21T17:41:33.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4035779213' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T17:41:33.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:32 smithi042 ceph-mon[29361]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T17:41:33.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:32 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:33.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:32 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:33.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:32 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:33.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:32 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:33.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:32 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T17:41:33.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:32 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:33.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:32 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:41:33.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.277+0000 7f5b98978640 1 -- 172.21.15.162:0/1485035860 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi042:[v2:172.21.15.42:3301,v1:172.21.15.42:6790]=c;smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}) -- 0x7f5b94198830 con 0x7f5b7c03f8a0 2024-09-21T17:41:33.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.282+0000 7f5b837fe640 1 -- 172.21.15.162:0/1485035860 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5b94198830 con 0x7f5b7c03f8a0 2024-09-21T17:41:33.285 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mon update... 2024-09-21T17:41:33.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.284+0000 7f5b98978640 1 -- 172.21.15.162:0/1485035860 >> v2:172.21.15.42:6800/92962027 conn(0x7f5b7c03f8a0 msgr2=0x7f5b7c041d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:33.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.284+0000 7f5b98978640 1 --2- 172.21.15.162:0/1485035860 >> v2:172.21.15.42:6800/92962027 conn(0x7f5b7c03f8a0 0x7f5b7c041d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5b880098c0 tx=0x7f5b88006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:33.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.284+0000 7f5b98978640 1 -- 172.21.15.162:0/1485035860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b94101680 msgr2=0x7f5b94197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:33.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.285+0000 7f5b98978640 1 --2- 172.21.15.162:0/1485035860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b94101680 0x7f5b94197700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b84005ab0 tx=0x7f5b840048f0 comp rx=0 tx=0).stop 2024-09-21T17:41:33.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.285+0000 7f5b98978640 1 -- 172.21.15.162:0/1485035860 shutdown_connections 2024-09-21T17:41:33.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.285+0000 7f5b98978640 1 --2- 172.21.15.162:0/1485035860 >> v2:172.21.15.42:6800/92962027 conn(0x7f5b7c03f8a0 0x7f5b7c041d60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:33.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.285+0000 7f5b98978640 1 --2- 172.21.15.162:0/1485035860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b94101680 0x7f5b94197700 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:33.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.285+0000 7f5b98978640 1 -- 172.21.15.162:0/1485035860 >> 172.21.15.162:0/1485035860 conn(0x7f5b940fd0f0 msgr2=0x7f5b9406b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:33.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.285+0000 7f5b98978640 1 -- 172.21.15.162:0/1485035860 shutdown_connections 2024-09-21T17:41:33.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:33.285+0000 7f5b98978640 1 -- 172.21.15.162:0/1485035860 wait complete. 2024-09-21T17:41:33.875 DEBUG:teuthology.orchestra.run.smithi042:mon.c> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.c.service 2024-09-21T17:41:33.878 DEBUG:teuthology.orchestra.run.smithi162:mon.b> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.b.service 2024-09-21T17:41:33.880 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T17:41:33.880 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T17:41:34.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:34.944 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:41:35.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:34 smithi042 ceph-mon[29361]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi042:[v2:172.21.15.42:3301,v1:172.21.15.42:6790]=c;smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:34 smithi042 ceph-mon[29361]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi042:[v2:172.21.15.42:3301,v1:172.21.15.42:6790]=c;smithi162:172.21.15.162=b;count:3 2024-09-21T17:41:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:34 smithi042 ceph-mon[29361]: Deploying daemon mon.b on smithi162 2024-09-21T17:41:35.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.509+0000 7fd3f513f640 1 -- 172.21.15.162:0/3047105121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f01016a0 msgr2=0x7fd3f0101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:35.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.509+0000 7fd3f513f640 1 --2- 172.21.15.162:0/3047105121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f01016a0 0x7fd3f0101a80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009880 tx=0x7fd3e002a5d0 comp rx=0 tx=0).stop 2024-09-21T17:41:35.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.509+0000 7fd3f513f640 1 -- 172.21.15.162:0/3047105121 shutdown_connections 2024-09-21T17:41:35.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.509+0000 7fd3f513f640 1 --2- 172.21.15.162:0/3047105121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f01016a0 0x7fd3f0101a80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:35.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.509+0000 7fd3f513f640 1 -- 172.21.15.162:0/3047105121 >> 172.21.15.162:0/3047105121 conn(0x7fd3f00fd0f0 msgr2=0x7fd3f00ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:35.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.509+0000 7fd3f513f640 1 -- 172.21.15.162:0/3047105121 shutdown_connections 2024-09-21T17:41:35.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.509+0000 7fd3f513f640 1 -- 172.21.15.162:0/3047105121 wait complete. 2024-09-21T17:41:35.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.510+0000 7fd3f513f640 1 Processor -- start 2024-09-21T17:41:35.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.510+0000 7fd3f513f640 1 -- start start 2024-09-21T17:41:35.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.511+0000 7fd3f513f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f01016a0 0x7fd3f01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:35.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.511+0000 7fd3f513f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f010b000 con 0x7fd3f01016a0 2024-09-21T17:41:35.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.511+0000 7fd3eed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f01016a0 0x7fd3f01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:35.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.511+0000 7fd3eed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f01016a0 0x7fd3f01984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.162:37742/0 (socket says 172.21.15.162:37742) 2024-09-21T17:41:35.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.511+0000 7fd3eed9d640 1 -- 172.21.15.162:0/3587367428 learned_addr learned my addr 172.21.15.162:0/3587367428 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:41:35.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.511+0000 7fd3eed9d640 1 -- 172.21.15.162:0/3587367428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f006bd00 con 0x7fd3f01016a0 2024-09-21T17:41:35.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.512+0000 7fd3eed9d640 1 --2- 172.21.15.162:0/3587367428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f01016a0 0x7fd3f01984d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0005ab0 tx=0x7fd3e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:35.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.512+0000 7fd3ecd99640 1 -- 172.21.15.162:0/3587367428 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3e003f070 con 0x7fd3f01016a0 2024-09-21T17:41:35.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.512+0000 7fd3f513f640 1 -- 172.21.15.162:0/3587367428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f0198a10 con 0x7fd3f01016a0 2024-09-21T17:41:35.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.512+0000 7fd3ecd99640 1 -- 172.21.15.162:0/3587367428 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fd3e0003a70 con 0x7fd3f01016a0 2024-09-21T17:41:35.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.512+0000 7fd3ecd99640 1 -- 172.21.15.162:0/3587367428 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3e0035030 con 0x7fd3f01016a0 2024-09-21T17:41:35.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.512+0000 7fd3f513f640 1 -- 172.21.15.162:0/3587367428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f0198ff0 con 0x7fd3f01016a0 2024-09-21T17:41:35.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.513+0000 7fd3f513f640 1 -- 172.21.15.162:0/3587367428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f0102950 con 0x7fd3f01016a0 2024-09-21T17:41:35.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.513+0000 7fd3ecd99640 1 -- 172.21.15.162:0/3587367428 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7fd3e0042070 con 0x7fd3f01016a0 2024-09-21T17:41:35.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.513+0000 7fd3ecd99640 1 --2- 172.21.15.162:0/3587367428 >> v2:172.21.15.42:6800/92962027 conn(0x7fd3dc03f8a0 0x7fd3dc041d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:35.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.513+0000 7fd3ecd99640 1 -- 172.21.15.162:0/3587367428 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fd3e0074dc0 con 0x7fd3f01016a0 2024-09-21T17:41:35.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.513+0000 7fd3e7fff640 1 --2- 172.21.15.162:0/3587367428 >> v2:172.21.15.42:6800/92962027 conn(0x7fd3dc03f8a0 0x7fd3dc041d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:35.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.514+0000 7fd3e7fff640 1 --2- 172.21.15.162:0/3587367428 >> v2:172.21.15.42:6800/92962027 conn(0x7fd3dc03f8a0 0x7fd3dc041d60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80098c0 tx=0x7fd3d8006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:35.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.518+0000 7fd3ecd99640 1 -- 172.21.15.162:0/3587367428 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fd3e004a260 con 0x7fd3f01016a0 2024-09-21T17:41:35.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.775+0000 7fd3f513f640 1 -- 172.21.15.162:0/3587367428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd3f0101b00 con 0x7fd3f01016a0 2024-09-21T17:41:35.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.776+0000 7fd3ecd99640 1 -- 172.21.15.162:0/3587367428 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fd3e00035f0 con 0x7fd3f01016a0 2024-09-21T17:41:35.779 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:41:35.779 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":1,"fsid":"6e3cf65a-7840-11ef-baf6-efdc52797490","modified":"2024-09-21T17:40:15.831038Z","created":"2024-09-21T17:40:15.831038Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T17:41:35.779 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 1 2024-09-21T17:41:35.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.778+0000 7fd3f513f640 1 -- 172.21.15.162:0/3587367428 >> v2:172.21.15.42:6800/92962027 conn(0x7fd3dc03f8a0 msgr2=0x7fd3dc041d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:35.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.778+0000 7fd3f513f640 1 --2- 172.21.15.162:0/3587367428 >> v2:172.21.15.42:6800/92962027 conn(0x7fd3dc03f8a0 0x7fd3dc041d60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80098c0 tx=0x7fd3d8006db0 comp rx=0 tx=0).stop 2024-09-21T17:41:35.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.778+0000 7fd3f513f640 1 -- 172.21.15.162:0/3587367428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f01016a0 msgr2=0x7fd3f01984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:35.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.778+0000 7fd3f513f640 1 --2- 172.21.15.162:0/3587367428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f01016a0 0x7fd3f01984d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0005ab0 tx=0x7fd3e00048f0 comp rx=0 tx=0).stop 2024-09-21T17:41:35.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.778+0000 7fd3f513f640 1 -- 172.21.15.162:0/3587367428 shutdown_connections 2024-09-21T17:41:35.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.778+0000 7fd3f513f640 1 --2- 172.21.15.162:0/3587367428 >> v2:172.21.15.42:6800/92962027 conn(0x7fd3dc03f8a0 0x7fd3dc041d60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:35.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.778+0000 7fd3f513f640 1 --2- 172.21.15.162:0/3587367428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f01016a0 0x7fd3f01984d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:35.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.778+0000 7fd3f513f640 1 -- 172.21.15.162:0/3587367428 >> 172.21.15.162:0/3587367428 conn(0x7fd3f00fd0f0 msgr2=0x7fd3f0103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:35.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.778+0000 7fd3f513f640 1 -- 172.21.15.162:0/3587367428 shutdown_connections 2024-09-21T17:41:35.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:35.778+0000 7fd3f513f640 1 -- 172.21.15.162:0/3587367428 wait complete. 2024-09-21T17:41:36.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:35 smithi042 ceph-mon[29361]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:36.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/3587367428' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:37.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 podman[32085]: 2024-09-21 17:41:37.73030268 +0000 UTC m=+0.125614169 container create 164dd68bdec770e414328513b7dc172b6f4286a6dbbef5b9bd894e926f9f7045 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.license=GPLv2) 2024-09-21T17:41:38.039 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T17:41:38.039 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T17:41:38.286 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:41:38.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 podman[32085]: 2024-09-21 17:41:37.924606296 +0000 UTC m=+0.319917796 container init 164dd68bdec770e414328513b7dc172b6f4286a6dbbef5b9bd894e926f9f7045 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T17:41:38.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 podman[32085]: 2024-09-21 17:41:37.928212403 +0000 UTC m=+0.323523899 container start 164dd68bdec770e414328513b7dc172b6f4286a6dbbef5b9bd894e926f9f7045 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T17:41:38.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T17:41:38.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: ceph version 19.3.0-5129-g0ecbb435 (0ecbb435437226bc091a0c2d4549ba25bf724efe) squid (dev), process ceph-mon, pid 2 2024-09-21T17:41:38.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: pidfile_write: ignore empty --pid-file 2024-09-21T17:41:38.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: load: jerasure load: lrc 2024-09-21T17:41:38.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: RocksDB version: 7.9.2 2024-09-21T17:41:38.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Git sha 0 2024-09-21T17:41:38.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Compile date 2024-09-21 14:38:11 2024-09-21T17:41:38.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: DB SUMMARY 2024-09-21T17:41:38.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: DB Session ID: G8PHB5HBHGM1UFY4GIQY 2024-09-21T17:41:38.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: CURRENT file: CURRENT 2024-09-21T17:41:38.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T17:41:38.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T17:41:38.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-21T17:41:38.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2024-09-21T17:41:38.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.error_if_exists: 0 2024-09-21T17:41:38.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.create_if_missing: 0 2024-09-21T17:41:38.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.paranoid_checks: 1 2024-09-21T17:41:38.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T17:41:38.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T17:41:38.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T17:41:38.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.env: 0x55d5cc1ce120 2024-09-21T17:41:38.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T17:41:38.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.info_log: 0x55d5cd29d700 2024-09-21T17:41:38.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T17:41:38.330 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.statistics: (nil) 2024-09-21T17:41:38.330 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.use_fsync: 0 2024-09-21T17:41:38.330 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_log_file_size: 0 2024-09-21T17:41:38.330 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T17:41:38.330 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T17:41:38.330 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T17:41:38.330 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T17:41:38.330 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.allow_fallocate: 1 2024-09-21T17:41:38.330 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.use_direct_reads: 0 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.db_log_dir: 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.wal_dir: 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T17:41:38.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T17:41:38.332 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T17:41:38.332 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.write_buffer_manager: 0x55d5cd2a1b80 2024-09-21T17:41:38.332 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T17:41:38.332 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T17:41:38.332 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T17:41:38.332 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T17:41:38.332 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T17:41:38.332 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T17:41:38.332 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T17:41:38.332 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T17:41:38.332 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.unordered_write: 0 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.row_cache: None 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.wal_filter: None 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.two_write_queues: 0 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.wal_compression: 0 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.atomic_flush: 0 2024-09-21T17:41:38.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.log_readahead_size: 0 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_background_jobs: 2 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_background_compactions: -1 2024-09-21T17:41:38.334 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_subcompactions: 1 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_open_files: -1 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T17:41:38.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_background_flushes: -1 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Compression algorithms supported: 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: kZSTD supported: 0 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: kXpressCompression supported: 0 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: kBZip2Compression supported: 0 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: kLZ4Compression supported: 1 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: kZlibCompression supported: 1 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: kSnappyCompression supported: 1 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T17:41:38.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.merge_operator: 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_filter: None 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d5cd29d320) 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout: cache_index_and_filter_blocks: 1 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout: pin_top_level_index_and_filter: 1 2024-09-21T17:41:38.337 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_type: 0 2024-09-21T17:41:38.338 INFO:journalctl@ceph.mon.b.smithi162.stdout: data_block_index_type: 0 2024-09-21T17:41:38.338 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_shortening: 1 2024-09-21T17:41:38.338 INFO:journalctl@ceph.mon.b.smithi162.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T17:41:38.338 INFO:journalctl@ceph.mon.b.smithi162.stdout: checksum: 4 2024-09-21T17:41:38.338 INFO:journalctl@ceph.mon.b.smithi162.stdout: no_block_cache: 0 2024-09-21T17:41:38.338 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache: 0x55d5cd291610 2024-09-21T17:41:38.338 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_name: BinnedLRUCache 2024-09-21T17:41:38.338 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_options: 2024-09-21T17:41:38.338 INFO:journalctl@ceph.mon.b.smithi162.stdout: capacity : 536870912 2024-09-21T17:41:38.339 INFO:journalctl@ceph.mon.b.smithi162.stdout: num_shard_bits : 4 2024-09-21T17:41:38.339 INFO:journalctl@ceph.mon.b.smithi162.stdout: strict_capacity_limit : 0 2024-09-21T17:41:38.339 INFO:journalctl@ceph.mon.b.smithi162.stdout: high_pri_pool_ratio: 0.000 2024-09-21T17:41:38.339 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_compressed: (nil) 2024-09-21T17:41:38.339 INFO:journalctl@ceph.mon.b.smithi162.stdout: persistent_cache: (nil) 2024-09-21T17:41:38.339 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_size: 4096 2024-09-21T17:41:38.339 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_size_deviation: 10 2024-09-21T17:41:38.339 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_restart_interval: 16 2024-09-21T17:41:38.339 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_block_restart_interval: 1 2024-09-21T17:41:38.339 INFO:journalctl@ceph.mon.b.smithi162.stdout: metadata_block_size: 4096 2024-09-21T17:41:38.339 INFO:journalctl@ceph.mon.b.smithi162.stdout: partition_filters: 0 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: use_delta_encoding: 1 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: filter_policy: bloomfilter 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: whole_key_filtering: 1 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: verify_compression: 0 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: read_amp_bytes_per_bit: 0 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: format_version: 5 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: enable_index_compression: 1 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_align: 0 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: max_auto_readahead_size: 262144 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: prepopulate_block_cache: 0 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: initial_auto_readahead_size: 8192 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T17:41:38.340 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T17:41:38.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compression: NoCompression 2024-09-21T17:41:38.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T17:41:38.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T17:41:38.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T17:41:38.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.num_levels: 7 2024-09-21T17:41:38.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T17:41:38.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T17:41:38.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T17:41:38.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T17:41:38.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T17:41:38.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T17:41:38.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T17:41:38.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T17:41:38.344 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.inplace_update_support: 0 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.bloom_locality: 0 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.max_successive_merges: 0 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T17:41:38.345 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.ttl: 2592000 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.enable_blob_files: false 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.min_blob_size: 0 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T17:41:38.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 00a025eb-e00f-481c-9cd8-1d09d890f97b 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726940497955299, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726940497955722, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726940497, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "00a025eb-e00f-481c-9cd8-1d09d890f97b", "db_session_id": "G8PHB5HBHGM1UFY4GIQY", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726940497955815, "job": 1, "event": "recovery_finished"} 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d5cd2c0e00 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: DB pointer 0x55d5cd3c2000 2024-09-21T17:41:38.347 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** DB Stats ** 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T17:41:38.348 INFO:journalctl@ceph.mon.b.smithi162.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T17:41:38.349 INFO:journalctl@ceph.mon.b.smithi162.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T17:41:38.349 INFO:journalctl@ceph.mon.b.smithi162.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T17:41:38.349 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T17:41:38.349 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-21T17:41:38.349 INFO:journalctl@ceph.mon.b.smithi162.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T17:41:38.349 INFO:journalctl@ceph.mon.b.smithi162.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T17:41:38.349 INFO:journalctl@ceph.mon.b.smithi162.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T17:41:38.349 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T17:41:38.350 INFO:journalctl@ceph.mon.b.smithi162.stdout: Block cache BinnedLRUCache@0x55d5cd291610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: using public_addr v2:172.21.15.162:0/0 -> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: starting mon.b rank -1 at public addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] at bind addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(???) e0 preinit fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout: e1 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout: btime 2024-09-21T17:40:19:412275+0000 2024-09-21T17:41:38.351 INFO:journalctl@ceph.mon.b.smithi162.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout: legacy client fscid: -1 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout: No filesystems configured 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T17:41:38.352 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T17:41:38.353 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T17:41:38.353 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:38.353 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T17:41:38.353 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:41:38.353 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:41:38.353 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T17:41:38.353 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:38.353 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:38.353 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:38.353 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi042:[v2:172.21.15.42:3301,v1:172.21.15.42:6790]=c;smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi042:[v2:172.21.15.42:3301,v1:172.21.15.42:6790]=c;smithi162:172.21.15.162=b;count:3 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: Deploying daemon mon.b on smithi162 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/3587367428' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:38.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 ceph-mon[32106]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T17:41:38.355 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:37 smithi162 bash[32085]: 164dd68bdec770e414328513b7dc172b6f4286a6dbbef5b9bd894e926f9f7045 2024-09-21T17:41:38.355 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:38 smithi162 systemd[1]: Started Ceph mon.b for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:41:38.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:37 smithi042 ceph-mon[29361]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:43.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.145+0000 7fa1712df640 1 -- 172.21.15.162:0/3760423124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa158003530 msgr2=0x7fa1580059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:43.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.145+0000 7fa1712df640 1 --2- 172.21.15.162:0/3760423124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa158003530 0x7fa1580059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0784b0 tx=0x7fa15c02bfe0 comp rx=0 tx=0).stop 2024-09-21T17:41:43.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.145+0000 7fa1712df640 1 -- 172.21.15.162:0/3760423124 shutdown_connections 2024-09-21T17:41:43.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.145+0000 7fa1712df640 1 --2- 172.21.15.162:0/3760423124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa158003530 0x7fa1580059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:43.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.145+0000 7fa1712df640 1 -- 172.21.15.162:0/3760423124 >> 172.21.15.162:0/3760423124 conn(0x7fa16c077170 msgr2=0x7fa16c077580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:43.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.145+0000 7fa1712df640 1 -- 172.21.15.162:0/3760423124 shutdown_connections 2024-09-21T17:41:43.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.145+0000 7fa1712df640 1 -- 172.21.15.162:0/3760423124 wait complete. 2024-09-21T17:41:43.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.146+0000 7fa1712df640 1 Processor -- start 2024-09-21T17:41:43.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa1712df640 1 -- start start 2024-09-21T17:41:43.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa1712df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa158003530 0x7fa16c197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:43.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa1712df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa16c197d40 0x7fa16c19d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:43.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa1712df640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c108bf0 con 0x7fa158003530 2024-09-21T17:41:43.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa1712df640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c108a70 con 0x7fa16c197d40 2024-09-21T17:41:43.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa16affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa158003530 0x7fa16c197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:43.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa16affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa158003530 0x7fa16c197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.162:57650/0 (socket says 172.21.15.162:57650) 2024-09-21T17:41:43.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa16affd640 1 -- 172.21.15.162:0/2003296066 learned_addr learned my addr 172.21.15.162:0/2003296066 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:41:43.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa16a7fc640 1 --2- 172.21.15.162:0/2003296066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa16c197d40 0x7fa16c19d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:43.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa16a7fc640 1 -- 172.21.15.162:0/2003296066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa16c197d40 msgr2=0x7fa16c19d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-21T17:41:43.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa16a7fc640 1 -- 172.21.15.162:0/2003296066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa16c197d40 msgr2=0x7fa16c19d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T17:41:43.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa16a7fc640 1 --2- 172.21.15.162:0/2003296066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa16c197d40 0x7fa16c19d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T17:41:43.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa16affd640 1 -- 172.21.15.162:0/2003296066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa16c197d40 msgr2=0x7fa16c19d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:43.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.147+0000 7fa16a7fc640 1 --2- 172.21.15.162:0/2003296066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa16c197d40 0x7fa16c19d0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:41:43.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.148+0000 7fa16affd640 1 --2- 172.21.15.162:0/2003296066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa16c197d40 0x7fa16c19d0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:43.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.148+0000 7fa16affd640 1 -- 172.21.15.162:0/2003296066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c1983c0 con 0x7fa158003530 2024-09-21T17:41:43.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.148+0000 7fa16affd640 1 --2- 172.21.15.162:0/2003296066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa158003530 0x7fa16c197800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa15c034630 tx=0x7fa15c004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:43.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.148+0000 7fa163fff640 1 -- 172.21.15.162:0/2003296066 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa15c0051d0 con 0x7fa158003530 2024-09-21T17:41:43.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.148+0000 7fa163fff640 1 -- 172.21.15.162:0/2003296066 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fa15c0057f0 con 0x7fa158003530 2024-09-21T17:41:43.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.148+0000 7fa1712df640 1 -- 172.21.15.162:0/2003296066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa16c19d680 con 0x7fa158003530 2024-09-21T17:41:43.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.148+0000 7fa163fff640 1 -- 172.21.15.162:0/2003296066 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa15c03c3f0 con 0x7fa158003530 2024-09-21T17:41:43.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.148+0000 7fa1712df640 1 -- 172.21.15.162:0/2003296066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa16c19dc40 con 0x7fa158003530 2024-09-21T17:41:43.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.149+0000 7fa163fff640 1 -- 172.21.15.162:0/2003296066 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7fa15c043070 con 0x7fa158003530 2024-09-21T17:41:43.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.149+0000 7fa1712df640 1 -- 172.21.15.162:0/2003296066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa16c19def0 con 0x7fa158003530 2024-09-21T17:41:43.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.150+0000 7fa163fff640 1 --2- 172.21.15.162:0/2003296066 >> v2:172.21.15.42:6800/92962027 conn(0x7fa14c03f650 0x7fa14c041b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:43.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.150+0000 7fa163fff640 1 -- 172.21.15.162:0/2003296066 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fa15c075cb0 con 0x7fa158003530 2024-09-21T17:41:43.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.150+0000 7fa16a7fc640 1 --2- 172.21.15.162:0/2003296066 >> v2:172.21.15.42:6800/92962027 conn(0x7fa14c03f650 0x7fa14c041b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:43.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.150+0000 7fa16a7fc640 1 --2- 172.21.15.162:0/2003296066 >> v2:172.21.15.42:6800/92962027 conn(0x7fa14c03f650 0x7fa14c041b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa154006fd0 tx=0x7fa154008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:43.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.155+0000 7fa163fff640 1 -- 172.21.15.162:0/2003296066 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fa15c044dc0 con 0x7fa158003530 2024-09-21T17:41:43.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:41:43.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: mon.a calling monitor election 2024-09-21T17:41:43.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:43.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: mon.b calling monitor election 2024-09-21T17:41:43.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:43.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:43.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-21T17:41:43.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: monmap epoch 2 2024-09-21T17:41:43.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:43.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: last_changed 2024-09-21T17:41:37.980643+0000 2024-09-21T17:41:43.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: created 2024-09-21T17:40:15.831038+0000 2024-09-21T17:41:43.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: min_mon_release 19 (squid) 2024-09-21T17:41:43.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: election_strategy: 1 2024-09-21T17:41:43.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-21T17:41:43.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T17:41:43.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: fsmap 2024-09-21T17:41:43.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T17:41:43.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: mgrmap e14: y(active, since 34s) 2024-09-21T17:41:43.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: overall HEALTH_OK 2024-09-21T17:41:43.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:43.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:43.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:43.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:43.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:43.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.404+0000 7fa1712df640 1 -- 172.21.15.162:0/2003296066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa16c198930 con 0x7fa158003530 2024-09-21T17:41:43.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.405+0000 7fa163fff640 1 -- 172.21.15.162:0/2003296066 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fa15c042db0 con 0x7fa158003530 2024-09-21T17:41:43.408 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:41:43.408 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"6e3cf65a-7840-11ef-baf6-efdc52797490","modified":"2024-09-21T17:41:37.980643Z","created":"2024-09-21T17:40:15.831038Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T17:41:43.408 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-21T17:41:43.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.407+0000 7fa1712df640 1 -- 172.21.15.162:0/2003296066 >> v2:172.21.15.42:6800/92962027 conn(0x7fa14c03f650 msgr2=0x7fa14c041b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:43.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.408+0000 7fa1712df640 1 --2- 172.21.15.162:0/2003296066 >> v2:172.21.15.42:6800/92962027 conn(0x7fa14c03f650 0x7fa14c041b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa154006fd0 tx=0x7fa154008040 comp rx=0 tx=0).stop 2024-09-21T17:41:43.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.408+0000 7fa1712df640 1 -- 172.21.15.162:0/2003296066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa158003530 msgr2=0x7fa16c197800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:43.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.408+0000 7fa1712df640 1 --2- 172.21.15.162:0/2003296066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa158003530 0x7fa16c197800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa15c034630 tx=0x7fa15c004a00 comp rx=0 tx=0).stop 2024-09-21T17:41:43.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.408+0000 7fa1712df640 1 -- 172.21.15.162:0/2003296066 shutdown_connections 2024-09-21T17:41:43.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.408+0000 7fa1712df640 1 --2- 172.21.15.162:0/2003296066 >> v2:172.21.15.42:6800/92962027 conn(0x7fa14c03f650 0x7fa14c041b10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:43.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.408+0000 7fa1712df640 1 --2- 172.21.15.162:0/2003296066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa16c197d40 0x7fa16c19d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:43.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.408+0000 7fa1712df640 1 --2- 172.21.15.162:0/2003296066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa158003530 0x7fa16c197800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:43.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.408+0000 7fa1712df640 1 -- 172.21.15.162:0/2003296066 >> 172.21.15.162:0/2003296066 conn(0x7fa16c077170 msgr2=0x7fa16c1058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:43.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.408+0000 7fa1712df640 1 -- 172.21.15.162:0/2003296066 shutdown_connections 2024-09-21T17:41:43.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:43.408+0000 7fa1712df640 1 -- 172.21.15.162:0/2003296066 wait complete. 2024-09-21T17:41:43.413 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:41:43.413 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.413 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: mon.a calling monitor election 2024-09-21T17:41:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: mon.b calling monitor election 2024-09-21T17:41:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: monmap epoch 2 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: last_changed 2024-09-21T17:41:37.980643+0000 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: created 2024-09-21T17:40:15.831038+0000 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: min_mon_release 19 (squid) 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: election_strategy: 1 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: fsmap 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: mgrmap e14: y(active, since 34s) 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: overall HEALTH_OK 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:43.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:43.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:43.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:44.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:44 smithi162 ceph-mon[32106]: Deploying daemon mon.c on smithi042 2024-09-21T17:41:44.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/2003296066' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:44.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:44 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:44.386 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:44 smithi042 ceph-mon[29361]: Deploying daemon mon.c on smithi042 2024-09-21T17:41:44.386 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/2003296066' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:44.387 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:44 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:45.056 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:41:44 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: 2024-09-21T17:41:44.980+0000 7f87f57d0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T17:41:45.159 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T17:41:45.159 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T17:41:45.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:45 smithi162 ceph-mon[32106]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:45.377 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:45 smithi042 ceph-mon[29361]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:45.413 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:41:45.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.804+0000 7f0e7252f640 1 -- 172.21.15.162:0/1913027068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e6c101780 msgr2=0x7f0e6c101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.804+0000 7f0e7252f640 1 --2- 172.21.15.162:0/1913027068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e6c101780 0x7f0e6c101b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009880 tx=0x7f0e5c02a5d0 comp rx=0 tx=0).stop 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.804+0000 7f0e7252f640 1 -- 172.21.15.162:0/1913027068 shutdown_connections 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.804+0000 7f0e7252f640 1 --2- 172.21.15.162:0/1913027068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e6c101780 0x7f0e6c101b60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.804+0000 7f0e7252f640 1 -- 172.21.15.162:0/1913027068 >> 172.21.15.162:0/1913027068 conn(0x7f0e6c0fd1d0 msgr2=0x7f0e6c0ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.804+0000 7f0e7252f640 1 -- 172.21.15.162:0/1913027068 shutdown_connections 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.804+0000 7f0e7252f640 1 -- 172.21.15.162:0/1913027068 wait complete. 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.805+0000 7f0e7252f640 1 Processor -- start 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.805+0000 7f0e7252f640 1 -- start start 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.805+0000 7f0e7252f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e6c101780 0x7f0e6c197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.805+0000 7f0e7252f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e6c197ec0 0x7f0e6c19d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.805+0000 7f0e7252f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c10b0e0 con 0x7f0e6c101780 2024-09-21T17:41:45.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.805+0000 7f0e7252f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c10af60 con 0x7f0e6c197ec0 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.805+0000 7f0e6bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e6c101780 0x7f0e6c197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.805+0000 7f0e6b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e6c197ec0 0x7f0e6c19d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.805+0000 7f0e6bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e6c101780 0x7f0e6c197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.162:57674/0 (socket says 172.21.15.162:57674) 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e6bfff640 1 -- 172.21.15.162:0/1658504200 learned_addr learned my addr 172.21.15.162:0/1658504200 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e6b7fe640 1 -- 172.21.15.162:0/1658504200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e6c197ec0 msgr2=0x7f0e6c19d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e6b7fe640 1 -- 172.21.15.162:0/1658504200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e6c197ec0 msgr2=0x7f0e6c19d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e6b7fe640 1 --2- 172.21.15.162:0/1658504200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e6c197ec0 0x7f0e6c19d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e6b7fe640 1 --2- 172.21.15.162:0/1658504200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e6c197ec0 0x7f0e6c19d260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e6bfff640 1 -- 172.21.15.162:0/1658504200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e6c197ec0 msgr2=0x7f0e6c19d260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e6bfff640 1 --2- 172.21.15.162:0/1658504200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e6c197ec0 0x7f0e6c19d260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e6bfff640 1 -- 172.21.15.162:0/1658504200 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c198540 con 0x7f0e6c101780 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e6bfff640 1 --2- 172.21.15.162:0/1658504200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e6c101780 0x7f0e6c197980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c005ab0 tx=0x7f0e5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:45.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e697fa640 1 -- 172.21.15.162:0/1658504200 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0e5c035030 con 0x7f0e6c101780 2024-09-21T17:41:45.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e7252f640 1 -- 172.21.15.162:0/1658504200 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6c19d800 con 0x7f0e6c101780 2024-09-21T17:41:45.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e697fa640 1 -- 172.21.15.162:0/1658504200 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f0e5c004cf0 con 0x7f0e6c101780 2024-09-21T17:41:45.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e697fa640 1 -- 172.21.15.162:0/1658504200 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0e5c03b700 con 0x7f0e6c101780 2024-09-21T17:41:45.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.806+0000 7f0e7252f640 1 -- 172.21.15.162:0/1658504200 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6c19dd40 con 0x7f0e6c101780 2024-09-21T17:41:45.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.807+0000 7f0e7252f640 1 -- 172.21.15.162:0/1658504200 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e6c102a30 con 0x7f0e6c101780 2024-09-21T17:41:45.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.807+0000 7f0e697fa640 1 -- 172.21.15.162:0/1658504200 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7f0e5c042070 con 0x7f0e6c101780 2024-09-21T17:41:45.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.808+0000 7f0e697fa640 1 --2- 172.21.15.162:0/1658504200 >> v2:172.21.15.42:6800/92962027 conn(0x7f0e5403f650 0x7f0e54041b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:45.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.808+0000 7f0e697fa640 1 -- 172.21.15.162:0/1658504200 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f0e5c074d30 con 0x7f0e6c101780 2024-09-21T17:41:45.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.808+0000 7f0e6b7fe640 1 --2- 172.21.15.162:0/1658504200 >> v2:172.21.15.42:6800/92962027 conn(0x7f0e5403f650 0x7f0e54041b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:45.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.808+0000 7f0e6b7fe640 1 --2- 172.21.15.162:0/1658504200 >> v2:172.21.15.42:6800/92962027 conn(0x7f0e5403f650 0x7f0e54041b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0e60006fd0 tx=0x7f0e60008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:45.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:45.813+0000 7f0e697fa640 1 -- 172.21.15.162:0/1658504200 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f0e5c03add0 con 0x7f0e6c101780 2024-09-21T17:41:46.055 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:45 smithi042 systemd[1]: Starting Ceph mon.c for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:41:46.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.061+0000 7f0e7252f640 1 -- 172.21.15.162:0/1658504200 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0e6c19e050 con 0x7f0e6c101780 2024-09-21T17:41:46.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.062+0000 7f0e697fa640 1 -- 172.21.15.162:0/1658504200 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f0e5c04ad20 con 0x7f0e6c101780 2024-09-21T17:41:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:41:46.064 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"6e3cf65a-7840-11ef-baf6-efdc52797490","modified":"2024-09-21T17:41:37.980643Z","created":"2024-09-21T17:40:15.831038Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T17:41:46.064 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-21T17:41:46.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.064+0000 7f0e7252f640 1 -- 172.21.15.162:0/1658504200 >> v2:172.21.15.42:6800/92962027 conn(0x7f0e5403f650 msgr2=0x7f0e54041b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:46.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.064+0000 7f0e7252f640 1 --2- 172.21.15.162:0/1658504200 >> v2:172.21.15.42:6800/92962027 conn(0x7f0e5403f650 0x7f0e54041b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0e60006fd0 tx=0x7f0e60008040 comp rx=0 tx=0).stop 2024-09-21T17:41:46.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.064+0000 7f0e7252f640 1 -- 172.21.15.162:0/1658504200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e6c101780 msgr2=0x7f0e6c197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:46.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.064+0000 7f0e7252f640 1 --2- 172.21.15.162:0/1658504200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e6c101780 0x7f0e6c197980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c005ab0 tx=0x7f0e5c0048f0 comp rx=0 tx=0).stop 2024-09-21T17:41:46.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.064+0000 7f0e7252f640 1 -- 172.21.15.162:0/1658504200 shutdown_connections 2024-09-21T17:41:46.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.065+0000 7f0e7252f640 1 --2- 172.21.15.162:0/1658504200 >> v2:172.21.15.42:6800/92962027 conn(0x7f0e5403f650 0x7f0e54041b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:46.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.065+0000 7f0e7252f640 1 --2- 172.21.15.162:0/1658504200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e6c197ec0 0x7f0e6c19d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:46.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.065+0000 7f0e7252f640 1 --2- 172.21.15.162:0/1658504200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e6c101780 0x7f0e6c197980 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:46.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.065+0000 7f0e7252f640 1 -- 172.21.15.162:0/1658504200 >> 172.21.15.162:0/1658504200 conn(0x7f0e6c0fd1d0 msgr2=0x7f0e6c06b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:46.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.065+0000 7f0e7252f640 1 -- 172.21.15.162:0/1658504200 shutdown_connections 2024-09-21T17:41:46.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:46.065+0000 7f0e7252f640 1 -- 172.21.15.162:0/1658504200 wait complete. 2024-09-21T17:41:46.306 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/1658504200' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:46.306 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 podman[38289]: 2024-09-21 17:41:45.956020667 +0000 UTC m=+0.015928771 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5 2024-09-21T17:41:46.306 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 podman[38289]: 2024-09-21 17:41:46.060675554 +0000 UTC m=+0.120583708 container create 84035f58ffc0def0efa1ea9d31cab7ce0fc38fc0a2a617c0f9df4742b8152dac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T17:41:46.306 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 podman[38289]: 2024-09-21 17:41:46.304771941 +0000 UTC m=+0.364680034 container init 84035f58ffc0def0efa1ea9d31cab7ce0fc38fc0a2a617c0f9df4742b8152dac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T17:41:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/1658504200' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 podman[38289]: 2024-09-21 17:41:46.308182715 +0000 UTC m=+0.368090798 container start 84035f58ffc0def0efa1ea9d31cab7ce0fc38fc0a2a617c0f9df4742b8152dac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T17:41:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T17:41:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: ceph version 19.3.0-5129-g0ecbb435 (0ecbb435437226bc091a0c2d4549ba25bf724efe) squid (dev), process ceph-mon, pid 2 2024-09-21T17:41:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: pidfile_write: ignore empty --pid-file 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: load: jerasure load: lrc 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: RocksDB version: 7.9.2 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Git sha 0 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Compile date 2024-09-21 14:38:11 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: DB SUMMARY 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: DB Session ID: 9SSJZD659SY8ZRRYDP5L 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: CURRENT file: CURRENT 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 636 ; 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.error_if_exists: 0 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.create_if_missing: 0 2024-09-21T17:41:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.paranoid_checks: 1 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.env: 0x556fcf981120 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.info_log: 0x556fd1a3b700 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.statistics: (nil) 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.use_fsync: 0 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_log_file_size: 0 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T17:41:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.allow_fallocate: 1 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.use_direct_reads: 0 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.db_log_dir: 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.wal_dir: 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T17:41:46.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.write_buffer_manager: 0x556fd1a3fb80 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.unordered_write: 0 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T17:41:46.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.row_cache: None 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.wal_filter: None 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.two_write_queues: 0 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.wal_compression: 0 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.atomic_flush: 0 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T17:41:46.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T17:41:46.672 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.log_readahead_size: 0 2024-09-21T17:41:46.672 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T17:41:46.672 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T17:41:46.672 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T17:41:46.672 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T17:41:46.672 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T17:41:46.672 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_background_jobs: 2 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_background_compactions: -1 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_subcompactions: 1 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_open_files: -1 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T17:41:46.673 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_background_flushes: -1 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Compression algorithms supported: 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: kZSTD supported: 0 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: kXpressCompression supported: 0 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: kBZip2Compression supported: 0 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: kLZ4Compression supported: 1 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: kZlibCompression supported: 1 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: kSnappyCompression supported: 1 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T17:41:46.674 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.merge_operator: 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_filter: None 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556fd1a3b320) 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout: cache_index_and_filter_blocks: 1 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout: pin_top_level_index_and_filter: 1 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout: index_type: 0 2024-09-21T17:41:46.675 INFO:journalctl@ceph.mon.c.smithi042.stdout: data_block_index_type: 0 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: index_shortening: 1 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: checksum: 4 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: no_block_cache: 0 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: block_cache: 0x556fd1a2f610 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: block_cache_name: BinnedLRUCache 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: block_cache_options: 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: capacity : 536870912 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: num_shard_bits : 4 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: strict_capacity_limit : 0 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: high_pri_pool_ratio: 0.000 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: block_cache_compressed: (nil) 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: persistent_cache: (nil) 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: block_size: 4096 2024-09-21T17:41:46.676 INFO:journalctl@ceph.mon.c.smithi042.stdout: block_size_deviation: 10 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: block_restart_interval: 16 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: index_block_restart_interval: 1 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: metadata_block_size: 4096 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: partition_filters: 0 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: use_delta_encoding: 1 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: filter_policy: bloomfilter 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: whole_key_filtering: 1 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: verify_compression: 0 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: read_amp_bytes_per_bit: 0 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: format_version: 5 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: enable_index_compression: 1 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: block_align: 0 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: max_auto_readahead_size: 262144 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: prepopulate_block_cache: 0 2024-09-21T17:41:46.677 INFO:journalctl@ceph.mon.c.smithi042.stdout: initial_auto_readahead_size: 8192 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compression: NoCompression 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.num_levels: 7 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T17:41:46.678 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T17:41:46.679 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T17:41:46.680 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T17:41:46.681 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.inplace_update_support: 0 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.bloom_locality: 0 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.max_successive_merges: 0 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.ttl: 2592000 2024-09-21T17:41:46.682 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.enable_blob_files: false 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.min_blob_size: 0 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T17:41:46.683 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7d839330-cf80-4165-bac3-436f7ed526e9 2024-09-21T17:41:46.684 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726940506335950, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T17:41:46.684 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T17:41:46.684 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726940506336489, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726940506, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7d839330-cf80-4165-bac3-436f7ed526e9", "db_session_id": "9SSJZD659SY8ZRRYDP5L", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T17:41:46.684 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726940506336622, "job": 1, "event": "recovery_finished"} 2024-09-21T17:41:46.684 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T17:41:46.685 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T17:41:46.685 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556fd1a5ee00 2024-09-21T17:41:46.685 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: DB pointer 0x556fd1b60000 2024-09-21T17:41:46.685 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: ** DB Stats ** 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: ** Compaction Stats [default] ** 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T17:41:46.686 INFO:journalctl@ceph.mon.c.smithi042.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T17:41:46.687 INFO:journalctl@ceph.mon.c.smithi042.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T17:41:46.687 INFO:journalctl@ceph.mon.c.smithi042.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T17:41:46.687 INFO:journalctl@ceph.mon.c.smithi042.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T17:41:46.687 INFO:journalctl@ceph.mon.c.smithi042.stdout: 2024-09-21T17:41:46.687 INFO:journalctl@ceph.mon.c.smithi042.stdout: ** Compaction Stats [default] ** 2024-09-21T17:41:46.687 INFO:journalctl@ceph.mon.c.smithi042.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T17:41:46.687 INFO:journalctl@ceph.mon.c.smithi042.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T17:41:46.687 INFO:journalctl@ceph.mon.c.smithi042.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T17:41:46.687 INFO:journalctl@ceph.mon.c.smithi042.stdout: 2024-09-21T17:41:46.687 INFO:journalctl@ceph.mon.c.smithi042.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T17:41:46.687 INFO:journalctl@ceph.mon.c.smithi042.stdout: 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: Cumulative compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: Interval compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: Block cache BinnedLRUCache@0x556fd1a2f610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T17:41:46.688 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: using public_addrv [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: starting mon.c rank -1 at public addrs [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] at bind addrs [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(???) e0 preinit fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout: e1 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout: btime 2024-09-21T17:40:19:412275+0000 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout: legacy client fscid: -1 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout: 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout: No filesystems configured 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T17:41:46.689 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:46.690 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi042:[v2:172.21.15.42:3301,v1:172.21.15.42:6790]=c;smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi042:[v2:172.21.15.42:3301,v1:172.21.15.42:6790]=c;smithi162:172.21.15.162=b;count:3 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: Deploying daemon mon.b on smithi162 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/3587367428' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:46.691 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.a calling monitor election 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.b calling monitor election 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: monmap epoch 2 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:46.692 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: last_changed 2024-09-21T17:41:37.980643+0000 2024-09-21T17:41:46.693 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: created 2024-09-21T17:40:15.831038+0000 2024-09-21T17:41:46.693 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: min_mon_release 19 (squid) 2024-09-21T17:41:46.693 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: election_strategy: 1 2024-09-21T17:41:46.693 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-21T17:41:46.693 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T17:41:46.693 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: fsmap 2024-09-21T17:41:46.693 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T17:41:46.693 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mgrmap e14: y(active, since 34s) 2024-09-21T17:41:46.693 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: overall HEALTH_OK 2024-09-21T17:41:46.693 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: Deploying daemon mon.c on smithi042 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/2003296066' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/1658504200' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 ceph-mon[38309]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 bash[38289]: 84035f58ffc0def0efa1ea9d31cab7ce0fc38fc0a2a617c0f9df4742b8152dac 2024-09-21T17:41:46.694 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:46 smithi042 systemd[1]: Started Ceph mon.c for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:41:47.671 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T17:41:47.672 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T17:41:47.916 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:41:51.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.563+0000 7fd886bbe640 1 -- 172.21.15.162:0/4104271251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86c003530 msgr2=0x7fd86c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:51.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.563+0000 7fd886bbe640 1 --2- 172.21.15.162:0/4104271251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86c003530 0x7fd86c0059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd880101500 tx=0x7fd87002c150 comp rx=0 tx=0).stop 2024-09-21T17:41:51.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.563+0000 7fd886bbe640 1 -- 172.21.15.162:0/4104271251 shutdown_connections 2024-09-21T17:41:51.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.563+0000 7fd886bbe640 1 --2- 172.21.15.162:0/4104271251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86c003530 0x7fd86c0059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:51.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.563+0000 7fd886bbe640 1 -- 172.21.15.162:0/4104271251 >> 172.21.15.162:0/4104271251 conn(0x7fd8800fd220 msgr2=0x7fd8800ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:51.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.563+0000 7fd886bbe640 1 -- 172.21.15.162:0/4104271251 shutdown_connections 2024-09-21T17:41:51.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.563+0000 7fd886bbe640 1 -- 172.21.15.162:0/4104271251 wait complete. 2024-09-21T17:41:51.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd886bbe640 1 Processor -- start 2024-09-21T17:41:51.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd886bbe640 1 -- start start 2024-09-21T17:41:51.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd886bbe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86c003530 0x7fd8801956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:51.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd886bbe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd880195c00 0x7fd88019afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:51.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd886bbe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd88019b4e0 0x7fd88019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:51.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd886bbe640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd88006b810 con 0x7fd86c003530 2024-09-21T17:41:51.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd886bbe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd88006b690 con 0x7fd880195c00 2024-09-21T17:41:51.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd886bbe640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fd88006b990 con 0x7fd88019b4e0 2024-09-21T17:41:51.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd87ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd880195c00 0x7fd88019afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:51.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd88495a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86c003530 0x7fd8801956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:51.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd88495a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86c003530 0x7fd8801956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.162:53460/0 (socket says 172.21.15.162:53460) 2024-09-21T17:41:51.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd88495a640 1 -- 172.21.15.162:0/1499866654 learned_addr learned my addr 172.21.15.162:0/1499866654 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:41:51.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd87ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd880195c00 0x7fd88019afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46254/0 (socket says 172.21.15.162:46254) 2024-09-21T17:41:51.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd88515b640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd88019b4e0 0x7fd88019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:51.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd87ffff640 1 -- 172.21.15.162:0/1499866654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd880195c00 msgr2=0x7fd88019afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-21T17:41:51.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd87ffff640 1 -- 172.21.15.162:0/1499866654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd880195c00 msgr2=0x7fd88019afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T17:41:51.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd87ffff640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd880195c00 0x7fd88019afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T17:41:51.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd88515b640 1 -- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd88019b4e0 msgr2=0x7fd88019b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-21T17:41:51.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd88515b640 1 -- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd88019b4e0 msgr2=0x7fd88019b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T17:41:51.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd88515b640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd88019b4e0 0x7fd88019b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T17:41:51.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd87ffff640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd880195c00 0x7fd88019afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:41:51.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.564+0000 7fd88515b640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd88019b4e0 0x7fd88019b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:41:51.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.565+0000 7fd88495a640 1 -- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd88019b4e0 msgr2=0x7fd88019b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T17:41:51.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.565+0000 7fd88495a640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd88019b4e0 0x7fd88019b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:51.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.565+0000 7fd88495a640 1 -- 172.21.15.162:0/1499866654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd880195c00 msgr2=0x7fd88019afa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T17:41:51.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.565+0000 7fd88495a640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd880195c00 0x7fd88019afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:51.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.565+0000 7fd88495a640 1 -- 172.21.15.162:0/1499866654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8801a2120 con 0x7fd86c003530 2024-09-21T17:41:51.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.565+0000 7fd88495a640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86c003530 0x7fd8801956c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd870005730 tx=0x7fd870004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:51.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.565+0000 7fd87dffb640 1 -- 172.21.15.162:0/1499866654 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870032040 con 0x7fd86c003530 2024-09-21T17:41:51.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.565+0000 7fd87dffb640 1 -- 172.21.15.162:0/1499866654 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fd87002dc70 con 0x7fd86c003530 2024-09-21T17:41:51.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.565+0000 7fd886bbe640 1 -- 172.21.15.162:0/1499866654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8801a23b0 con 0x7fd86c003530 2024-09-21T17:41:51.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.565+0000 7fd87dffb640 1 -- 172.21.15.162:0/1499866654 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870036670 con 0x7fd86c003530 2024-09-21T17:41:51.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.565+0000 7fd886bbe640 1 -- 172.21.15.162:0/1499866654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8801a28c0 con 0x7fd86c003530 2024-09-21T17:41:51.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.567+0000 7fd87dffb640 1 -- 172.21.15.162:0/1499866654 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7fd870036810 con 0x7fd86c003530 2024-09-21T17:41:51.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.567+0000 7fd886bbe640 1 -- 172.21.15.162:0/1499866654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd880102a40 con 0x7fd86c003530 2024-09-21T17:41:51.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.567+0000 7fd87dffb640 1 --2- 172.21.15.162:0/1499866654 >> v2:172.21.15.42:6800/92962027 conn(0x7fd860041f40 0x7fd860044400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:51.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.567+0000 7fd87dffb640 1 -- 172.21.15.162:0/1499866654 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fd870076160 con 0x7fd86c003530 2024-09-21T17:41:51.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.567+0000 7fd87ffff640 1 --2- 172.21.15.162:0/1499866654 >> v2:172.21.15.42:6800/92962027 conn(0x7fd860041f40 0x7fd860044400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:51.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.567+0000 7fd87ffff640 1 --2- 172.21.15.162:0/1499866654 >> v2:172.21.15.42:6800/92962027 conn(0x7fd860041f40 0x7fd860044400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd8680070b0 tx=0x7fd868007040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:51.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.571+0000 7fd87dffb640 1 -- 172.21.15.162:0/1499866654 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fd870047560 con 0x7fd86c003530 2024-09-21T17:41:51.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:51.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:41:51.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:51.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: mon.a calling monitor election 2024-09-21T17:41:51.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: mon.b calling monitor election 2024-09-21T17:41:51.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:51.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: mon.c calling monitor election 2024-09-21T17:41:51.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:51.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T17:41:51.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: monmap epoch 3 2024-09-21T17:41:51.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:51.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: last_changed 2024-09-21T17:41:46.363388+0000 2024-09-21T17:41:51.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: created 2024-09-21T17:40:15.831038+0000 2024-09-21T17:41:51.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: min_mon_release 19 (squid) 2024-09-21T17:41:51.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: election_strategy: 1 2024-09-21T17:41:51.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-21T17:41:51.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T17:41:51.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: 2: [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] mon.c 2024-09-21T17:41:51.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: fsmap 2024-09-21T17:41:51.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T17:41:51.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: mgrmap e14: y(active, since 43s) 2024-09-21T17:41:51.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: overall HEALTH_OK 2024-09-21T17:41:51.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:51.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:51.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:51.830 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:51.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.840+0000 7fd886bbe640 1 -- 172.21.15.162:0/1499866654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd88018f060 con 0x7fd86c003530 2024-09-21T17:41:51.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.841+0000 7fd87dffb640 1 -- 172.21.15.162:0/1499866654 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7fd870047300 con 0x7fd86c003530 2024-09-21T17:41:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:41:51.843 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":3,"fsid":"6e3cf65a-7840-11ef-baf6-efdc52797490","modified":"2024-09-21T17:41:46.363388Z","created":"2024-09-21T17:40:15.831038Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3301","nonce":0},{"type":"v1","addr":"172.21.15.42:6790","nonce":0}]},"addr":"172.21.15.42:6790/0","public_addr":"172.21.15.42:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T17:41:51.843 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 3 2024-09-21T17:41:51.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 -- 172.21.15.162:0/1499866654 >> v2:172.21.15.42:6800/92962027 conn(0x7fd860041f40 msgr2=0x7fd860044400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:51.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 --2- 172.21.15.162:0/1499866654 >> v2:172.21.15.42:6800/92962027 conn(0x7fd860041f40 0x7fd860044400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd8680070b0 tx=0x7fd868007040 comp rx=0 tx=0).stop 2024-09-21T17:41:51.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 -- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86c003530 msgr2=0x7fd8801956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:51.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86c003530 0x7fd8801956c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd870005730 tx=0x7fd870004840 comp rx=0 tx=0).stop 2024-09-21T17:41:51.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 -- 172.21.15.162:0/1499866654 shutdown_connections 2024-09-21T17:41:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 --2- 172.21.15.162:0/1499866654 >> v2:172.21.15.42:6800/92962027 conn(0x7fd860041f40 0x7fd860044400 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd88019b4e0 0x7fd88019b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd880195c00 0x7fd88019afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 --2- 172.21.15.162:0/1499866654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86c003530 0x7fd8801956c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 -- 172.21.15.162:0/1499866654 >> 172.21.15.162:0/1499866654 conn(0x7fd8800fd220 msgr2=0x7fd8801037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 -- 172.21.15.162:0/1499866654 shutdown_connections 2024-09-21T17:41:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:51.843+0000 7fd886bbe640 1 -- 172.21.15.162:0/1499866654 wait complete. 2024-09-21T17:41:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:41:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: mon.a calling monitor election 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: mon.b calling monitor election 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: mon.c calling monitor election 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: monmap epoch 3 2024-09-21T17:41:51.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:51.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: last_changed 2024-09-21T17:41:46.363388+0000 2024-09-21T17:41:51.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: created 2024-09-21T17:40:15.831038+0000 2024-09-21T17:41:51.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: min_mon_release 19 (squid) 2024-09-21T17:41:51.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: election_strategy: 1 2024-09-21T17:41:51.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-21T17:41:51.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T17:41:51.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: 2: [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] mon.c 2024-09-21T17:41:51.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: fsmap 2024-09-21T17:41:51.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T17:41:51.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: mgrmap e14: y(active, since 43s) 2024-09-21T17:41:51.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: overall HEALTH_OK 2024-09-21T17:41:51.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:51.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:51.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:51.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:51.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:51.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:41:51.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:41:51.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: mon.a calling monitor election 2024-09-21T17:41:51.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: mon.b calling monitor election 2024-09-21T17:41:51.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: mon.c calling monitor election 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: monmap epoch 3 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: last_changed 2024-09-21T17:41:46.363388+0000 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: created 2024-09-21T17:40:15.831038+0000 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: min_mon_release 19 (squid) 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: election_strategy: 1 2024-09-21T17:41:51.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-21T17:41:51.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T17:41:51.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: 2: [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] mon.c 2024-09-21T17:41:51.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: fsmap 2024-09-21T17:41:51.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T17:41:51.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: mgrmap e14: y(active, since 43s) 2024-09-21T17:41:51.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: overall HEALTH_OK 2024-09-21T17:41:51.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:51.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:51.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:51.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:52.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:52 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:52.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/1499866654' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:52.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:52 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:52 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:52.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/1499866654' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:52.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:52 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:52 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/1499866654' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T17:41:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:52 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:41:53.074 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T17:41:53.074 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T17:41:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:41:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T17:41:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T17:41:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:41:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: Updating smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[29361]: Reconfiguring daemon mon.a on smithi042 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: Updating smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:41:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:53.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:53 smithi042 ceph-mon[38309]: Reconfiguring daemon mon.a on smithi042 2024-09-21T17:41:53.689 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:41:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: Updating smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:53.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T17:41:53.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:53.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T17:41:53.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:53.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:53 smithi162 ceph-mon[32106]: Reconfiguring daemon mon.a on smithi042 2024-09-21T17:41:54.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.139+0000 7f1795be2640 1 -- 172.21.15.42:0/2934302770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1790103690 msgr2=0x7f1790103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:54.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.139+0000 7f1795be2640 1 --2- 172.21.15.42:0/2934302770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1790103690 0x7f1790103a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1780009c20 tx=0x7f178002aa90 comp rx=0 tx=0).stop 2024-09-21T17:41:54.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.139+0000 7f1795be2640 1 -- 172.21.15.42:0/2934302770 shutdown_connections 2024-09-21T17:41:54.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.139+0000 7f1795be2640 1 --2- 172.21.15.42:0/2934302770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1790103690 0x7f1790103a70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:54.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.139+0000 7f1795be2640 1 -- 172.21.15.42:0/2934302770 >> 172.21.15.42:0/2934302770 conn(0x7f1790078280 msgr2=0x7f17900ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:54.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.139+0000 7f1795be2640 1 -- 172.21.15.42:0/2934302770 shutdown_connections 2024-09-21T17:41:54.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.139+0000 7f1795be2640 1 -- 172.21.15.42:0/2934302770 wait complete. 2024-09-21T17:41:54.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.139+0000 7f1795be2640 1 Processor -- start 2024-09-21T17:41:54.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f1795be2640 1 -- start start 2024-09-21T17:41:54.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f1795be2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17901979c0 0x7f1790197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:54.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f1795be2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17901982e0 0x7f179019d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:54.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f1795be2640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f179019d8b0 0x7f179019dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:54.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f1795be2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f179010c0f0 con 0x7f17901982e0 2024-09-21T17:41:54.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f1795be2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f179010bf70 con 0x7f17901979c0 2024-09-21T17:41:54.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f1795be2640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f179010c270 con 0x7f179019d8b0 2024-09-21T17:41:54.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17901982e0 0x7f179019d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17901982e0 0x7f179019d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38526/0 (socket says 172.21.15.42:38526) 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178ffff640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f179019d8b0 0x7f179019dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178effd640 1 -- 172.21.15.42:0/1357145106 learned_addr learned my addr 172.21.15.42:0/1357145106 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178f7fe640 1 --2- 172.21.15.42:0/1357145106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17901979c0 0x7f1790197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178ffff640 1 -- 172.21.15.42:0/1357145106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17901979c0 msgr2=0x7f1790197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178ffff640 1 --2- 172.21.15.42:0/1357145106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17901979c0 0x7f1790197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178ffff640 1 -- 172.21.15.42:0/1357145106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17901982e0 msgr2=0x7f179019d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178ffff640 1 --2- 172.21.15.42:0/1357145106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17901982e0 0x7f179019d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178ffff640 1 -- 172.21.15.42:0/1357145106 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17901a4750 con 0x7f179019d8b0 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178effd640 1 --2- 172.21.15.42:0/1357145106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17901982e0 0x7f179019d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178f7fe640 1 --2- 172.21.15.42:0/1357145106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17901979c0 0x7f1790197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T17:41:54.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.140+0000 7f178ffff640 1 --2- 172.21.15.42:0/1357145106 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f179019d8b0 0x7f179019dd20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1788009fd0 tx=0x7f178800b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:54.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.141+0000 7f178cff9640 1 -- 172.21.15.42:0/1357145106 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788015020 con 0x7f179019d8b0 2024-09-21T17:41:54.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.141+0000 7f178cff9640 1 -- 172.21.15.42:0/1357145106 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f1788011cb0 con 0x7f179019d8b0 2024-09-21T17:41:54.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.141+0000 7f178cff9640 1 -- 172.21.15.42:0/1357145106 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788010d40 con 0x7f179019d8b0 2024-09-21T17:41:54.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.141+0000 7f1795be2640 1 -- 172.21.15.42:0/1357145106 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17901a4a40 con 0x7f179019d8b0 2024-09-21T17:41:54.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.141+0000 7f1795be2640 1 -- 172.21.15.42:0/1357145106 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17901a4f80 con 0x7f179019d8b0 2024-09-21T17:41:54.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.142+0000 7f178cff9640 1 -- 172.21.15.42:0/1357145106 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7f1788018020 con 0x7f179019d8b0 2024-09-21T17:41:54.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.142+0000 7f178cff9640 1 --2- 172.21.15.42:0/1357145106 >> v2:172.21.15.42:6800/92962027 conn(0x7f177c03fd30 0x7f177c0421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:54.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.142+0000 7f178cff9640 1 -- 172.21.15.42:0/1357145106 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f1788053aa0 con 0x7f179019d8b0 2024-09-21T17:41:54.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.142+0000 7f1795be2640 1 -- 172.21.15.42:0/1357145106 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f179006ad10 con 0x7f179019d8b0 2024-09-21T17:41:54.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.142+0000 7f178f7fe640 1 --2- 172.21.15.42:0/1357145106 >> v2:172.21.15.42:6800/92962027 conn(0x7f177c03fd30 0x7f177c0421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:54.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.142+0000 7f178f7fe640 1 --2- 172.21.15.42:0/1357145106 >> v2:172.21.15.42:6800/92962027 conn(0x7f177c03fd30 0x7f177c0421f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1780000f80 tx=0x7f178003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:54.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.147+0000 7f178cff9640 1 -- 172.21.15.42:0/1357145106 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f178801f020 con 0x7f179019d8b0 2024-09-21T17:41:54.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.338+0000 7f1795be2640 1 -- 172.21.15.42:0/1357145106 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f1790198bc0 con 0x7f179019d8b0 2024-09-21T17:41:54.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.339+0000 7f178cff9640 1 -- 172.21.15.42:0/1357145106 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f1788017cd0 con 0x7f179019d8b0 2024-09-21T17:41:54.342 INFO:teuthology.orchestra.run.smithi042.stdout:# minimal ceph.conf for 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:54.342 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-09-21T17:41:54.342 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:41:54.343 INFO:teuthology.orchestra.run.smithi042.stdout: mon_host = [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] 2024-09-21T17:41:54.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 -- 172.21.15.42:0/1357145106 >> v2:172.21.15.42:6800/92962027 conn(0x7f177c03fd30 msgr2=0x7f177c0421f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:54.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 --2- 172.21.15.42:0/1357145106 >> v2:172.21.15.42:6800/92962027 conn(0x7f177c03fd30 0x7f177c0421f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1780000f80 tx=0x7f178003a040 comp rx=0 tx=0).stop 2024-09-21T17:41:54.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 -- 172.21.15.42:0/1357145106 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f179019d8b0 msgr2=0x7f179019dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:54.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 --2- 172.21.15.42:0/1357145106 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f179019d8b0 0x7f179019dd20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1788009fd0 tx=0x7f178800b870 comp rx=0 tx=0).stop 2024-09-21T17:41:54.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 -- 172.21.15.42:0/1357145106 shutdown_connections 2024-09-21T17:41:54.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 --2- 172.21.15.42:0/1357145106 >> v2:172.21.15.42:6800/92962027 conn(0x7f177c03fd30 0x7f177c0421f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:54.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 --2- 172.21.15.42:0/1357145106 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f179019d8b0 0x7f179019dd20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:54.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 --2- 172.21.15.42:0/1357145106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17901982e0 0x7f179019d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:54.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 --2- 172.21.15.42:0/1357145106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17901979c0 0x7f1790197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:54.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 -- 172.21.15.42:0/1357145106 >> 172.21.15.42:0/1357145106 conn(0x7f1790103690 msgr2=0x7f1790106c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:54.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 -- 172.21.15.42:0/1357145106 shutdown_connections 2024-09-21T17:41:54.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:41:54.342+0000 7f1795be2640 1 -- 172.21.15.42:0/1357145106 wait complete. 2024-09-21T17:41:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:54 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1357145106' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:54 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1357145106' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:55.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:54 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:55.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1357145106' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:55.245 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T17:41:55.245 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:41:55.245 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T17:41:55.274 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:41:55.274 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:41:55.342 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:41:55.342 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T17:41:55.375 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:41:55.375 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:41:55.444 INFO:tasks.cephadm:Adding mgr.y on smithi042 2024-09-21T17:41:55.445 INFO:tasks.cephadm:Adding mgr.x on smithi162 2024-09-21T17:41:55.445 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch apply mgr '2;smithi042=y;smithi162=x' 2024-09-21T17:41:55.732 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:41:55.751 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[29361]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:55.751 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[29361]: Reconfiguring mon.c (monmap changed)... 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[29361]: Reconfiguring daemon mon.c on smithi042 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[38309]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[38309]: Reconfiguring mon.c (monmap changed)... 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:55.752 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T17:41:55.753 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:55.753 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:55 smithi042 ceph-mon[38309]: Reconfiguring daemon mon.c on smithi042 2024-09-21T17:41:55.959 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:55 smithi162 ceph-mon[32106]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:55.959 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:55 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:55.960 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:55 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:55.960 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:55 smithi162 ceph-mon[32106]: Reconfiguring mon.c (monmap changed)... 2024-09-21T17:41:55.960 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:55 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:55.960 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:55 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T17:41:55.960 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:55 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:55.960 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:55 smithi162 ceph-mon[32106]: Reconfiguring daemon mon.c on smithi042 2024-09-21T17:41:56.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.165+0000 7efce94ad640 1 -- 172.21.15.162:0/788566933 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efce4101450 msgr2=0x7efce4101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:56.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.165+0000 7efce94ad640 1 --2- 172.21.15.162:0/788566933 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efce4101450 0x7efce4101850 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009880 tx=0x7efcd402a5d0 comp rx=0 tx=0).stop 2024-09-21T17:41:56.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.165+0000 7efce94ad640 1 -- 172.21.15.162:0/788566933 shutdown_connections 2024-09-21T17:41:56.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.165+0000 7efce94ad640 1 --2- 172.21.15.162:0/788566933 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efce4101450 0x7efce4101850 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:56.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.165+0000 7efce94ad640 1 -- 172.21.15.162:0/788566933 >> 172.21.15.162:0/788566933 conn(0x7efce40fcd20 msgr2=0x7efce40ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:56.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.165+0000 7efce94ad640 1 -- 172.21.15.162:0/788566933 shutdown_connections 2024-09-21T17:41:56.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.165+0000 7efce94ad640 1 -- 172.21.15.162:0/788566933 wait complete. 2024-09-21T17:41:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efce94ad640 1 Processor -- start 2024-09-21T17:41:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efce94ad640 1 -- start start 2024-09-21T17:41:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efce94ad640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efce4101450 0x7efce41963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efce94ad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efce41969a0 0x7efce4197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efce94ad640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efce4197bc0 0x7efce4198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efce94ad640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efce4106b00 con 0x7efce4197bc0 2024-09-21T17:41:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efce94ad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efce4106980 con 0x7efce41969a0 2024-09-21T17:41:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efce94ad640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7efce4106c80 con 0x7efce4101450 2024-09-21T17:41:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efcdbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efce41969a0 0x7efce4197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efcdbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efce41969a0 0x7efce4197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46268/0 (socket says 172.21.15.162:46268) 2024-09-21T17:41:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efcdbfff640 1 -- 172.21.15.162:0/3325501974 learned_addr learned my addr 172.21.15.162:0/3325501974 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:41:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efce2ffd640 1 --2- 172.21.15.162:0/3325501974 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efce4101450 0x7efce41963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.166+0000 7efce37fe640 1 --2- 172.21.15.162:0/3325501974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efce4197bc0 0x7efce4198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.167+0000 7efcdbfff640 1 -- 172.21.15.162:0/3325501974 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efce4101450 msgr2=0x7efce41963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.167+0000 7efcdbfff640 1 --2- 172.21.15.162:0/3325501974 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efce4101450 0x7efce41963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.167+0000 7efcdbfff640 1 -- 172.21.15.162:0/3325501974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efce4197bc0 msgr2=0x7efce4198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.167+0000 7efcdbfff640 1 --2- 172.21.15.162:0/3325501974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efce4197bc0 0x7efce4198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.167+0000 7efcdbfff640 1 -- 172.21.15.162:0/3325501974 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce419e7a0 con 0x7efce41969a0 2024-09-21T17:41:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.167+0000 7efcdbfff640 1 --2- 172.21.15.162:0/3325501974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efce41969a0 0x7efce4197680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efccc00b520 tx=0x7efccc00b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:56.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.167+0000 7efce0ff9640 1 -- 172.21.15.162:0/3325501974 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc004230 con 0x7efce41969a0 2024-09-21T17:41:56.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.167+0000 7efce0ff9640 1 -- 172.21.15.162:0/3325501974 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7efccc0043d0 con 0x7efce41969a0 2024-09-21T17:41:56.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.167+0000 7efce94ad640 1 -- 172.21.15.162:0/3325501974 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce419ea90 con 0x7efce41969a0 2024-09-21T17:41:56.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.167+0000 7efce0ff9640 1 -- 172.21.15.162:0/3325501974 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc003c10 con 0x7efce41969a0 2024-09-21T17:41:56.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.167+0000 7efce94ad640 1 -- 172.21.15.162:0/3325501974 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce419f050 con 0x7efce41969a0 2024-09-21T17:41:56.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.168+0000 7efce0ff9640 1 -- 172.21.15.162:0/3325501974 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7efccc00e070 con 0x7efce41969a0 2024-09-21T17:41:56.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.168+0000 7efce94ad640 1 -- 172.21.15.162:0/3325501974 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce4101850 con 0x7efce41969a0 2024-09-21T17:41:56.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.168+0000 7efce0ff9640 1 --2- 172.21.15.162:0/3325501974 >> v2:172.21.15.42:6800/92962027 conn(0x7efcd003fd30 0x7efcd00421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:41:56.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.168+0000 7efce0ff9640 1 -- 172.21.15.162:0/3325501974 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7efccc053dd0 con 0x7efce41969a0 2024-09-21T17:41:56.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.168+0000 7efce2ffd640 1 --2- 172.21.15.162:0/3325501974 >> v2:172.21.15.42:6800/92962027 conn(0x7efcd003fd30 0x7efcd00421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:41:56.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.169+0000 7efce2ffd640 1 --2- 172.21.15.162:0/3325501974 >> v2:172.21.15.42:6800/92962027 conn(0x7efcd003fd30 0x7efcd00421f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efcd40096c0 tx=0x7efcd4005a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:41:56.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.173+0000 7efce0ff9640 1 -- 172.21.15.162:0/3325501974 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7efccc014020 con 0x7efce41969a0 2024-09-21T17:41:56.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.364+0000 7efce94ad640 1 -- 172.21.15.162:0/3325501974 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi042=y;smithi162=x", "target": ["mon-mgr", ""]}) -- 0x7efce4063590 con 0x7efcd003fd30 2024-09-21T17:41:56.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.370+0000 7efce0ff9640 1 -- 172.21.15.162:0/3325501974 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7efce4063590 con 0x7efcd003fd30 2024-09-21T17:41:56.373 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mgr update... 2024-09-21T17:41:56.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.372+0000 7efce94ad640 1 -- 172.21.15.162:0/3325501974 >> v2:172.21.15.42:6800/92962027 conn(0x7efcd003fd30 msgr2=0x7efcd00421f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:56.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.372+0000 7efce94ad640 1 --2- 172.21.15.162:0/3325501974 >> v2:172.21.15.42:6800/92962027 conn(0x7efcd003fd30 0x7efcd00421f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efcd40096c0 tx=0x7efcd4005a40 comp rx=0 tx=0).stop 2024-09-21T17:41:56.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.372+0000 7efce94ad640 1 -- 172.21.15.162:0/3325501974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efce41969a0 msgr2=0x7efce4197680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:41:56.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.372+0000 7efce94ad640 1 --2- 172.21.15.162:0/3325501974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efce41969a0 0x7efce4197680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efccc00b520 tx=0x7efccc00b9e0 comp rx=0 tx=0).stop 2024-09-21T17:41:56.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.373+0000 7efce94ad640 1 -- 172.21.15.162:0/3325501974 shutdown_connections 2024-09-21T17:41:56.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.373+0000 7efce94ad640 1 --2- 172.21.15.162:0/3325501974 >> v2:172.21.15.42:6800/92962027 conn(0x7efcd003fd30 0x7efcd00421f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:56.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.373+0000 7efce94ad640 1 --2- 172.21.15.162:0/3325501974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efce4197bc0 0x7efce4198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:56.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.373+0000 7efce94ad640 1 --2- 172.21.15.162:0/3325501974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efce41969a0 0x7efce4197680 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:56.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.373+0000 7efce94ad640 1 --2- 172.21.15.162:0/3325501974 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efce4101450 0x7efce41963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:41:56.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.373+0000 7efce94ad640 1 -- 172.21.15.162:0/3325501974 >> 172.21.15.162:0/3325501974 conn(0x7efce40fcd20 msgr2=0x7efce40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:41:56.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.373+0000 7efce94ad640 1 -- 172.21.15.162:0/3325501974 shutdown_connections 2024-09-21T17:41:56.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:41:56.373+0000 7efce94ad640 1 -- 172.21.15.162:0/3325501974 wait complete. 2024-09-21T17:41:56.968 DEBUG:teuthology.orchestra.run.smithi162:mgr.x> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mgr.x.service 2024-09-21T17:41:56.970 DEBUG:tasks.cephadm:set 0 configs 2024-09-21T17:41:56.970 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T17:41:56.970 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:41:56.970 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T17:41:56.988 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T17:41:56.989 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-09-21T17:41:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T17:41:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T17:41:57.045 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 968 Links: 1 2024-09-21T17:41:57.045 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T17:41:57.045 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T17:41:57.045 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-21 17:41:45.778562657 +0000 2024-09-21T17:41:57.045 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.046 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.046 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T17:41:57.113 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-21T17:41:57.113 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-21T17:41:57.113 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000118238 s, 4.3 MB/s 2024-09-21T17:41:57.114 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T17:41:57.172 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-09-21T17:41:57.229 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T17:41:57.229 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T17:41:57.229 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 966 Links: 1 2024-09-21T17:41:57.229 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T17:41:57.229 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T17:41:57.229 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-21 17:41:45.779562650 +0000 2024-09-21T17:41:57.229 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.229 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.229 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.230 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T17:41:57.294 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-21T17:41:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-21T17:41:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000112408 s, 4.6 MB/s 2024-09-21T17:41:57.296 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T17:41:57.353 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-09-21T17:41:57.411 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T17:41:57.411 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T17:41:57.411 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 969 Links: 1 2024-09-21T17:41:57.411 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T17:41:57.411 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T17:41:57.412 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-21 17:41:45.779562650 +0000 2024-09-21T17:41:57.412 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.412 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.412 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.412 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T17:41:57.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-21T17:41:57.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-21T17:41:57.476 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 9.8099e-05 s, 5.2 MB/s 2024-09-21T17:41:57.478 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T17:41:57.535 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-09-21T17:41:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:57 smithi162 ceph-mon[32106]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:57 smithi162 ceph-mon[32106]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi042=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:57 smithi162 ceph-mon[32106]: Saving service mgr spec with placement smithi042=y;smithi162=x;count:2 2024-09-21T17:41:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:57 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:57 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:57 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:57 smithi162 ceph-mon[32106]: Reconfiguring mon.b (monmap changed)... 2024-09-21T17:41:57.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:57 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:57.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:57 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T17:41:57.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:57 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:57.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:57 smithi162 ceph-mon[32106]: Reconfiguring daemon mon.b on smithi162 2024-09-21T17:41:57.591 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T17:41:57.591 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T17:41:57.591 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 977 Links: 1 2024-09-21T17:41:57.592 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T17:41:57.592 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T17:41:57.592 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-21 17:41:45.780562642 +0000 2024-09-21T17:41:57.592 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.592 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.592 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-21 17:36:40.276937526 +0000 2024-09-21T17:41:57.592 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T17:41:57.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[38309]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:57.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[38309]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi042=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:57.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[38309]: Saving service mgr spec with placement smithi042=y;smithi162=x;count:2 2024-09-21T17:41:57.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:57.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:57.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:57.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[38309]: Reconfiguring mon.b (monmap changed)... 2024-09-21T17:41:57.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:57.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T17:41:57.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:57.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[38309]: Reconfiguring daemon mon.b on smithi162 2024-09-21T17:41:57.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[29361]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:57.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[29361]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi042=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:41:57.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[29361]: Saving service mgr spec with placement smithi042=y;smithi162=x;count:2 2024-09-21T17:41:57.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:57.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:57.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:57.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[29361]: Reconfiguring mon.b (monmap changed)... 2024-09-21T17:41:57.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T17:41:57.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T17:41:57.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:57.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:57 smithi042 ceph-mon[29361]: Reconfiguring daemon mon.b on smithi162 2024-09-21T17:41:57.655 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-21T17:41:57.655 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-21T17:41:57.655 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000100566 s, 5.1 MB/s 2024-09-21T17:41:57.656 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T17:41:57.713 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:41:57.713 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T17:41:57.729 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T17:41:57.729 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-21T17:41:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T17:41:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T17:41:57.784 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 974 Links: 1 2024-09-21T17:41:57.784 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T17:41:57.785 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T17:41:57.785 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 17:41:37.415370296 +0000 2024-09-21T17:41:57.785 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 17:36:40.949520484 +0000 2024-09-21T17:41:57.785 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 17:36:40.949520484 +0000 2024-09-21T17:41:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 17:36:40.949520484 +0000 2024-09-21T17:41:57.785 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T17:41:57.848 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T17:41:57.848 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T17:41:57.848 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000251483 s, 2.0 MB/s 2024-09-21T17:41:57.849 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T17:41:57.905 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-21T17:41:57.961 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T17:41:57.961 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T17:41:57.961 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 982 Links: 1 2024-09-21T17:41:57.962 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T17:41:57.962 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T17:41:57.962 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 17:41:37.415370296 +0000 2024-09-21T17:41:57.962 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 17:36:40.950520421 +0000 2024-09-21T17:41:57.962 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 17:36:40.950520421 +0000 2024-09-21T17:41:57.962 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 17:36:40.950520421 +0000 2024-09-21T17:41:57.962 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T17:41:58.026 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T17:41:58.026 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T17:41:58.026 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.00018606 s, 2.8 MB/s 2024-09-21T17:41:58.027 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T17:41:58.084 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-21T17:41:58.140 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T17:41:58.140 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T17:41:58.141 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 975 Links: 1 2024-09-21T17:41:58.141 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T17:41:58.141 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T17:41:58.141 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 17:41:37.415370296 +0000 2024-09-21T17:41:58.141 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 17:36:40.950520421 +0000 2024-09-21T17:41:58.141 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 17:36:40.950520421 +0000 2024-09-21T17:41:58.141 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 17:36:40.950520421 +0000 2024-09-21T17:41:58.141 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T17:41:58.206 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T17:41:58.207 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T17:41:58.207 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000210131 s, 2.4 MB/s 2024-09-21T17:41:58.208 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T17:41:58.266 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-21T17:41:58.321 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T17:41:58.321 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T17:41:58.322 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 963 Links: 1 2024-09-21T17:41:58.322 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T17:41:58.322 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T17:41:58.322 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 17:41:37.416370275 +0000 2024-09-21T17:41:58.322 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 17:36:40.949520484 +0000 2024-09-21T17:41:58.322 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 17:36:40.949520484 +0000 2024-09-21T17:41:58.322 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 17:36:40.949520484 +0000 2024-09-21T17:41:58.322 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T17:41:58.385 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T17:41:58.385 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T17:41:58.385 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000189979 s, 2.7 MB/s 2024-09-21T17:41:58.386 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T17:41:58.442 INFO:tasks.cephadm:Deploying osd.0 on smithi042 with /dev/vg_nvme/lv_4... 2024-09-21T17:41:58.443 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T17:41:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:41:59.160 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:59.160 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:59.160 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: Deploying daemon mgr.x on smithi162 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[29361]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:59.161 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:59.162 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:59.162 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:41:59.162 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:59.162 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T17:41:59.162 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T17:41:59.162 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T17:41:59.162 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:59.162 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: Deploying daemon mgr.x on smithi162 2024-09-21T17:41:59.162 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:41:58 smithi042 ceph-mon[38309]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:59.235 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:59.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:59.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:41:59.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:59.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:41:59.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:41:59.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T17:41:59.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T17:41:59.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T17:41:59.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:41:59.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: Deploying daemon mgr.x on smithi162 2024-09-21T17:41:59.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:41:58 smithi162 ceph-mon[32106]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:41:59.826 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:41:59 smithi162 systemd[1]: Starting Ceph mgr.x for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:42:00.182 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:41:59 smithi162 podman[33587]: 2024-09-21 17:41:59.919552566 +0000 UTC m=+0.108766101 container create ae207f0f42531984e946c51fb910d73a69694864043bf49d1898a52ce74f1413 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T17:42:00.182 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:41:59 smithi162 podman[33587]: 2024-09-21 17:41:59.826705691 +0000 UTC m=+0.015919201 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5 2024-09-21T17:42:00.182 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:42:00 smithi162 podman[33587]: 2024-09-21 17:42:00.097108193 +0000 UTC m=+0.286321697 container init ae207f0f42531984e946c51fb910d73a69694864043bf49d1898a52ce74f1413 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T17:42:00.182 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:42:00 smithi162 podman[33587]: 2024-09-21 17:42:00.09988331 +0000 UTC m=+0.289096800 container start ae207f0f42531984e946c51fb910d73a69694864043bf49d1898a52ce74f1413 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T17:42:00.182 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:42:00 smithi162 ceph-mgr[33606]: -- 172.21.15.162:0/2866052355 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ac1a37d0e0 con 0x55ac1a35b400 2024-09-21T17:42:00.182 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:42:00 smithi162 bash[33587]: ae207f0f42531984e946c51fb910d73a69694864043bf49d1898a52ce74f1413 2024-09-21T17:42:00.575 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:42:00 smithi162 systemd[1]: Started Ceph mgr.x for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:42:01.058 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:42:01.086 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi042:vg_nvme/lv_4 2024-09-21T17:42:01.344 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:42:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:01 smithi162 ceph-mon[32106]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:01 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:01 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:01 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:01 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:01 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:01.608 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[29361]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:01.608 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.608 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.608 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.608 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.608 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:01.608 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[38309]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:01.608 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.609 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.609 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.609 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:01.609 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:01 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:01.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.833+0000 7f3991029640 1 -- 172.21.15.42:0/3806555839 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f398c103400 msgr2=0x7f398c109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:01.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.833+0000 7f3991029640 1 --2- 172.21.15.42:0/3806555839 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f398c103400 0x7f398c109d80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3984009d00 tx=0x7f398402a910 comp rx=0 tx=0).stop 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.833+0000 7f3991029640 1 -- 172.21.15.42:0/3806555839 shutdown_connections 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.833+0000 7f3991029640 1 --2- 172.21.15.42:0/3806555839 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f398c103400 0x7f398c109d80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.833+0000 7f3991029640 1 --2- 172.21.15.42:0/3806555839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f398c102a40 0x7f398c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.833+0000 7f3991029640 1 --2- 172.21.15.42:0/3806555839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f398c1018e0 0x7f398c101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.833+0000 7f3991029640 1 -- 172.21.15.42:0/3806555839 >> 172.21.15.42:0/3806555839 conn(0x7f398c0fd1b0 msgr2=0x7f398c0ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.833+0000 7f3991029640 1 -- 172.21.15.42:0/3806555839 shutdown_connections 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.833+0000 7f3991029640 1 -- 172.21.15.42:0/3806555839 wait complete. 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f3991029640 1 Processor -- start 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f3991029640 1 -- start start 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f3991029640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f398c1018e0 0x7f398c06b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f3991029640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f398c102a40 0x7f398c19d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f3991029640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f398c103400 0x7f398c19f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f3991029640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f398c10cc50 con 0x7f398c1018e0 2024-09-21T17:42:01.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f3991029640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f398c10cad0 con 0x7f398c102a40 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f3991029640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f398c10cdd0 con 0x7f398c103400 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f398ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f398c1018e0 0x7f398c06b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f398b59e640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f398c103400 0x7f398c19f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f398b59e640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f398c103400 0x7f398c19f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:60894/0 (socket says 172.21.15.42:60894) 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f398ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f398c1018e0 0x7f398c06b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54804/0 (socket says 172.21.15.42:54804) 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.834+0000 7f398b59e640 1 -- 172.21.15.42:0/1438430377 learned_addr learned my addr 172.21.15.42:0/1438430377 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f398a59c640 1 --2- 172.21.15.42:0/1438430377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f398c102a40 0x7f398c19d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f398b59e640 1 -- 172.21.15.42:0/1438430377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f398c102a40 msgr2=0x7f398c19d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f398b59e640 1 --2- 172.21.15.42:0/1438430377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f398c102a40 0x7f398c19d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f398b59e640 1 -- 172.21.15.42:0/1438430377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f398c1018e0 msgr2=0x7f398c06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f398b59e640 1 --2- 172.21.15.42:0/1438430377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f398c1018e0 0x7f398c06b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f398b59e640 1 -- 172.21.15.42:0/1438430377 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c1a0040 con 0x7f398c103400 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f398b59e640 1 --2- 172.21.15.42:0/1438430377 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f398c103400 0x7f398c19f780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3984031830 tx=0x7f3984003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:42:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f3973fff640 1 -- 172.21.15.42:0/1438430377 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39840307d0 con 0x7f398c103400 2024-09-21T17:42:01.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f3991029640 1 -- 172.21.15.42:0/1438430377 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398c196f60 con 0x7f398c103400 2024-09-21T17:42:01.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f3973fff640 1 -- 172.21.15.42:0/1438430377 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f3984032e90 con 0x7f398c103400 2024-09-21T17:42:01.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f3973fff640 1 -- 172.21.15.42:0/1438430377 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984004820 con 0x7f398c103400 2024-09-21T17:42:01.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.835+0000 7f3991029640 1 -- 172.21.15.42:0/1438430377 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f398c1974a0 con 0x7f398c103400 2024-09-21T17:42:01.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.836+0000 7f3973fff640 1 -- 172.21.15.42:0/1438430377 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 14) ==== 51863+0+0 (secure 0 0 0) 0x7f398404e440 con 0x7f398c103400 2024-09-21T17:42:01.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.836+0000 7f3991029640 1 -- 172.21.15.42:0/1438430377 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f398c101ce0 con 0x7f398c103400 2024-09-21T17:42:01.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.836+0000 7f3973fff640 1 --2- 172.21.15.42:0/1438430377 >> v2:172.21.15.42:6800/92962027 conn(0x7f397403fae0 0x7f3974041fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:01.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.837+0000 7f3973fff640 1 -- 172.21.15.42:0/1438430377 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f39840758b0 con 0x7f398c103400 2024-09-21T17:42:01.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.837+0000 7f398ad9d640 1 --2- 172.21.15.42:0/1438430377 >> v2:172.21.15.42:6800/92962027 conn(0x7f397403fae0 0x7f3974041fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:01.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.837+0000 7f398ad9d640 1 --2- 172.21.15.42:0/1438430377 >> v2:172.21.15.42:6800/92962027 conn(0x7f397403fae0 0x7f3974041fa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f397c0095f0 tx=0x7f397c012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:42:01.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:01.842+0000 7f3973fff640 1 -- 172.21.15.42:0/1438430377 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f39840393b0 con 0x7f398c103400 2024-09-21T17:42:02.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:02.042+0000 7f3991029640 1 -- 172.21.15.42:0/1438430377 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f398c02e980 con 0x7f397403fae0 2024-09-21T17:42:02.661 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:02.661 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:02.661 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: Reconfiguring mgr.y (unknown last config time)... 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: Reconfiguring daemon mgr.y on smithi042 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:02.662 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:02.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:02.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:02.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:02.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: Reconfiguring mgr.y (unknown last config time)... 2024-09-21T17:42:02.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T17:42:02.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T17:42:02.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:02.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: Reconfiguring daemon mgr.y on smithi042 2024-09-21T17:42:02.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:42:02.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:42:02.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: Reconfiguring mgr.y (unknown last config time)... 2024-09-21T17:42:02.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T17:42:02.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T17:42:02.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:02.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: Reconfiguring daemon mgr.y on smithi042 2024-09-21T17:42:02.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:42:02.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:42:02.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:03.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[29361]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:42:03.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[29361]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:03.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:03.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:03.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:03.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:03.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:03.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:03.445 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[38309]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:42:03.445 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[38309]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:03.445 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:03.445 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:03.445 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:03.445 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:03.445 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:03.445 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:03 smithi162 ceph-mon[32106]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:42:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:03 smithi162 ceph-mon[32106]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:04 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:04 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:05.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:04 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:05.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3042811312' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9400dd6c-acd8-4ab6-a2a0-7ae899d85554"} : dispatch 2024-09-21T17:42:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9400dd6c-acd8-4ab6-a2a0-7ae899d85554"} : dispatch 2024-09-21T17:42:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9400dd6c-acd8-4ab6-a2a0-7ae899d85554"}]': finished 2024-09-21T17:42:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T17:42:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: Standby manager daemon x started 2024-09-21T17:42:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T17:42:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T17:42:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T17:42:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T17:42:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/786357968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3042811312' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9400dd6c-acd8-4ab6-a2a0-7ae899d85554"} : dispatch 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9400dd6c-acd8-4ab6-a2a0-7ae899d85554"} : dispatch 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9400dd6c-acd8-4ab6-a2a0-7ae899d85554"}]': finished 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: Standby manager daemon x started 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T17:42:05.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:05 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/786357968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:42:05.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:05.953+0000 7f3973fff640 1 -- 172.21.15.42:0/1438430377 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mgrmap(e 15) ==== 103142+0+0 (secure 0 0 0) 0x7f3984077d10 con 0x7f398c103400 2024-09-21T17:42:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3042811312' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9400dd6c-acd8-4ab6-a2a0-7ae899d85554"} : dispatch 2024-09-21T17:42:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9400dd6c-acd8-4ab6-a2a0-7ae899d85554"} : dispatch 2024-09-21T17:42:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9400dd6c-acd8-4ab6-a2a0-7ae899d85554"}]': finished 2024-09-21T17:42:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T17:42:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: Standby manager daemon x started 2024-09-21T17:42:06.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T17:42:06.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T17:42:06.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T17:42:06.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: from='mgr.? 172.21.15.162:0/3326740457' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T17:42:06.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:05 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/786357968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:42:07.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:06 smithi162 ceph-mon[32106]: mgrmap e15: y(active, since 57s), standbys: x 2024-09-21T17:42:07.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:06 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T17:42:07.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:06 smithi042 ceph-mon[29361]: mgrmap e15: y(active, since 57s), standbys: x 2024-09-21T17:42:07.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:06 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T17:42:07.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:06 smithi042 ceph-mon[38309]: mgrmap e15: y(active, since 57s), standbys: x 2024-09-21T17:42:07.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:06 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T17:42:08.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:07 smithi162 ceph-mon[32106]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:08.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:07 smithi042 ceph-mon[29361]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:08.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:07 smithi042 ceph-mon[38309]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:10.084 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:09 smithi042 ceph-mon[29361]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:10.085 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:09 smithi042 ceph-mon[38309]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:10.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:09 smithi162 ceph-mon[32106]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:11.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:10 smithi042 ceph-mon[29361]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:11.100 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:10 smithi042 ceph-mon[38309]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:11.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:10 smithi162 ceph-mon[32106]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:12.238 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:11 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T17:42:12.238 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:11 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:12.238 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:11 smithi042 ceph-mon[38309]: Deploying daemon osd.0 on smithi042 2024-09-21T17:42:12.238 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:11 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T17:42:12.238 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:11 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:12.238 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:11 smithi042 ceph-mon[29361]: Deploying daemon osd.0 on smithi042 2024-09-21T17:42:12.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:11 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T17:42:12.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:11 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:12.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:11 smithi162 ceph-mon[32106]: Deploying daemon osd.0 on smithi042 2024-09-21T17:42:13.240 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:12 smithi042 ceph-mon[29361]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:13.241 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:12 smithi042 ceph-mon[38309]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:13.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:12 smithi162 ceph-mon[32106]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:15 smithi042 ceph-mon[29361]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:15.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:15 smithi042 ceph-mon[38309]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:15 smithi162 ceph-mon[32106]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:17.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:17 smithi042 ceph-mon[29361]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:17.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:17 smithi042 ceph-mon[38309]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:17 smithi162 ceph-mon[32106]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:19.569 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:19 smithi042 ceph-mon[29361]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:19.569 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:19 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:19.569 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:19 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:19.570 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:19 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:19.570 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:19 smithi042 ceph-mon[38309]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:19.570 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:19 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:19.570 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:19 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:19.570 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:19 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:19 smithi162 ceph-mon[32106]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:19 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:19 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:19 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.636+0000 7f3973fff640 1 -- 172.21.15.42:0/1438430377 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f398c02e980 con 0x7f397403fae0 2024-09-21T17:42:21.639 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 0 on host 'smithi042' 2024-09-21T17:42:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.638+0000 7f3991029640 1 -- 172.21.15.42:0/1438430377 >> v2:172.21.15.42:6800/92962027 conn(0x7f397403fae0 msgr2=0x7f3974041fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.638+0000 7f3991029640 1 --2- 172.21.15.42:0/1438430377 >> v2:172.21.15.42:6800/92962027 conn(0x7f397403fae0 0x7f3974041fa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f397c0095f0 tx=0x7f397c012040 comp rx=0 tx=0).stop 2024-09-21T17:42:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.638+0000 7f3991029640 1 -- 172.21.15.42:0/1438430377 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f398c103400 msgr2=0x7f398c19f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.638+0000 7f3991029640 1 --2- 172.21.15.42:0/1438430377 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f398c103400 0x7f398c19f780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3984031830 tx=0x7f3984003c20 comp rx=0 tx=0).stop 2024-09-21T17:42:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.638+0000 7f3991029640 1 -- 172.21.15.42:0/1438430377 shutdown_connections 2024-09-21T17:42:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.638+0000 7f3991029640 1 --2- 172.21.15.42:0/1438430377 >> v2:172.21.15.42:6800/92962027 conn(0x7f397403fae0 0x7f3974041fa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.638+0000 7f3991029640 1 --2- 172.21.15.42:0/1438430377 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f398c103400 0x7f398c19f780 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.638+0000 7f3991029640 1 --2- 172.21.15.42:0/1438430377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f398c102a40 0x7f398c19d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.638+0000 7f3991029640 1 --2- 172.21.15.42:0/1438430377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f398c1018e0 0x7f398c06b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.638+0000 7f3991029640 1 -- 172.21.15.42:0/1438430377 >> 172.21.15.42:0/1438430377 conn(0x7f398c0fd1b0 msgr2=0x7f398c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:42:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.639+0000 7f3991029640 1 -- 172.21.15.42:0/1438430377 shutdown_connections 2024-09-21T17:42:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:21.639+0000 7f3991029640 1 -- 172.21.15.42:0/1438430377 wait complete. 2024-09-21T17:42:21.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[29361]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[38309]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:21.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:21.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:21.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:21.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:21.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:21.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:21 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:21 smithi162 ceph-mon[32106]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:21 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:22.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:21 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:22.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:21 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:22.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:21 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:22.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:21 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:22.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:21 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:22.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:21 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:22.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:21 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:22.244 DEBUG:teuthology.orchestra.run.smithi042:osd.0> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.0.service 2024-09-21T17:42:22.247 INFO:tasks.cephadm:Deploying osd.1 on smithi042 with /dev/vg_nvme/lv_3... 2024-09-21T17:42:22.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T17:42:23.292 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:42:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0[41623]: 2024-09-21T17:42:23.284+0000 7f4371f59640 -1 osd.0 0 log_to_monitors true 2024-09-21T17:42:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:42:23.869 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:23 smithi042 ceph-mon[38309]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:23.869 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:23 smithi042 ceph-mon[38309]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T17:42:23.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:23 smithi042 ceph-mon[29361]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:23.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:23 smithi042 ceph-mon[29361]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T17:42:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:23 smithi162 ceph-mon[32106]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:23 smithi162 ceph-mon[32106]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T17:42:25.062 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0[41623]: 2024-09-21T17:42:24.984+0000 7f436dedc640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T17:42:25.062 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0[41623]: 2024-09-21T17:42:24.986+0000 7f4365cfb640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T17:42:25.063 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[29361]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T17:42:25.063 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[29361]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T17:42:25.063 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[29361]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:42:25.063 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:25.063 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[29361]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:42:25.063 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[29361]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T17:42:25.063 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:25.063 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[38309]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T17:42:25.063 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[38309]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T17:42:25.064 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[38309]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:42:25.064 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:25.064 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[38309]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:42:25.064 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[38309]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T17:42:25.064 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:24 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:24 smithi162 ceph-mon[32106]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T17:42:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:24 smithi162 ceph-mon[32106]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T17:42:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:24 smithi162 ceph-mon[32106]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:42:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:24 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:24 smithi162 ceph-mon[32106]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:42:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:24 smithi162 ceph-mon[32106]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T17:42:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:24 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:25.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[29361]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:42:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[29361]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' 2024-09-21T17:42:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[38309]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:42:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[38309]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' 2024-09-21T17:42:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:25 smithi162 ceph-mon[32106]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:26.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:42:26.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:26.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:26.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:26.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:26.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:25 smithi162 ceph-mon[32106]: from='osd.0 v2:172.21.15.42:6801/443738680' entity='osd.0' 2024-09-21T17:42:26.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:26.700 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:42:26.727 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi042:vg_nvme/lv_3 2024-09-21T17:42:26.984 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:42:27.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:26 smithi162 ceph-mon[32106]: purged_snaps scrub starts 2024-09-21T17:42:27.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:26 smithi162 ceph-mon[32106]: purged_snaps scrub ok 2024-09-21T17:42:27.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:26 smithi162 ceph-mon[32106]: Detected new or changed devices on smithi042 2024-09-21T17:42:27.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:26 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi042 to 16068M 2024-09-21T17:42:27.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:26 smithi162 ceph-mon[32106]: osd.0 v2:172.21.15.42:6801/443738680 boot 2024-09-21T17:42:27.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:26 smithi162 ceph-mon[32106]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T17:42:27.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:26 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:27.106 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[29361]: purged_snaps scrub starts 2024-09-21T17:42:27.106 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[29361]: purged_snaps scrub ok 2024-09-21T17:42:27.106 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[29361]: Detected new or changed devices on smithi042 2024-09-21T17:42:27.106 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi042 to 16068M 2024-09-21T17:42:27.106 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[29361]: osd.0 v2:172.21.15.42:6801/443738680 boot 2024-09-21T17:42:27.106 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[29361]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T17:42:27.106 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:27.106 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[38309]: purged_snaps scrub starts 2024-09-21T17:42:27.107 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[38309]: purged_snaps scrub ok 2024-09-21T17:42:27.107 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[38309]: Detected new or changed devices on smithi042 2024-09-21T17:42:27.107 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi042 to 16068M 2024-09-21T17:42:27.107 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[38309]: osd.0 v2:172.21.15.42:6801/443738680 boot 2024-09-21T17:42:27.107 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[38309]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T17:42:27.107 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:26 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:42:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.392+0000 7fbc3cab6640 1 -- 172.21.15.42:0/2366602691 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc381018e0 msgr2=0x7fbc38101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.392+0000 7fbc3cab6640 1 --2- 172.21.15.42:0/2366602691 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc381018e0 0x7fbc38101ce0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbc280098c0 tx=0x7fbc2802a390 comp rx=0 tx=0).stop 2024-09-21T17:42:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.392+0000 7fbc3cab6640 1 -- 172.21.15.42:0/2366602691 shutdown_connections 2024-09-21T17:42:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.392+0000 7fbc3cab6640 1 --2- 172.21.15.42:0/2366602691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc38103400 0x7fbc38109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.392+0000 7fbc3cab6640 1 --2- 172.21.15.42:0/2366602691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc38102a40 0x7fbc38102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.392+0000 7fbc3cab6640 1 --2- 172.21.15.42:0/2366602691 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc381018e0 0x7fbc38101ce0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.392+0000 7fbc3cab6640 1 -- 172.21.15.42:0/2366602691 >> 172.21.15.42:0/2366602691 conn(0x7fbc380fd1b0 msgr2=0x7fbc380ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:42:27.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.392+0000 7fbc3cab6640 1 -- 172.21.15.42:0/2366602691 shutdown_connections 2024-09-21T17:42:27.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.392+0000 7fbc3cab6640 1 -- 172.21.15.42:0/2366602691 wait complete. 2024-09-21T17:42:27.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc3cab6640 1 Processor -- start 2024-09-21T17:42:27.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc3cab6640 1 -- start start 2024-09-21T17:42:27.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc3cab6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc381018e0 0x7fbc38198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:27.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc3cab6640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc38102a40 0x7fbc38198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc3cab6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc38103400 0x7fbc381997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc3cab6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3810cc10 con 0x7fbc381018e0 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc3cab6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3810ca90 con 0x7fbc38103400 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc3cab6640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3810cd90 con 0x7fbc38102a40 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc3659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc381018e0 0x7fbc38198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc2ffff640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc38102a40 0x7fbc38198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc3659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc381018e0 0x7fbc38198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36296/0 (socket says 172.21.15.42:36296) 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.393+0000 7fbc3659c640 1 -- 172.21.15.42:0/707546510 learned_addr learned my addr 172.21.15.42:0/707546510 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc36d9d640 1 --2- 172.21.15.42:0/707546510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc38103400 0x7fbc381997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc3659c640 1 -- 172.21.15.42:0/707546510 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc38102a40 msgr2=0x7fbc38198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc3659c640 1 --2- 172.21.15.42:0/707546510 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc38102a40 0x7fbc38198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc3659c640 1 -- 172.21.15.42:0/707546510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc38103400 msgr2=0x7fbc381997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc3659c640 1 --2- 172.21.15.42:0/707546510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc38103400 0x7fbc381997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc3659c640 1 -- 172.21.15.42:0/707546510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3819a050 con 0x7fbc381018e0 2024-09-21T17:42:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc2ffff640 1 --2- 172.21.15.42:0/707546510 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc38102a40 0x7fbc38198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:42:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc3659c640 1 --2- 172.21.15.42:0/707546510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc381018e0 0x7fbc38198520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009890 tx=0x7fbc28032ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:42:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/707546510 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28040070 con 0x7fbc381018e0 2024-09-21T17:42:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc3cab6640 1 -- 172.21.15.42:0/707546510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3819a2e0 con 0x7fbc381018e0 2024-09-21T17:42:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/707546510 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fbc28005550 con 0x7fbc381018e0 2024-09-21T17:42:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/707546510 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28037040 con 0x7fbc381018e0 2024-09-21T17:42:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.394+0000 7fbc3cab6640 1 -- 172.21.15.42:0/707546510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc381a0a20 con 0x7fbc381018e0 2024-09-21T17:42:27.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.395+0000 7fbc3cab6640 1 -- 172.21.15.42:0/707546510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc38101ce0 con 0x7fbc381018e0 2024-09-21T17:42:27.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.396+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/707546510 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 15) ==== 103142+0+0 (secure 0 0 0) 0x7fbc28043070 con 0x7fbc381018e0 2024-09-21T17:42:27.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.396+0000 7fbc2f7fe640 1 --2- 172.21.15.42:0/707546510 >> v2:172.21.15.42:6800/92962027 conn(0x7fbc2407af90 0x7fbc2407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:27.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.397+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/707546510 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1541+0+0 (secure 0 0 0) 0x7fbc280bc1e0 con 0x7fbc381018e0 2024-09-21T17:42:27.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.397+0000 7fbc2ffff640 1 --2- 172.21.15.42:0/707546510 >> v2:172.21.15.42:6800/92962027 conn(0x7fbc2407af90 0x7fbc2407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:27.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.397+0000 7fbc2ffff640 1 --2- 172.21.15.42:0/707546510 >> v2:172.21.15.42:6800/92962027 conn(0x7fbc2407af90 0x7fbc2407d450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbc20005fd0 tx=0x7fbc2000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:42:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.401+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/707546510 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fbc28088ac0 con 0x7fbc381018e0 2024-09-21T17:42:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:27.599+0000 7fbc3cab6640 1 -- 172.21.15.42:0/707546510 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbc3802e730 con 0x7fbc2407af90 2024-09-21T17:42:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:27 smithi162 ceph-mon[32106]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:27 smithi162 ceph-mon[32106]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T17:42:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:27 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:42:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:27 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:42:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:27 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:28.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:27 smithi042 ceph-mon[29361]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:28.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:27 smithi042 ceph-mon[29361]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T17:42:28.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:27 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:42:28.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:27 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:42:28.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:27 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:28.087 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:27 smithi042 ceph-mon[38309]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T17:42:28.087 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:27 smithi042 ceph-mon[38309]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T17:42:28.087 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:27 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:42:28.087 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:27 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:42:28.087 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:27 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:28 smithi042 ceph-mon[29361]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:42:28.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:28 smithi042 ceph-mon[38309]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:42:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:28 smithi162 ceph-mon[32106]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:42:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:29 smithi042 ceph-mon[29361]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:29 smithi042 ceph-mon[38309]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:29 smithi162 ceph-mon[32106]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3574585723' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "087fa35f-aafd-4879-8b78-d47dc2a7f5c2"} : dispatch 2024-09-21T17:42:31.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "087fa35f-aafd-4879-8b78-d47dc2a7f5c2"} : dispatch 2024-09-21T17:42:31.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "087fa35f-aafd-4879-8b78-d47dc2a7f5c2"}]': finished 2024-09-21T17:42:31.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:30 smithi162 ceph-mon[32106]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T17:42:31.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:30 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:31.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1000372601' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:42:31.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3574585723' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "087fa35f-aafd-4879-8b78-d47dc2a7f5c2"} : dispatch 2024-09-21T17:42:31.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "087fa35f-aafd-4879-8b78-d47dc2a7f5c2"} : dispatch 2024-09-21T17:42:31.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "087fa35f-aafd-4879-8b78-d47dc2a7f5c2"}]': finished 2024-09-21T17:42:31.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[29361]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T17:42:31.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:31.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1000372601' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:42:31.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3574585723' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "087fa35f-aafd-4879-8b78-d47dc2a7f5c2"} : dispatch 2024-09-21T17:42:31.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "087fa35f-aafd-4879-8b78-d47dc2a7f5c2"} : dispatch 2024-09-21T17:42:31.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "087fa35f-aafd-4879-8b78-d47dc2a7f5c2"}]': finished 2024-09-21T17:42:31.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[38309]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T17:42:31.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:31.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1000372601' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:42:32.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:31 smithi042 ceph-mon[29361]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:32.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:31 smithi042 ceph-mon[38309]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:32.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:31 smithi162 ceph-mon[32106]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:33.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:33 smithi042 ceph-mon[29361]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:33.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:33 smithi042 ceph-mon[38309]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:34.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:33 smithi162 ceph-mon[32106]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:35.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:35 smithi042 ceph-mon[29361]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:35.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:35 smithi042 ceph-mon[38309]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:36.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:35 smithi162 ceph-mon[32106]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:38.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:37 smithi042 ceph-mon[29361]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:38.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:37 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T17:42:38.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:37 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:38.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:37 smithi042 ceph-mon[38309]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:38.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:37 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T17:42:38.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:37 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:38.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:37 smithi162 ceph-mon[32106]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:38.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T17:42:38.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:39.152 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:38 smithi042 ceph-mon[29361]: Deploying daemon osd.1 on smithi042 2024-09-21T17:42:39.152 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:38 smithi042 ceph-mon[38309]: Deploying daemon osd.1 on smithi042 2024-09-21T17:42:39.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:38 smithi162 ceph-mon[32106]: Deploying daemon osd.1 on smithi042 2024-09-21T17:42:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:39 smithi042 ceph-mon[38309]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:39 smithi042 ceph-mon[29361]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:40.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:39 smithi162 ceph-mon[32106]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:42.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:41 smithi042 ceph-mon[38309]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:42.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:41 smithi042 ceph-mon[29361]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:42.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:41 smithi162 ceph-mon[32106]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:44.062 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:43 smithi042 ceph-mon[29361]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:44.062 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:44.063 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:44.063 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:44.063 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:43 smithi042 ceph-mon[38309]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:44.063 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:43 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:44.063 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:43 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:44.063 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:43 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:44.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:43 smithi162 ceph-mon[32106]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:44.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:44.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:44.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:46.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[38309]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:46.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[29361]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:46.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:46.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:46.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:46.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:46.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:45 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:45 smithi162 ceph-mon[32106]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:45 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:45 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:45 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:45 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:45 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.881+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/707546510 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbc3802e730 con 0x7fbc2407af90 2024-09-21T17:42:46.882 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 1 on host 'smithi042' 2024-09-21T17:42:46.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 -- 172.21.15.42:0/707546510 >> v2:172.21.15.42:6800/92962027 conn(0x7fbc2407af90 msgr2=0x7fbc2407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:46.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 --2- 172.21.15.42:0/707546510 >> v2:172.21.15.42:6800/92962027 conn(0x7fbc2407af90 0x7fbc2407d450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbc20005fd0 tx=0x7fbc2000b390 comp rx=0 tx=0).stop 2024-09-21T17:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 -- 172.21.15.42:0/707546510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc381018e0 msgr2=0x7fbc38198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 --2- 172.21.15.42:0/707546510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc381018e0 0x7fbc38198520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009890 tx=0x7fbc28032ca0 comp rx=0 tx=0).stop 2024-09-21T17:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 -- 172.21.15.42:0/707546510 shutdown_connections 2024-09-21T17:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 --2- 172.21.15.42:0/707546510 >> v2:172.21.15.42:6800/92962027 conn(0x7fbc2407af90 0x7fbc2407d450 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 --2- 172.21.15.42:0/707546510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc38103400 0x7fbc381997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 --2- 172.21.15.42:0/707546510 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc38102a40 0x7fbc38198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 --2- 172.21.15.42:0/707546510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc381018e0 0x7fbc38198520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 -- 172.21.15.42:0/707546510 >> 172.21.15.42:0/707546510 conn(0x7fbc380fd1b0 msgr2=0x7fbc3806b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 -- 172.21.15.42:0/707546510 shutdown_connections 2024-09-21T17:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:46.884+0000 7fbc3cab6640 1 -- 172.21.15.42:0/707546510 wait complete. 2024-09-21T17:42:47.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:47.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:47.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:46 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:47.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:46 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:47.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:46 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:47.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:46 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:47.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:46 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:42:47.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:46 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:47.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:46 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:47.496 DEBUG:teuthology.orchestra.run.smithi042:osd.1> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.1.service 2024-09-21T17:42:47.498 INFO:tasks.cephadm:Deploying osd.2 on smithi042 with /dev/vg_nvme/lv_2... 2024-09-21T17:42:47.498 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T17:42:48.013 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:47 smithi042 ceph-mon[29361]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:48.013 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:47 smithi042 ceph-mon[29361]: from='osd.1 v2:172.21.15.42:6805/555179714' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T17:42:48.013 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:47 smithi042 ceph-mon[29361]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T17:42:48.013 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:47 smithi042 ceph-mon[38309]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:48.013 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:47 smithi042 ceph-mon[38309]: from='osd.1 v2:172.21.15.42:6805/555179714' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T17:42:48.014 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:47 smithi042 ceph-mon[38309]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T17:42:48.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:47 smithi162 ceph-mon[32106]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:48.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:47 smithi162 ceph-mon[32106]: from='osd.1 v2:172.21.15.42:6805/555179714' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T17:42:48.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:47 smithi162 ceph-mon[32106]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T17:42:48.537 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:42:49.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-mon[29361]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T17:42:49.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-mon[29361]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T17:42:49.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:49.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-mon[29361]: from='osd.1 v2:172.21.15.42:6805/555179714' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:42:49.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-mon[29361]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:42:49.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-mon[38309]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T17:42:49.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-mon[38309]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T17:42:49.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:49.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-mon[38309]: from='osd.1 v2:172.21.15.42:6805/555179714' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:42:49.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-mon[38309]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:42:49.165 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1[46957]: 2024-09-21T17:42:48.905+0000 7fe4a8c9f640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T17:42:49.165 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:42:48 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1[46957]: 2024-09-21T17:42:48.908+0000 7fe4a4ac6640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T17:42:49.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:48 smithi162 ceph-mon[32106]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T17:42:49.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:48 smithi162 ceph-mon[32106]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T17:42:49.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:48 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:49.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:48 smithi162 ceph-mon[32106]: from='osd.1 v2:172.21.15.42:6805/555179714' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:42:49.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:48 smithi162 ceph-mon[32106]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:42:50.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:49 smithi042 ceph-mon[29361]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:49 smithi042 ceph-mon[29361]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:42:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:49 smithi042 ceph-mon[29361]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T17:42:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:49 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:49 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:49 smithi042 ceph-mon[38309]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:49 smithi042 ceph-mon[38309]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:42:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:49 smithi042 ceph-mon[38309]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T17:42:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:49 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:49 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:50.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:49 smithi162 ceph-mon[32106]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T17:42:50.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:49 smithi162 ceph-mon[32106]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:42:50.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:49 smithi162 ceph-mon[32106]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T17:42:50.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:49 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:50.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:49 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:51.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:50 smithi042 ceph-mon[29361]: purged_snaps scrub starts 2024-09-21T17:42:51.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:50 smithi042 ceph-mon[29361]: purged_snaps scrub ok 2024-09-21T17:42:51.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:50 smithi042 ceph-mon[29361]: osd.1 v2:172.21.15.42:6805/555179714 boot 2024-09-21T17:42:51.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:50 smithi042 ceph-mon[29361]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T17:42:51.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:50 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:51.030 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:50 smithi042 ceph-mon[38309]: purged_snaps scrub starts 2024-09-21T17:42:51.030 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:50 smithi042 ceph-mon[38309]: purged_snaps scrub ok 2024-09-21T17:42:51.031 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:50 smithi042 ceph-mon[38309]: osd.1 v2:172.21.15.42:6805/555179714 boot 2024-09-21T17:42:51.031 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:50 smithi042 ceph-mon[38309]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T17:42:51.031 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:50 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:50 smithi162 ceph-mon[32106]: purged_snaps scrub starts 2024-09-21T17:42:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:50 smithi162 ceph-mon[32106]: purged_snaps scrub ok 2024-09-21T17:42:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:50 smithi162 ceph-mon[32106]: osd.1 v2:172.21.15.42:6805/555179714 boot 2024-09-21T17:42:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:50 smithi162 ceph-mon[32106]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T17:42:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:50 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:42:52.112 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[29361]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:42:52.112 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[29361]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T17:42:52.112 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.112 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.112 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:42:52.112 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[38309]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[38309]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.113 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:52.114 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:52.114 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.226 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:51 smithi162 ceph-mon[32106]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:42:52.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:51 smithi162 ceph-mon[32106]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T17:42:52.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:42:52.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:42:52.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:52.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:42:52.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:42:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:42:52.436 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi042:vg_nvme/lv_2 2024-09-21T17:42:52.690 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:42:53.107 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:52 smithi042 ceph-mon[29361]: Detected new or changed devices on smithi042 2024-09-21T17:42:53.107 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:52 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi042 to 8034M 2024-09-21T17:42:53.107 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:52 smithi042 ceph-mon[38309]: Detected new or changed devices on smithi042 2024-09-21T17:42:53.107 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:52 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi042 to 8034M 2024-09-21T17:42:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.133+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2848059638 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdaf41011f0 msgr2=0x7fdaf410b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.133+0000 7fdafa8fa640 1 --2- 172.21.15.42:0/2848059638 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdaf41011f0 0x7fdaf410b040 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009cd0 tx=0x7fdaec02a8e0 comp rx=0 tx=0).stop 2024-09-21T17:42:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.133+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2848059638 shutdown_connections 2024-09-21T17:42:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.133+0000 7fdafa8fa640 1 --2- 172.21.15.42:0/2848059638 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdaf41011f0 0x7fdaf410b040 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.133+0000 7fdafa8fa640 1 --2- 172.21.15.42:0/2848059638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaf4104990 0x7fdaf4100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:53.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.133+0000 7fdafa8fa640 1 --2- 172.21.15.42:0/2848059638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaf4104050 0x7fdaf4104450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:53.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.133+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2848059638 >> 172.21.15.42:0/2848059638 conn(0x7fdaf40fc960 msgr2=0x7fdaf40feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:42:53.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.133+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2848059638 shutdown_connections 2024-09-21T17:42:53.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.133+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2848059638 wait complete. 2024-09-21T17:42:53.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.134+0000 7fdafa8fa640 1 Processor -- start 2024-09-21T17:42:53.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.134+0000 7fdafa8fa640 1 -- start start 2024-09-21T17:42:53.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.134+0000 7fdafa8fa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaf41011f0 0x7fdaf41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:53.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.134+0000 7fdafa8fa640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdaf4104050 0x7fdaf4198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:53.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.134+0000 7fdafa8fa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaf4104990 0x7fdaf4199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:53.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.134+0000 7fdafa8fa640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf410ddc0 con 0x7fdaf4104990 2024-09-21T17:42:53.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.134+0000 7fdafa8fa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf410dc40 con 0x7fdaf41011f0 2024-09-21T17:42:53.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.134+0000 7fdafa8fa640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf410df40 con 0x7fdaf4104050 2024-09-21T17:42:53.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf37fe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdaf4104050 0x7fdaf4198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:53.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf8e97640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaf4104990 0x7fdaf4199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:53.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf37fe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdaf4104050 0x7fdaf4198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:40608/0 (socket says 172.21.15.42:40608) 2024-09-21T17:42:53.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf37fe640 1 -- 172.21.15.42:0/2388909015 learned_addr learned my addr 172.21.15.42:0/2388909015 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:42:53.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf3fff640 1 --2- 172.21.15.42:0/2388909015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaf41011f0 0x7fdaf41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:53.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf37fe640 1 -- 172.21.15.42:0/2388909015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaf41011f0 msgr2=0x7fdaf41984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:53.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf37fe640 1 --2- 172.21.15.42:0/2388909015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaf41011f0 0x7fdaf41984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:53.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf37fe640 1 -- 172.21.15.42:0/2388909015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaf4104990 msgr2=0x7fdaf4199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:42:53.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf37fe640 1 --2- 172.21.15.42:0/2388909015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaf4104990 0x7fdaf4199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:42:53.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf37fe640 1 -- 172.21.15.42:0/2388909015 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf4199fd0 con 0x7fdaf4104050 2024-09-21T17:42:53.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf37fe640 1 --2- 172.21.15.42:0/2388909015 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdaf4104050 0x7fdaf4198af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e980 tx=0x7fdae800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:42:53.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf17fa640 1 -- 172.21.15.42:0/2388909015 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae800cd80 con 0x7fdaf4104050 2024-09-21T17:42:53.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf17fa640 1 -- 172.21.15.42:0/2388909015 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fdae80108b0 con 0x7fdaf4104050 2024-09-21T17:42:53.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2388909015 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf419a2c0 con 0x7fdaf4104050 2024-09-21T17:42:53.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdaf17fa640 1 -- 172.21.15.42:0/2388909015 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8018840 con 0x7fdaf4104050 2024-09-21T17:42:53.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.135+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2388909015 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf41a09a0 con 0x7fdaf4104050 2024-09-21T17:42:53.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.136+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2388909015 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf4104450 con 0x7fdaf4104050 2024-09-21T17:42:53.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.137+0000 7fdaf17fa640 1 -- 172.21.15.42:0/2388909015 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 15) ==== 103142+0+0 (secure 0 0 0) 0x7fdae801f020 con 0x7fdaf4104050 2024-09-21T17:42:53.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.138+0000 7fdaf17fa640 1 --2- 172.21.15.42:0/2388909015 >> v2:172.21.15.42:6800/92962027 conn(0x7fdadc07af90 0x7fdadc07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:42:53.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.138+0000 7fdaf17fa640 1 -- 172.21.15.42:0/2388909015 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 1833+0+0 (secure 0 0 0) 0x7fdae809d110 con 0x7fdaf4104050 2024-09-21T17:42:53.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.138+0000 7fdaf3fff640 1 --2- 172.21.15.42:0/2388909015 >> v2:172.21.15.42:6800/92962027 conn(0x7fdadc07af90 0x7fdadc07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:42:53.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.138+0000 7fdaf3fff640 1 --2- 172.21.15.42:0/2388909015 >> v2:172.21.15.42:6800/92962027 conn(0x7fdadc07af90 0x7fdadc07d450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdae4005fd0 tx=0x7fdae400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:42:53.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.142+0000 7fdaf17fa640 1 -- 172.21.15.42:0/2388909015 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fdae8069950 con 0x7fdaf4104050 2024-09-21T17:42:53.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:52 smithi162 ceph-mon[32106]: Detected new or changed devices on smithi042 2024-09-21T17:42:53.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:52 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi042 to 8034M 2024-09-21T17:42:53.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:42:53.342+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2388909015 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fdaf402e8a0 con 0x7fdadc07af90 2024-09-21T17:42:54.002 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:53 smithi042 ceph-mon[29361]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:42:54.002 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:42:54.002 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:42:54.002 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:54.002 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:53 smithi042 ceph-mon[38309]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:42:54.002 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:42:54.002 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:42:54.002 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:54.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:53 smithi162 ceph-mon[32106]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:42:54.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:42:54.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:42:54.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:42:55.193 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:54 smithi042 ceph-mon[29361]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:42:55.193 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:54 smithi042 ceph-mon[38309]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:42:55.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:54 smithi162 ceph-mon[32106]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:42:56.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:55 smithi042 ceph-mon[29361]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:42:56.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2796736766' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c7346df3-244f-4c4e-a0c0-6058b91388a8"} : dispatch 2024-09-21T17:42:56.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2796736766' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7346df3-244f-4c4e-a0c0-6058b91388a8"}]': finished 2024-09-21T17:42:56.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:55 smithi042 ceph-mon[29361]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T17:42:56.068 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:55 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:42:56.069 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:55 smithi042 ceph-mon[38309]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:42:56.069 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2796736766' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c7346df3-244f-4c4e-a0c0-6058b91388a8"} : dispatch 2024-09-21T17:42:56.069 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2796736766' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7346df3-244f-4c4e-a0c0-6058b91388a8"}]': finished 2024-09-21T17:42:56.069 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:55 smithi042 ceph-mon[38309]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T17:42:56.069 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:55 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:42:56.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:55 smithi162 ceph-mon[32106]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:42:56.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2796736766' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c7346df3-244f-4c4e-a0c0-6058b91388a8"} : dispatch 2024-09-21T17:42:56.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2796736766' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7346df3-244f-4c4e-a0c0-6058b91388a8"}]': finished 2024-09-21T17:42:56.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:55 smithi162 ceph-mon[32106]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T17:42:56.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:55 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:42:57.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2342757850' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:42:57.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2342757850' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:42:57.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2342757850' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:42:58.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:57 smithi162 ceph-mon[32106]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:42:58.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:57 smithi042 ceph-mon[29361]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:42:58.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:57 smithi042 ceph-mon[38309]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:00.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:42:59 smithi162 ceph-mon[32106]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:00.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:42:59 smithi042 ceph-mon[29361]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:00.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:42:59 smithi042 ceph-mon[38309]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:02.270 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:01 smithi042 ceph-mon[29361]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:02.270 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:01 smithi042 ceph-mon[38309]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:02.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:01 smithi162 ceph-mon[32106]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:04.209 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:03 smithi042 ceph-mon[29361]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:04.209 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T17:43:04.209 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:04.210 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:03 smithi042 ceph-mon[38309]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:04.210 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T17:43:04.210 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:04.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:03 smithi162 ceph-mon[32106]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:04.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T17:43:04.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:05.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:04 smithi042 ceph-mon[29361]: Deploying daemon osd.2 on smithi042 2024-09-21T17:43:05.090 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:04 smithi042 ceph-mon[38309]: Deploying daemon osd.2 on smithi042 2024-09-21T17:43:05.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:04 smithi162 ceph-mon[32106]: Deploying daemon osd.2 on smithi042 2024-09-21T17:43:06.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:05 smithi042 ceph-mon[29361]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:06.120 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:05 smithi042 ceph-mon[38309]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:06.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:05 smithi162 ceph-mon[32106]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:08.141 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:07 smithi042 ceph-mon[29361]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:08.141 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:07 smithi042 ceph-mon[38309]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:08.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:07 smithi162 ceph-mon[32106]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:09.236 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:08 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:09.237 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:08 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:09.237 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:08 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:09.237 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:08 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:09.237 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:08 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:09.237 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:08 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:09.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:08 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:09.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:08 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:09.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:08 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:10.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:09 smithi042 ceph-mon[29361]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:10.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:09 smithi042 ceph-mon[38309]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:10.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:09 smithi162 ceph-mon[32106]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:11.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:10 smithi162 ceph-mon[32106]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:11.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:10 smithi042 ceph-mon[38309]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:10 smithi042 ceph-mon[29361]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:12.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.133+0000 7fdaf17fa640 1 -- 172.21.15.42:0/2388909015 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdaf402e8a0 con 0x7fdadc07af90 2024-09-21T17:43:12.218 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 2 on host 'smithi042' 2024-09-21T17:43:12.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2388909015 >> v2:172.21.15.42:6800/92962027 conn(0x7fdadc07af90 msgr2=0x7fdadc07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:12.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 --2- 172.21.15.42:0/2388909015 >> v2:172.21.15.42:6800/92962027 conn(0x7fdadc07af90 0x7fdadc07d450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdae4005fd0 tx=0x7fdae400b390 comp rx=0 tx=0).stop 2024-09-21T17:43:12.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2388909015 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdaf4104050 msgr2=0x7fdaf4198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:12.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 --2- 172.21.15.42:0/2388909015 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdaf4104050 0x7fdaf4198af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e980 tx=0x7fdae800ee40 comp rx=0 tx=0).stop 2024-09-21T17:43:12.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2388909015 shutdown_connections 2024-09-21T17:43:12.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 --2- 172.21.15.42:0/2388909015 >> v2:172.21.15.42:6800/92962027 conn(0x7fdadc07af90 0x7fdadc07d450 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:12.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 --2- 172.21.15.42:0/2388909015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaf4104990 0x7fdaf4199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:12.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 --2- 172.21.15.42:0/2388909015 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdaf4104050 0x7fdaf4198af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:12.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 --2- 172.21.15.42:0/2388909015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaf41011f0 0x7fdaf41984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:12.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2388909015 >> 172.21.15.42:0/2388909015 conn(0x7fdaf40fc960 msgr2=0x7fdaf40fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:43:12.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2388909015 shutdown_connections 2024-09-21T17:43:12.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:12.136+0000 7fdafa8fa640 1 -- 172.21.15.42:0/2388909015 wait complete. 2024-09-21T17:43:12.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:12.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:12.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:12.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.384 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.385 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.385 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:12.385 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:12.385 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.385 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:12.385 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.385 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:12 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:12 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:12 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:12 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:12 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:12 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:12 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:12 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:12 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:12.705 DEBUG:teuthology.orchestra.run.smithi042:osd.2> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.2.service 2024-09-21T17:43:12.707 INFO:tasks.cephadm:Deploying osd.3 on smithi042 with /dev/vg_nvme/lv_1... 2024-09-21T17:43:12.707 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T17:43:13.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:13 smithi042 ceph-mon[29361]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:13.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:13 smithi042 ceph-mon[38309]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:13 smithi162 ceph-mon[32106]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:13.870 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 17:43:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2[52272]: 2024-09-21T17:43:13.549+0000 7f7ccdb5c640 -1 osd.2 0 log_to_monitors true 2024-09-21T17:43:14.213 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:43:14.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:14 smithi042 ceph-mon[29361]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T17:43:14.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:14 smithi042 ceph-mon[38309]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T17:43:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:14 smithi162 ceph-mon[32106]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T17:43:15.503 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-mon[29361]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:15.503 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-mon[29361]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T17:43:15.503 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-mon[29361]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T17:43:15.503 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-mon[29361]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:43:15.503 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:15.503 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-mon[38309]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:15.504 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-mon[38309]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T17:43:15.504 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-mon[38309]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T17:43:15.504 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-mon[38309]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:43:15.504 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:15 smithi162 ceph-mon[32106]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:15 smithi162 ceph-mon[32106]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T17:43:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:15 smithi162 ceph-mon[32106]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T17:43:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:15 smithi162 ceph-mon[32106]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:43:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:15 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:15.819 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2[52272]: 2024-09-21T17:43:15.499+0000 7f7cc9adf640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T17:43:15.819 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 17:43:15 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2[52272]: 2024-09-21T17:43:15.503+0000 7f7cc18fe640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T17:43:16.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:43:16.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T17:43:16.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:16.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:16.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: Detected new or changed devices on smithi042 2024-09-21T17:43:16.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:16.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:16.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:16.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi042 to 5356M 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: Detected new or changed devices on smithi042 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:16.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:16.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:16.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi042 to 5356M 2024-09-21T17:43:16.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:16.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:16.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' 2024-09-21T17:43:16.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:16 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:43:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T17:43:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: Detected new or changed devices on smithi042 2024-09-21T17:43:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:16.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:16.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:16.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi042 to 5356M 2024-09-21T17:43:16.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:16.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:16.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:16.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='osd.2 v2:172.21.15.42:6809/429996625' entity='osd.2' 2024-09-21T17:43:16.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:16 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:17.147 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:43:17.175 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi042:vg_nvme/lv_1 2024-09-21T17:43:17.430 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:43:17.759 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[29361]: purged_snaps scrub starts 2024-09-21T17:43:17.759 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[29361]: purged_snaps scrub ok 2024-09-21T17:43:17.759 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[29361]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:17.759 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[29361]: osd.2 v2:172.21.15.42:6809/429996625 boot 2024-09-21T17:43:17.759 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[29361]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T17:43:17.759 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:17.759 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:43:17.760 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[38309]: purged_snaps scrub starts 2024-09-21T17:43:17.760 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[38309]: purged_snaps scrub ok 2024-09-21T17:43:17.760 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[38309]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:17.760 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[38309]: osd.2 v2:172.21.15.42:6809/429996625 boot 2024-09-21T17:43:17.760 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[38309]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T17:43:17.760 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:17.760 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:17 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:43:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:17 smithi162 ceph-mon[32106]: purged_snaps scrub starts 2024-09-21T17:43:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:17 smithi162 ceph-mon[32106]: purged_snaps scrub ok 2024-09-21T17:43:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:17 smithi162 ceph-mon[32106]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T17:43:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:17 smithi162 ceph-mon[32106]: osd.2 v2:172.21.15.42:6809/429996625 boot 2024-09-21T17:43:17.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:17 smithi162 ceph-mon[32106]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T17:43:17.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:17 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:43:17.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:17 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:43:17.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.839+0000 7f4e47432640 1 -- 172.21.15.42:0/3129784897 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4e40107f40 msgr2=0x7f4e4010a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:17.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.839+0000 7f4e47432640 1 --2- 172.21.15.42:0/3129784897 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4e40107f40 0x7f4e4010a330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009900 tx=0x7f4e3002a410 comp rx=0 tx=0).stop 2024-09-21T17:43:17.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.839+0000 7f4e47432640 1 -- 172.21.15.42:0/3129784897 shutdown_connections 2024-09-21T17:43:17.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.839+0000 7f4e47432640 1 --2- 172.21.15.42:0/3129784897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e4010a950 0x7f4e4010ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.839+0000 7f4e47432640 1 --2- 172.21.15.42:0/3129784897 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4e40107f40 0x7f4e4010a330 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.839+0000 7f4e47432640 1 --2- 172.21.15.42:0/3129784897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e4006bf80 0x7f4e40107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.839+0000 7f4e47432640 1 -- 172.21.15.42:0/3129784897 >> 172.21.15.42:0/3129784897 conn(0x7f4e400fd1d0 msgr2=0x7f4e400ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.839+0000 7f4e47432640 1 -- 172.21.15.42:0/3129784897 shutdown_connections 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.839+0000 7f4e47432640 1 -- 172.21.15.42:0/3129784897 wait complete. 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.839+0000 7f4e47432640 1 Processor -- start 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.839+0000 7f4e47432640 1 -- start start 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e47432640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e4006bf80 0x7f4e4019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e47432640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4e40107f40 0x7f4e4019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e47432640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e4010a950 0x7f4e4019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e47432640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4010ff50 con 0x7f4e4006bf80 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e47432640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4010fdd0 con 0x7f4e4010a950 2024-09-21T17:43:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e47432640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f4e401100d0 con 0x7f4e40107f40 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e451ce640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e4006bf80 0x7f4e4019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e449cd640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4e40107f40 0x7f4e4019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e451ce640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e4006bf80 0x7f4e4019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41804/0 (socket says 172.21.15.42:41804) 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e451ce640 1 -- 172.21.15.42:0/1023088269 learned_addr learned my addr 172.21.15.42:0/1023088269 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e449cd640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4e40107f40 0x7f4e4019ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:53652/0 (socket says 172.21.15.42:53652) 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e459cf640 1 --2- 172.21.15.42:0/1023088269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e4010a950 0x7f4e4019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e449cd640 1 -- 172.21.15.42:0/1023088269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e4010a950 msgr2=0x7f4e4019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e449cd640 1 --2- 172.21.15.42:0/1023088269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e4010a950 0x7f4e4019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e449cd640 1 -- 172.21.15.42:0/1023088269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e4006bf80 msgr2=0x7f4e4019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e449cd640 1 --2- 172.21.15.42:0/1023088269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e4006bf80 0x7f4e4019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e449cd640 1 -- 172.21.15.42:0/1023088269 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4019c2c0 con 0x7f4e40107f40 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e451ce640 1 --2- 172.21.15.42:0/1023088269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e4006bf80 0x7f4e4019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e459cf640 1 --2- 172.21.15.42:0/1023088269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e4010a950 0x7f4e4019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T17:43:17.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e449cd640 1 --2- 172.21.15.42:0/1023088269 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4e40107f40 0x7f4e4019ade0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e30006010 tx=0x7f4e30032a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:43:17.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e367fc640 1 -- 172.21.15.42:0/1023088269 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3003f030 con 0x7f4e40107f40 2024-09-21T17:43:17.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e367fc640 1 -- 172.21.15.42:0/1023088269 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f4e30032e40 con 0x7f4e40107f40 2024-09-21T17:43:17.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e367fc640 1 -- 172.21.15.42:0/1023088269 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30035070 con 0x7f4e40107f40 2024-09-21T17:43:17.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.840+0000 7f4e47432640 1 -- 172.21.15.42:0/1023088269 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4019c550 con 0x7f4e40107f40 2024-09-21T17:43:17.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.841+0000 7f4e47432640 1 -- 172.21.15.42:0/1023088269 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e401a2c90 con 0x7f4e40107f40 2024-09-21T17:43:17.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.842+0000 7f4e47432640 1 -- 172.21.15.42:0/1023088269 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e40110710 con 0x7f4e40107f40 2024-09-21T17:43:17.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.842+0000 7f4e367fc640 1 -- 172.21.15.42:0/1023088269 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 15) ==== 103142+0+0 (secure 0 0 0) 0x7f4e30042030 con 0x7f4e40107f40 2024-09-21T17:43:17.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.843+0000 7f4e367fc640 1 --2- 172.21.15.42:0/1023088269 >> v2:172.21.15.42:6800/92962027 conn(0x7f4e2c07af90 0x7f4e2c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:43:17.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.843+0000 7f4e367fc640 1 -- 172.21.15.42:0/1023088269 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 2500+0+0 (secure 0 0 0) 0x7f4e300bd6c0 con 0x7f4e40107f40 2024-09-21T17:43:17.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.843+0000 7f4e451ce640 1 --2- 172.21.15.42:0/1023088269 >> v2:172.21.15.42:6800/92962027 conn(0x7f4e2c07af90 0x7f4e2c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:43:17.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.843+0000 7f4e451ce640 1 --2- 172.21.15.42:0/1023088269 >> v2:172.21.15.42:6800/92962027 conn(0x7f4e2c07af90 0x7f4e2c07d450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0104e0 tx=0x7f4e3c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:43:17.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:17.848+0000 7f4e367fc640 1 -- 172.21.15.42:0/1023088269 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f4e30089c60 con 0x7f4e40107f40 2024-09-21T17:43:18.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:18.048+0000 7f4e47432640 1 -- 172.21.15.42:0/1023088269 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f4e4002e840 con 0x7f4e2c07af90 2024-09-21T17:43:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T17:43:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[29361]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T17:43:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:43:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:43:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:43:18.726 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:18.726 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T17:43:18.726 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[38309]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T17:43:18.726 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:43:18.726 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:43:18.726 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:43:18.726 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T17:43:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:18 smithi162 ceph-mon[32106]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T17:43:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:43:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:43:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:43:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:19.724 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 ceph-mon[38309]: from='client.24194 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:43:19.725 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 ceph-mon[38309]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:19.725 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 ceph-mon[38309]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:43:19.725 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T17:43:19.725 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 ceph-mon[38309]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T17:43:19.725 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56451]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T17:43:19.725 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56451]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:19.725 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:19.725 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56451]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:19.725 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56454]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T17:43:19.725 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56454]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:19.725 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:19.726 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56454]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:19.726 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56457]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T17:43:19.726 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56457]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:19.726 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:19.726 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56457]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:19.726 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56461]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T17:43:19.726 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56461]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:19.726 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:19.726 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56461]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:19.727 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56465]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T17:43:19.727 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56465]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:19.727 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:19.727 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56465]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:19.727 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56468]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T17:43:19.727 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56468]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:19.727 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:19.727 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56468]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:19.727 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 ceph-mon[29361]: from='client.24194 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:43:19.727 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 ceph-mon[29361]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:19.727 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 ceph-mon[29361]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:43:19.727 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T17:43:19.728 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 ceph-mon[29361]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T17:43:19.728 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56471]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T17:43:19.728 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56471]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:19.728 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:19.728 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56471]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:19.728 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56474]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T17:43:19.728 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56474]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:19.728 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:19.728 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56474]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 ceph-mon[32106]: from='client.24194 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:43:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 ceph-mon[32106]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 ceph-mon[32106]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:43:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T17:43:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 ceph-mon[32106]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T17:43:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 sudo[34036]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T17:43:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 sudo[34036]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 sudo[34036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 sudo[34036]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 sudo[34039]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T17:43:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 sudo[34039]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 sudo[34039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:19 smithi162 sudo[34039]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:20.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56480]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T17:43:20.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56480]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:20.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:20.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56480]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:20.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56487]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T17:43:20.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56487]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T17:43:20.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T17:43:20.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:19 smithi042 sudo[56487]: pam_unix(sudo:session): session closed for user root 2024-09-21T17:43:20.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:20.778+0000 7f4e367fc640 1 -- 172.21.15.42:0/1023088269 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7f4e300814a0 con 0x7f4e40107f40 2024-09-21T17:43:20.782 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T17:43:20.782 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:43:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:43:20.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:43:20.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T17:43:20.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/852070662' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2099cf75-c0ab-4de5-bc44-dace0d4ee6b9"} : dispatch 2024-09-21T17:43:20.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2099cf75-c0ab-4de5-bc44-dace0d4ee6b9"} : dispatch 2024-09-21T17:43:20.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2099cf75-c0ab-4de5-bc44-dace0d4ee6b9"}]': finished 2024-09-21T17:43:20.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T17:43:20.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:20.784 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T17:43:20.784 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:20.784 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:43:20.785 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:43:20.786 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:43:20.786 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T17:43:20.786 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/852070662' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2099cf75-c0ab-4de5-bc44-dace0d4ee6b9"} : dispatch 2024-09-21T17:43:20.786 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2099cf75-c0ab-4de5-bc44-dace0d4ee6b9"} : dispatch 2024-09-21T17:43:20.786 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2099cf75-c0ab-4de5-bc44-dace0d4ee6b9"}]': finished 2024-09-21T17:43:20.786 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T17:43:20.786 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:20 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T17:43:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T17:43:20.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:43:20.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:43:20.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:43:20.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T17:43:20.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/852070662' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2099cf75-c0ab-4de5-bc44-dace0d4ee6b9"} : dispatch 2024-09-21T17:43:20.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2099cf75-c0ab-4de5-bc44-dace0d4ee6b9"} : dispatch 2024-09-21T17:43:20.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2099cf75-c0ab-4de5-bc44-dace0d4ee6b9"}]': finished 2024-09-21T17:43:20.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T17:43:20.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:20 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:21 smithi162 ceph-mon[32106]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:21 smithi162 ceph-mon[32106]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T17:43:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:21 smithi162 ceph-mon[32106]: Cluster is now healthy 2024-09-21T17:43:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:21 smithi162 ceph-mon[32106]: mgrmap e16: y(active, since 2m), standbys: x 2024-09-21T17:43:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1781710638' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:43:21.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:21 smithi042 ceph-mon[29361]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:21 smithi042 ceph-mon[29361]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T17:43:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:21 smithi042 ceph-mon[29361]: Cluster is now healthy 2024-09-21T17:43:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:21 smithi042 ceph-mon[29361]: mgrmap e16: y(active, since 2m), standbys: x 2024-09-21T17:43:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1781710638' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:43:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:21 smithi042 ceph-mon[38309]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:21 smithi042 ceph-mon[38309]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T17:43:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:21 smithi042 ceph-mon[38309]: Cluster is now healthy 2024-09-21T17:43:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:21 smithi042 ceph-mon[38309]: mgrmap e16: y(active, since 2m), standbys: x 2024-09-21T17:43:21.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1781710638' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:43:23.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:23 smithi162 ceph-mon[32106]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:23.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:23 smithi042 ceph-mon[29361]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:23.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:23 smithi042 ceph-mon[38309]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:25.698 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:25 smithi042 ceph-mon[29361]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:25.698 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:25 smithi042 ceph-mon[38309]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:25.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:25 smithi162 ceph-mon[32106]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:27 smithi162 ceph-mon[32106]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:27 smithi042 ceph-mon[29361]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:27.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:27 smithi042 ceph-mon[38309]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T17:43:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:28 smithi042 ceph-mon[29361]: Deploying daemon osd.3 on smithi042 2024-09-21T17:43:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T17:43:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:28 smithi042 ceph-mon[38309]: Deploying daemon osd.3 on smithi042 2024-09-21T17:43:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T17:43:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:28 smithi162 ceph-mon[32106]: Deploying daemon osd.3 on smithi042 2024-09-21T17:43:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:29 smithi162 ceph-mon[32106]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:29 smithi042 ceph-mon[29361]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:29 smithi042 ceph-mon[38309]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:31.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:31 smithi162 ceph-mon[32106]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:31 smithi042 ceph-mon[29361]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:31 smithi042 ceph-mon[38309]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:33.756 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:33 smithi042 ceph-mon[29361]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:33.756 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:33.757 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:33.757 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:33.757 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:33 smithi042 ceph-mon[38309]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:33.757 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:33 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:33.757 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:33 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:33.757 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:33 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:33 smithi162 ceph-mon[32106]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:33 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:33 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:33 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:35.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:35 smithi042 ceph-mon[29361]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:35.821 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:35 smithi042 ceph-mon[38309]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:35 smithi162 ceph-mon[32106]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:36.074 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 3 on host 'smithi042' 2024-09-21T17:43:36.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.071+0000 7f4e367fc640 1 -- 172.21.15.42:0/1023088269 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4e4002e840 con 0x7f4e2c07af90 2024-09-21T17:43:36.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 -- 172.21.15.42:0/1023088269 >> v2:172.21.15.42:6800/92962027 conn(0x7f4e2c07af90 msgr2=0x7f4e2c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:36.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 --2- 172.21.15.42:0/1023088269 >> v2:172.21.15.42:6800/92962027 conn(0x7f4e2c07af90 0x7f4e2c07d450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0104e0 tx=0x7f4e3c00b410 comp rx=0 tx=0).stop 2024-09-21T17:43:36.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 -- 172.21.15.42:0/1023088269 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4e40107f40 msgr2=0x7f4e4019ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 --2- 172.21.15.42:0/1023088269 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4e40107f40 0x7f4e4019ade0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e30006010 tx=0x7f4e30032a40 comp rx=0 tx=0).stop 2024-09-21T17:43:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 -- 172.21.15.42:0/1023088269 shutdown_connections 2024-09-21T17:43:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 --2- 172.21.15.42:0/1023088269 >> v2:172.21.15.42:6800/92962027 conn(0x7f4e2c07af90 0x7f4e2c07d450 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 --2- 172.21.15.42:0/1023088269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e4010a950 0x7f4e4019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 --2- 172.21.15.42:0/1023088269 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4e40107f40 0x7f4e4019ade0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 --2- 172.21.15.42:0/1023088269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e4006bf80 0x7f4e4019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 -- 172.21.15.42:0/1023088269 >> 172.21.15.42:0/1023088269 conn(0x7f4e400fd1d0 msgr2=0x7f4e40108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:43:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 -- 172.21.15.42:0/1023088269 shutdown_connections 2024-09-21T17:43:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:43:36.074+0000 7f4e47432640 1 -- 172.21.15.42:0/1023088269 wait complete. 2024-09-21T17:43:36.680 DEBUG:teuthology.orchestra.run.smithi042:osd.3> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.3.service 2024-09-21T17:43:36.682 INFO:tasks.cephadm:Deploying osd.4 on smithi162 with /dev/vg_nvme/lv_4... 2024-09-21T17:43:36.682 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T17:43:36.936 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:43:37.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:37.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:37.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:37 smithi162 ceph-mon[32106]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:37.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:37.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:37 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:37.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:37 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:37.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:37 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:37.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:37 smithi042 ceph-mon[29361]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:37.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:37 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:37.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:37 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:37.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:37 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:37.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:37 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:37.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:37 smithi042 ceph-mon[38309]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:37.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:37 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:37.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:37 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:38.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:38 smithi042 ceph-mon[29361]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T17:43:38.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:38 smithi042 ceph-mon[38309]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T17:43:38.165 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 17:43:37 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3[58121]: 2024-09-21T17:43:37.888+0000 7fb181369640 -1 osd.3 0 log_to_monitors true 2024-09-21T17:43:38.198 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:38 smithi162 ceph-mon[32106]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T17:43:39.179 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:43:39.206 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2024-09-21T17:43:39.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-mon[29361]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T17:43:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-mon[29361]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T17:43:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-mon[29361]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:43:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-mon[29361]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:39.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-mon[38309]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T17:43:39.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-mon[38309]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T17:43:39.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-mon[38309]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:43:39.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:39.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-mon[38309]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:39.416 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3[58121]: 2024-09-21T17:43:39.090+0000 7fb17d2ec640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T17:43:39.416 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 17:43:39 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3[58121]: 2024-09-21T17:43:39.097+0000 7fb179113640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T17:43:39.452 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:43:39.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:39 smithi162 ceph-mon[32106]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T17:43:39.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:39 smithi162 ceph-mon[32106]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T17:43:39.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:39 smithi162 ceph-mon[32106]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T17:43:39.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:39 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:39.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:39 smithi162 ceph-mon[32106]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.895+0000 7fd6ac14f640 1 -- 172.21.15.162:0/526291604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a4103400 msgr2=0x7fd6a4109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.895+0000 7fd6ac14f640 1 --2- 172.21.15.162:0/526291604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a4103400 0x7fd6a4109d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009cd0 tx=0x7fd69c02a8e0 comp rx=0 tx=0).stop 2024-09-21T17:43:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.895+0000 7fd6ac14f640 1 -- 172.21.15.162:0/526291604 shutdown_connections 2024-09-21T17:43:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 --2- 172.21.15.162:0/526291604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a4103400 0x7fd6a4109d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 --2- 172.21.15.162:0/526291604 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd6a4102a40 0x7fd6a4102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 --2- 172.21.15.162:0/526291604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6a41018e0 0x7fd6a4101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 -- 172.21.15.162:0/526291604 >> 172.21.15.162:0/526291604 conn(0x7fd6a40fd1b0 msgr2=0x7fd6a40ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 -- 172.21.15.162:0/526291604 shutdown_connections 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 -- 172.21.15.162:0/526291604 wait complete. 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 Processor -- start 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 -- start start 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd6a41018e0 0x7fd6a4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a4102a40 0x7fd6a4198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6a4103400 0x7fd6a4199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a410cc10 con 0x7fd6a4103400 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a410ca90 con 0x7fd6a4102a40 2024-09-21T17:43:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.896+0000 7fd6ac14f640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a410cd90 con 0x7fd6a41018e0 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6a96ea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a4102a40 0x7fd6a4198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6a9eeb640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd6a41018e0 0x7fd6a4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6a96ea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a4102a40 0x7fd6a4198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57458/0 (socket says 172.21.15.162:57458) 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6a9eeb640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd6a41018e0 0x7fd6a4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.162:58230/0 (socket says 172.21.15.162:58230) 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6a96ea640 1 -- 172.21.15.162:0/1025548055 learned_addr learned my addr 172.21.15.162:0/1025548055 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6aa6ec640 1 --2- 172.21.15.162:0/1025548055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6a4103400 0x7fd6a4199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6a96ea640 1 -- 172.21.15.162:0/1025548055 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd6a41018e0 msgr2=0x7fd6a4198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6a96ea640 1 --2- 172.21.15.162:0/1025548055 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd6a41018e0 0x7fd6a4198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6a96ea640 1 -- 172.21.15.162:0/1025548055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6a4103400 msgr2=0x7fd6a4199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6a96ea640 1 --2- 172.21.15.162:0/1025548055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6a4103400 0x7fd6a4199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6a96ea640 1 -- 172.21.15.162:0/1025548055 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a4199fc0 con 0x7fd6a4102a40 2024-09-21T17:43:39.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6a96ea640 1 --2- 172.21.15.162:0/1025548055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a4102a40 0x7fd6a4198ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd69400e9f0 tx=0x7fd69400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:43:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd69affd640 1 -- 172.21.15.162:0/1025548055 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69400cd80 con 0x7fd6a4102a40 2024-09-21T17:43:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6ac14f640 1 -- 172.21.15.162:0/1025548055 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a419a2b0 con 0x7fd6a4102a40 2024-09-21T17:43:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd69affd640 1 -- 172.21.15.162:0/1025548055 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fd6940054a0 con 0x7fd6a4102a40 2024-09-21T17:43:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd69affd640 1 -- 172.21.15.162:0/1025548055 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694010430 con 0x7fd6a4102a40 2024-09-21T17:43:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.897+0000 7fd6ac14f640 1 -- 172.21.15.162:0/1025548055 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a41a0990 con 0x7fd6a4102a40 2024-09-21T17:43:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.898+0000 7fd6ac14f640 1 -- 172.21.15.162:0/1025548055 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a4101ce0 con 0x7fd6a4102a40 2024-09-21T17:43:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.899+0000 7fd69affd640 1 -- 172.21.15.162:0/1025548055 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7fd694004fc0 con 0x7fd6a4102a40 2024-09-21T17:43:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.900+0000 7fd69affd640 1 --2- 172.21.15.162:0/1025548055 >> v2:172.21.15.42:6800/92962027 conn(0x7fd69007b020 0x7fd69007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:43:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.900+0000 7fd69affd640 1 -- 172.21.15.162:0/1025548055 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 2663+0+0 (secure 0 0 0) 0x7fd69409d980 con 0x7fd6a4102a40 2024-09-21T17:43:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.900+0000 7fd6a9eeb640 1 --2- 172.21.15.162:0/1025548055 >> v2:172.21.15.42:6800/92962027 conn(0x7fd69007b020 0x7fd69007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:43:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.900+0000 7fd6a9eeb640 1 --2- 172.21.15.162:0/1025548055 >> v2:172.21.15.42:6800/92962027 conn(0x7fd69007b020 0x7fd69007d4e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0005d00 tx=0x7fd6a000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:43:39.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:39.904+0000 7fd69affd640 1 -- 172.21.15.162:0/1025548055 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fd694069e60 con 0x7fd6a4102a40 2024-09-21T17:43:40.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:40.100+0000 7fd6ac14f640 1 -- 172.21.15.162:0/1025548055 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd6a402e8a0 con 0x7fd69007b020 2024-09-21T17:43:40.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:40 smithi042 ceph-mon[38309]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:43:40.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:40 smithi042 ceph-mon[38309]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T17:43:40.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:40 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:40.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:40 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:40.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:40 smithi042 ceph-mon[29361]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:43:40.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:40 smithi042 ceph-mon[29361]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T17:43:40.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:40 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:40.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:40 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:40.469 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:40 smithi162 ceph-mon[32106]: from='osd.3 v2:172.21.15.42:6813/2988176462' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T17:43:40.469 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:40 smithi162 ceph-mon[32106]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T17:43:40.469 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:40 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:40.469 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:40 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:41.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: purged_snaps scrub starts 2024-09-21T17:43:41.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: purged_snaps scrub ok 2024-09-21T17:43:41.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:41.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: osd.3 v2:172.21.15.42:6813/2988176462 boot 2024-09-21T17:43:41.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T17:43:41.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:41.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:43:41.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:43:41.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:43:41.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: Detected new or changed devices on smithi042 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi042 to 4017M 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:41.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: purged_snaps scrub starts 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: purged_snaps scrub ok 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: osd.3 v2:172.21.15.42:6813/2988176462 boot 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:43:41.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: Detected new or changed devices on smithi042 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi042 to 4017M 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:41.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:41.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:41.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:41.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: purged_snaps scrub starts 2024-09-21T17:43:41.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: purged_snaps scrub ok 2024-09-21T17:43:41.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:41.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: osd.3 v2:172.21.15.42:6813/2988176462 boot 2024-09-21T17:43:41.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T17:43:41.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:43:41.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:43:41.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: Detected new or changed devices on smithi042 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi042 to 4017M 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:41.479 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T17:43:41.480 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:41.480 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:41.480 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:41.480 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:42.489 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:42 smithi162 ceph-mon[32106]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T17:43:42.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:42 smithi042 ceph-mon[38309]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T17:43:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:42 smithi042 ceph-mon[29361]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T17:43:43.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[38309]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/3233525109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df62f00f-2873-4de2-9e6f-d558f53a0ce8"} : dispatch 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df62f00f-2873-4de2-9e6f-d558f53a0ce8"} : dispatch 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df62f00f-2873-4de2-9e6f-d558f53a0ce8"}]': finished 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[38309]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/4163979774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[29361]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/3233525109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df62f00f-2873-4de2-9e6f-d558f53a0ce8"} : dispatch 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df62f00f-2873-4de2-9e6f-d558f53a0ce8"} : dispatch 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df62f00f-2873-4de2-9e6f-d558f53a0ce8"}]': finished 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[29361]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T17:43:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:43:43.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/4163979774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:43:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:43 smithi162 ceph-mon[32106]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/3233525109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df62f00f-2873-4de2-9e6f-d558f53a0ce8"} : dispatch 2024-09-21T17:43:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df62f00f-2873-4de2-9e6f-d558f53a0ce8"} : dispatch 2024-09-21T17:43:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df62f00f-2873-4de2-9e6f-d558f53a0ce8"}]': finished 2024-09-21T17:43:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:43 smithi162 ceph-mon[32106]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T17:43:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:43:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/4163979774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:43:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:45 smithi162 ceph-mon[32106]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:45 smithi042 ceph-mon[29361]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:45 smithi042 ceph-mon[38309]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:47.421 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:47 smithi162 ceph-mon[32106]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:47.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:47 smithi042 ceph-mon[29361]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:47 smithi042 ceph-mon[38309]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:49 smithi162 ceph-mon[32106]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:49.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:49 smithi042 ceph-mon[29361]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:49.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:49 smithi042 ceph-mon[38309]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:50.538 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:50 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T17:43:50.538 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:50 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:50.538 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:50 smithi162 ceph-mon[32106]: Deploying daemon osd.4 on smithi162 2024-09-21T17:43:50.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:50 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T17:43:50.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:50 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:50 smithi042 ceph-mon[29361]: Deploying daemon osd.4 on smithi162 2024-09-21T17:43:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:50 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T17:43:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:50 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:50 smithi042 ceph-mon[38309]: Deploying daemon osd.4 on smithi162 2024-09-21T17:43:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:51 smithi162 ceph-mon[32106]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:51.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:51 smithi042 ceph-mon[29361]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:51.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:51 smithi042 ceph-mon[38309]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:53 smithi162 ceph-mon[32106]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:53.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:53 smithi042 ceph-mon[29361]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:53 smithi042 ceph-mon[38309]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:55.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:55 smithi162 ceph-mon[32106]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:55.490 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:55 smithi042 ceph-mon[29361]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:55.490 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:55 smithi042 ceph-mon[38309]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:56.273 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:56 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:56.273 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:56 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:56.273 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:56 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:56.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:56 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:56.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:56 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:56 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:56.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:56 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:43:56.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:56 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:56.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:56 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:57 smithi042 ceph-mon[29361]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:57 smithi042 ceph-mon[38309]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:58.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:57 smithi162 ceph-mon[32106]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:43:59.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:59.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:59.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:59.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:59.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:59.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.299+0000 7fd69affd640 1 -- 172.21.15.162:0/1025548055 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd6a402e8a0 con 0x7fd69007b020 2024-09-21T17:43:59.302 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 4 on host 'smithi162' 2024-09-21T17:43:59.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 -- 172.21.15.162:0/1025548055 >> v2:172.21.15.42:6800/92962027 conn(0x7fd69007b020 msgr2=0x7fd69007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:59.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 --2- 172.21.15.162:0/1025548055 >> v2:172.21.15.42:6800/92962027 conn(0x7fd69007b020 0x7fd69007d4e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0005d00 tx=0x7fd6a000b410 comp rx=0 tx=0).stop 2024-09-21T17:43:59.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 -- 172.21.15.162:0/1025548055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a4102a40 msgr2=0x7fd6a4198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:43:59.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 --2- 172.21.15.162:0/1025548055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a4102a40 0x7fd6a4198ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd69400e9f0 tx=0x7fd69400edf0 comp rx=0 tx=0).stop 2024-09-21T17:43:59.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 -- 172.21.15.162:0/1025548055 shutdown_connections 2024-09-21T17:43:59.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 --2- 172.21.15.162:0/1025548055 >> v2:172.21.15.42:6800/92962027 conn(0x7fd69007b020 0x7fd69007d4e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:59.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 --2- 172.21.15.162:0/1025548055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6a4103400 0x7fd6a4199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:59.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 --2- 172.21.15.162:0/1025548055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a4102a40 0x7fd6a4198ae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:59.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 --2- 172.21.15.162:0/1025548055 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd6a41018e0 0x7fd6a4198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:43:59.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 -- 172.21.15.162:0/1025548055 >> 172.21.15.162:0/1025548055 conn(0x7fd6a40fd1b0 msgr2=0x7fd6a406b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:43:59.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 -- 172.21.15.162:0/1025548055 shutdown_connections 2024-09-21T17:43:59.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:43:59.302+0000 7fd6ac14f640 1 -- 172.21.15.162:0/1025548055 wait complete. 2024-09-21T17:43:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:43:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:43:59.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:43:59.885 DEBUG:teuthology.orchestra.run.smithi162:osd.4> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.4.service 2024-09-21T17:43:59.887 INFO:tasks.cephadm:Deploying osd.5 on smithi162 with /dev/vg_nvme/lv_3... 2024-09-21T17:43:59.887 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T17:44:00.162 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:59 smithi162 ceph-mon[32106]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:44:00.162 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:59 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:00.162 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:59 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:00.163 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:43:59 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:00.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:59 smithi042 ceph-mon[29361]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:44:00.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:59 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:00.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:59 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:00.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:43:59 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:00.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:59 smithi042 ceph-mon[38309]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:44:00.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:59 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:00.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:59 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:00.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:43:59 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:00.638 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:44:00.979 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 17:44:00 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T17:44:00.676+0000 7fdd6e439640 -1 osd.4 0 log_to_monitors true 2024-09-21T17:44:01.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:00 smithi162 ceph-mon[32106]: from='osd.4 v2:172.21.15.162:6800/4286045529' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T17:44:01.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:00 smithi162 ceph-mon[32106]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T17:44:01.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:00 smithi042 ceph-mon[29361]: from='osd.4 v2:172.21.15.162:6800/4286045529' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T17:44:01.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:00 smithi042 ceph-mon[29361]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T17:44:01.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:00 smithi042 ceph-mon[38309]: from='osd.4 v2:172.21.15.162:6800/4286045529' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T17:44:01.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:00 smithi042 ceph-mon[38309]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T17:44:02.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:01 smithi162 ceph-mon[32106]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:44:02.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:01 smithi162 ceph-mon[32106]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T17:44:02.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:01 smithi162 ceph-mon[32106]: from='osd.4 v2:172.21.15.162:6800/4286045529' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:02.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:01 smithi162 ceph-mon[32106]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T17:44:02.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:01 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:02.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:01 smithi162 ceph-mon[32106]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[29361]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:44:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[29361]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T17:44:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[29361]: from='osd.4 v2:172.21.15.162:6800/4286045529' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[29361]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T17:44:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:02.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[29361]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:02.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[38309]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:44:02.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[38309]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T17:44:02.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[38309]: from='osd.4 v2:172.21.15.162:6800/4286045529' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:02.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[38309]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T17:44:02.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:02.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:01 smithi042 ceph-mon[38309]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:02.740 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 17:44:02 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T17:44:02.413+0000 7fdd6a3bc640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T17:44:02.740 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 17:44:02 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T17:44:02.419+0000 7fdd621db640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T17:44:03.258 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:02 smithi162 ceph-mon[32106]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:44:03.258 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:02 smithi162 ceph-mon[32106]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T17:44:03.258 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:03.258 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:02 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:03.258 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:02 smithi162 ceph-mon[32106]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:44:03.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:02 smithi162 ceph-mon[32106]: from='osd.4 ' entity='osd.4' 2024-09-21T17:44:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[29361]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:44:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[29361]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T17:44:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[29361]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:44:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[29361]: from='osd.4 ' entity='osd.4' 2024-09-21T17:44:03.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[38309]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:44:03.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[38309]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T17:44:03.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:03.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:03.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[38309]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T17:44:03.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:02 smithi042 ceph-mon[38309]: from='osd.4 ' entity='osd.4' 2024-09-21T17:44:04.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: purged_snaps scrub starts 2024-09-21T17:44:04.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: purged_snaps scrub ok 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: osd.4 v2:172.21.15.162:6800/4286045529 boot 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: Detected new or changed devices on smithi162 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:03 smithi162 ceph-mon[32106]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T17:44:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: purged_snaps scrub starts 2024-09-21T17:44:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: purged_snaps scrub ok 2024-09-21T17:44:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: osd.4 v2:172.21.15.162:6800/4286045529 boot 2024-09-21T17:44:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T17:44:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: Detected new or changed devices on smithi162 2024-09-21T17:44:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[29361]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: purged_snaps scrub starts 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: purged_snaps scrub ok 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: osd.4 v2:172.21.15.162:6800/4286045529 boot 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: Detected new or changed devices on smithi162 2024-09-21T17:44:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:04.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T17:44:04.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:04.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:04.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:04.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:03 smithi042 ceph-mon[38309]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T17:44:04.559 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:44:04.585 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2024-09-21T17:44:04.831 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:44:05.278 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:04 smithi162 ceph-mon[32106]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:05.278 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:04 smithi162 ceph-mon[32106]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T17:44:05.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.275+0000 7f264532c640 1 -- 172.21.15.162:0/26901046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640101920 msgr2=0x7f2640101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.275+0000 7f264532c640 1 --2- 172.21.15.162:0/26901046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640101920 0x7f2640101d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2630009930 tx=0x7f263002a420 comp rx=0 tx=0).stop 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.275+0000 7f264532c640 1 -- 172.21.15.162:0/26901046 shutdown_connections 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.275+0000 7f264532c640 1 --2- 172.21.15.162:0/26901046 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2640103440 0x7f2640109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.275+0000 7f264532c640 1 --2- 172.21.15.162:0/26901046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2640102a80 0x7f2640102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.275+0000 7f264532c640 1 --2- 172.21.15.162:0/26901046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640101920 0x7f2640101d20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.275+0000 7f264532c640 1 -- 172.21.15.162:0/26901046 >> 172.21.15.162:0/26901046 conn(0x7f26400fd1d0 msgr2=0x7f26400ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.275+0000 7f264532c640 1 -- 172.21.15.162:0/26901046 shutdown_connections 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.275+0000 7f264532c640 1 -- 172.21.15.162:0/26901046 wait complete. 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.275+0000 7f264532c640 1 Processor -- start 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f264532c640 1 -- start start 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f264532c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2640101920 0x7f26401a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f264532c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640102a80 0x7f26401a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:05.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f264532c640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2640103440 0x7f26401a6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f264532c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f264010ccc0 con 0x7f2640101920 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f264532c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f264010cb40 con 0x7f2640102a80 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f264532c640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f264010ce40 con 0x7f2640103440 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f263e7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640102a80 0x7f26401a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f263effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2640101920 0x7f26401a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f263e7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640102a80 0x7f26401a3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51504/0 (socket says 172.21.15.162:51504) 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f263e7fc640 1 -- 172.21.15.162:0/3666493811 learned_addr learned my addr 172.21.15.162:0/3666493811 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f263f7fe640 1 --2- 172.21.15.162:0/3666493811 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2640103440 0x7f26401a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f263e7fc640 1 -- 172.21.15.162:0/3666493811 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2640103440 msgr2=0x7f26401a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f263e7fc640 1 --2- 172.21.15.162:0/3666493811 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2640103440 0x7f26401a6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f263e7fc640 1 -- 172.21.15.162:0/3666493811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2640101920 msgr2=0x7f26401a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f263e7fc640 1 --2- 172.21.15.162:0/3666493811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2640101920 0x7f26401a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f263e7fc640 1 -- 172.21.15.162:0/3666493811 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26401a67c0 con 0x7f2640102a80 2024-09-21T17:44:05.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.276+0000 7f263effd640 1 --2- 172.21.15.162:0/3666493811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2640101920 0x7f26401a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.277+0000 7f263e7fc640 1 --2- 172.21.15.162:0/3666493811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640102a80 0x7f26401a3af0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f263400c890 tx=0x7f263400cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.277+0000 7f2627fff640 1 -- 172.21.15.162:0/3666493811 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634004220 con 0x7f2640102a80 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.277+0000 7f264532c640 1 -- 172.21.15.162:0/3666493811 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26401a6ab0 con 0x7f2640102a80 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.277+0000 7f2627fff640 1 -- 172.21.15.162:0/3666493811 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2634007e30 con 0x7f2640102a80 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.277+0000 7f2627fff640 1 -- 172.21.15.162:0/3666493811 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26340047a0 con 0x7f2640102a80 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.277+0000 7f264532c640 1 -- 172.21.15.162:0/3666493811 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26401a6ff0 con 0x7f2640102a80 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.278+0000 7f264532c640 1 -- 172.21.15.162:0/3666493811 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2640101d20 con 0x7f2640102a80 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.279+0000 7f2627fff640 1 -- 172.21.15.162:0/3666493811 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7f26340079b0 con 0x7f2640102a80 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.279+0000 7f2627fff640 1 --2- 172.21.15.162:0/3666493811 >> v2:172.21.15.42:6800/92962027 conn(0x7f262807b020 0x7f262807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.279+0000 7f2627fff640 1 -- 172.21.15.162:0/3666493811 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3205+0+0 (secure 0 0 0) 0x7f263409d380 con 0x7f2640102a80 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.279+0000 7f263effd640 1 --2- 172.21.15.162:0/3666493811 >> v2:172.21.15.42:6800/92962027 conn(0x7f262807b020 0x7f262807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.280+0000 7f263effd640 1 --2- 172.21.15.162:0/3666493811 >> v2:172.21.15.42:6800/92962027 conn(0x7f262807b020 0x7f262807d4e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2630006010 tx=0x7f2630000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:44:05.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.284+0000 7f2627fff640 1 -- 172.21.15.162:0/3666493811 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f2634014030 con 0x7f2640102a80 2024-09-21T17:44:05.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:04 smithi042 ceph-mon[29361]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:05.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:04 smithi042 ceph-mon[29361]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T17:44:05.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:04 smithi042 ceph-mon[38309]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:05.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:04 smithi042 ceph-mon[38309]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T17:44:05.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:05.478+0000 7f264532c640 1 -- 172.21.15.162:0/3666493811 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f264002e8b0 con 0x7f262807b020 2024-09-21T17:44:06.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:05 smithi162 ceph-mon[32106]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:44:06.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:05 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:44:06.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:05 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:44:06.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:05 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:06.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:05 smithi042 ceph-mon[29361]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:44:06.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:05 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:44:06.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:05 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:44:06.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:05 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:06.264 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:05 smithi042 ceph-mon[38309]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:44:06.264 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:05 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:44:06.264 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:05 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:44:06.264 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:06 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:07.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:07 smithi042 ceph-mon[29361]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:07.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:07 smithi042 ceph-mon[38309]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:07.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:07 smithi162 ceph-mon[32106]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:08.245 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/3831165843' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "103163e6-b14d-4ee6-9d77-d4b4dff5307d"} : dispatch 2024-09-21T17:44:08.245 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "103163e6-b14d-4ee6-9d77-d4b4dff5307d"} : dispatch 2024-09-21T17:44:08.245 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "103163e6-b14d-4ee6-9d77-d4b4dff5307d"}]': finished 2024-09-21T17:44:08.245 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:08 smithi162 ceph-mon[32106]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T17:44:08.245 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:08 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:08.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/3831165843' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "103163e6-b14d-4ee6-9d77-d4b4dff5307d"} : dispatch 2024-09-21T17:44:08.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "103163e6-b14d-4ee6-9d77-d4b4dff5307d"} : dispatch 2024-09-21T17:44:08.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "103163e6-b14d-4ee6-9d77-d4b4dff5307d"}]': finished 2024-09-21T17:44:08.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:08 smithi042 ceph-mon[29361]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T17:44:08.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:08 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:08.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/3831165843' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "103163e6-b14d-4ee6-9d77-d4b4dff5307d"} : dispatch 2024-09-21T17:44:08.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "103163e6-b14d-4ee6-9d77-d4b4dff5307d"} : dispatch 2024-09-21T17:44:08.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "103163e6-b14d-4ee6-9d77-d4b4dff5307d"}]': finished 2024-09-21T17:44:08.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:08 smithi042 ceph-mon[38309]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T17:44:08.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:08 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:09.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:09 smithi162 ceph-mon[32106]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:09.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/1533743641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:44:09.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:09 smithi042 ceph-mon[29361]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:09.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/1533743641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:44:09.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:09 smithi042 ceph-mon[38309]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:09.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/1533743641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:44:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:11 smithi162 ceph-mon[32106]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T17:44:11.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:11 smithi042 ceph-mon[29361]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T17:44:11.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:11 smithi042 ceph-mon[38309]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T17:44:13.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:13 smithi162 ceph-mon[32106]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T17:44:13.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:13 smithi042 ceph-mon[29361]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T17:44:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:13 smithi042 ceph-mon[38309]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T17:44:15.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:15 smithi162 ceph-mon[32106]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T17:44:15.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:15 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T17:44:15.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:15 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:15.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:15 smithi162 ceph-mon[32106]: Deploying daemon osd.5 on smithi162 2024-09-21T17:44:15.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:15 smithi042 ceph-mon[29361]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T17:44:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T17:44:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:15 smithi042 ceph-mon[29361]: Deploying daemon osd.5 on smithi162 2024-09-21T17:44:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:15 smithi042 ceph-mon[38309]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T17:44:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:15 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T17:44:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:15 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:15 smithi042 ceph-mon[38309]: Deploying daemon osd.5 on smithi162 2024-09-21T17:44:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:17 smithi162 ceph-mon[32106]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T17:44:17.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:17 smithi042 ceph-mon[29361]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T17:44:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:17 smithi042 ceph-mon[38309]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T17:44:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:19 smithi162 ceph-mon[32106]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T17:44:19.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:19 smithi042 ceph-mon[29361]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T17:44:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:19 smithi042 ceph-mon[38309]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T17:44:21.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:21 smithi162 ceph-mon[32106]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T17:44:21.536 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:21 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:21.536 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:21 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:21.536 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:21 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:21.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:21 smithi042 ceph-mon[29361]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T17:44:21.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:21 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:21 smithi042 ceph-mon[38309]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T17:44:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:21 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:21 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:21 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:24.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[38309]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:24.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:24.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:24.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:24.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:24.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:24.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[29361]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:24.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:24.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:24.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:24.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:24.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:23 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:24.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:23 smithi162 ceph-mon[32106]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:24.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:23 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:24.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:23 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:24.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:23 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:24.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:23 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:24.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:23 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:24.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.702+0000 7f2627fff640 1 -- 172.21.15.162:0/3666493811 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f264002e8b0 con 0x7f262807b020 2024-09-21T17:44:24.705 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 5 on host 'smithi162' 2024-09-21T17:44:24.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 -- 172.21.15.162:0/3666493811 >> v2:172.21.15.42:6800/92962027 conn(0x7f262807b020 msgr2=0x7f262807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:24.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 --2- 172.21.15.162:0/3666493811 >> v2:172.21.15.42:6800/92962027 conn(0x7f262807b020 0x7f262807d4e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2630006010 tx=0x7f2630000bc0 comp rx=0 tx=0).stop 2024-09-21T17:44:24.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 -- 172.21.15.162:0/3666493811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640102a80 msgr2=0x7f26401a3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:24.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 --2- 172.21.15.162:0/3666493811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640102a80 0x7f26401a3af0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f263400c890 tx=0x7f263400cd50 comp rx=0 tx=0).stop 2024-09-21T17:44:24.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 -- 172.21.15.162:0/3666493811 shutdown_connections 2024-09-21T17:44:24.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 --2- 172.21.15.162:0/3666493811 >> v2:172.21.15.42:6800/92962027 conn(0x7f262807b020 0x7f262807d4e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:24.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 --2- 172.21.15.162:0/3666493811 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2640103440 0x7f26401a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:24.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 --2- 172.21.15.162:0/3666493811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640102a80 0x7f26401a3af0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:24.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 --2- 172.21.15.162:0/3666493811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2640101920 0x7f26401a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:24.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 -- 172.21.15.162:0/3666493811 >> 172.21.15.162:0/3666493811 conn(0x7f26400fd1d0 msgr2=0x7f26400feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:44:24.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 -- 172.21.15.162:0/3666493811 shutdown_connections 2024-09-21T17:44:24.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:24.704+0000 7f264532c640 1 -- 172.21.15.162:0/3666493811 wait complete. 2024-09-21T17:44:25.068 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:24 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:25.069 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:24 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:25.069 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:24 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:25.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:24 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:25.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:24 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:25.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:24 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:25.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:24 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:25.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:24 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:25.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:24 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:25.379 DEBUG:teuthology.orchestra.run.smithi162:osd.5> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.5.service 2024-09-21T17:44:25.381 INFO:tasks.cephadm:Deploying osd.6 on smithi162 with /dev/vg_nvme/lv_2... 2024-09-21T17:44:25.382 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T17:44:26.182 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:25 smithi162 ceph-mon[32106]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:26.183 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 17:44:26 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T17:44:26.157+0000 7f4ec9b8b640 -1 osd.5 0 log_to_monitors true 2024-09-21T17:44:26.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:25 smithi042 ceph-mon[29361]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:26.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:25 smithi042 ceph-mon[38309]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:26.531 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:44:27.063 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:26 smithi162 ceph-mon[32106]: from='osd.5 v2:172.21.15.162:6804/338151964' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T17:44:27.063 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:26 smithi162 ceph-mon[32106]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T17:44:27.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:26 smithi042 ceph-mon[29361]: from='osd.5 v2:172.21.15.162:6804/338151964' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T17:44:27.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:26 smithi042 ceph-mon[29361]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T17:44:27.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:26 smithi042 ceph-mon[38309]: from='osd.5 v2:172.21.15.162:6804/338151964' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T17:44:27.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:26 smithi042 ceph-mon[38309]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T17:44:28.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:27 smithi162 ceph-mon[32106]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:28.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:27 smithi162 ceph-mon[32106]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T17:44:28.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:27 smithi162 ceph-mon[32106]: from='osd.5 v2:172.21.15.162:6804/338151964' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:28.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:27 smithi162 ceph-mon[32106]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T17:44:28.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:27 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:28.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:27 smithi162 ceph-mon[32106]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:28.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[29361]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:28.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[29361]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T17:44:28.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[29361]: from='osd.5 v2:172.21.15.162:6804/338151964' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:28.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[29361]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T17:44:28.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:28.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[29361]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:28.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[38309]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:28.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[38309]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T17:44:28.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[38309]: from='osd.5 v2:172.21.15.162:6804/338151964' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:28.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[38309]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T17:44:28.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:28.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:27 smithi042 ceph-mon[38309]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:28.575 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T17:44:28.367+0000 7f4ec5b0e640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T17:44:28.575 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T17:44:28.371+0000 7f4ebd92d640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T17:44:29.003 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:44:29.003 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T17:44:29.003 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:29.003 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:29.004 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='osd.5 ' entity='osd.5' 2024-09-21T17:44:29.004 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:29.004 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:29.004 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:29.004 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:29.004 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:29.004 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:29.004 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:29.004 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='osd.5 ' entity='osd.5' 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:29.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='osd.5 ' entity='osd.5' 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:29.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:29.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:30.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:29 smithi162 ceph-mon[32106]: purged_snaps scrub starts 2024-09-21T17:44:30.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:29 smithi162 ceph-mon[32106]: purged_snaps scrub ok 2024-09-21T17:44:30.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:29 smithi162 ceph-mon[32106]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:30.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:29 smithi162 ceph-mon[32106]: Detected new or changed devices on smithi162 2024-09-21T17:44:30.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:29 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T17:44:30.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:29 smithi162 ceph-mon[32106]: osd.5 v2:172.21.15.162:6804/338151964 boot 2024-09-21T17:44:30.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:29 smithi162 ceph-mon[32106]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T17:44:30.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:29 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:30.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:29 smithi162 ceph-mon[32106]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T17:44:30.048 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:44:30.080 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2024-09-21T17:44:30.329 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:44:30.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[29361]: purged_snaps scrub starts 2024-09-21T17:44:30.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[29361]: purged_snaps scrub ok 2024-09-21T17:44:30.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[29361]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:30.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[29361]: Detected new or changed devices on smithi162 2024-09-21T17:44:30.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T17:44:30.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[29361]: osd.5 v2:172.21.15.162:6804/338151964 boot 2024-09-21T17:44:30.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[29361]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T17:44:30.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:30.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[29361]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T17:44:30.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[38309]: purged_snaps scrub starts 2024-09-21T17:44:30.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[38309]: purged_snaps scrub ok 2024-09-21T17:44:30.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[38309]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T17:44:30.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[38309]: Detected new or changed devices on smithi162 2024-09-21T17:44:30.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T17:44:30.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[38309]: osd.5 v2:172.21.15.162:6804/338151964 boot 2024-09-21T17:44:30.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[38309]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T17:44:30.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:44:30.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:29 smithi042 ceph-mon[38309]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T17:44:30.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.762+0000 7f8c404a3640 1 -- 172.21.15.162:0/2746140577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c38103430 msgr2=0x7f8c38109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:30.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.762+0000 7f8c404a3640 1 --2- 172.21.15.162:0/2746140577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c38103430 0x7f8c38109db0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009930 tx=0x7f8c3002a420 comp rx=0 tx=0).stop 2024-09-21T17:44:30.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.762+0000 7f8c404a3640 1 -- 172.21.15.162:0/2746140577 shutdown_connections 2024-09-21T17:44:30.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.762+0000 7f8c404a3640 1 --2- 172.21.15.162:0/2746140577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c38103430 0x7f8c38109db0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:30.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.762+0000 7f8c404a3640 1 --2- 172.21.15.162:0/2746140577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c38102a70 0x7f8c38102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:30.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.762+0000 7f8c404a3640 1 --2- 172.21.15.162:0/2746140577 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8c38101910 0x7f8c38101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:30.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.762+0000 7f8c404a3640 1 -- 172.21.15.162:0/2746140577 >> 172.21.15.162:0/2746140577 conn(0x7f8c380fd200 msgr2=0x7f8c380ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:44:30.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.762+0000 7f8c404a3640 1 -- 172.21.15.162:0/2746140577 shutdown_connections 2024-09-21T17:44:30.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.762+0000 7f8c404a3640 1 -- 172.21.15.162:0/2746140577 wait complete. 2024-09-21T17:44:30.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.762+0000 7f8c404a3640 1 Processor -- start 2024-09-21T17:44:30.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c404a3640 1 -- start start 2024-09-21T17:44:30.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c404a3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c38101910 0x7f8c38197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:30.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c404a3640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8c38102a70 0x7f8c38197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:30.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c404a3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c38103430 0x7f8c381986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:30.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c404a3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3810cc50 con 0x7f8c38101910 2024-09-21T17:44:30.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c404a3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3810cad0 con 0x7f8c38103430 2024-09-21T17:44:30.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c404a3640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f8c3810cdd0 con 0x7f8c38102a70 2024-09-21T17:44:30.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c3ea40640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c38103430 0x7f8c381986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:30.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c3ea40640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c38103430 0x7f8c381986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45168/0 (socket says 172.21.15.162:45168) 2024-09-21T17:44:30.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c3ea40640 1 -- 172.21.15.162:0/2550571062 learned_addr learned my addr 172.21.15.162:0/2550571062 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:44:30.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c3e23f640 1 --2- 172.21.15.162:0/2550571062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c38101910 0x7f8c38197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:30.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c3da3e640 1 --2- 172.21.15.162:0/2550571062 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8c38102a70 0x7f8c38197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:30.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c3ea40640 1 -- 172.21.15.162:0/2550571062 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8c38102a70 msgr2=0x7f8c38197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:30.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c3ea40640 1 --2- 172.21.15.162:0/2550571062 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8c38102a70 0x7f8c38197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:30.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c3ea40640 1 -- 172.21.15.162:0/2550571062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c38101910 msgr2=0x7f8c38197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:30.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c3ea40640 1 --2- 172.21.15.162:0/2550571062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c38101910 0x7f8c38197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:30.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c3ea40640 1 -- 172.21.15.162:0/2550571062 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c38198f60 con 0x7f8c38103430 2024-09-21T17:44:30.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c3ea40640 1 --2- 172.21.15.162:0/2550571062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c38103430 0x7f8c381986c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c30005940 tx=0x7f8c30032bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:44:30.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c377fe640 1 -- 172.21.15.162:0/2550571062 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3003f030 con 0x7f8c38103430 2024-09-21T17:44:30.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c377fe640 1 -- 172.21.15.162:0/2550571062 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f8c30003a70 con 0x7f8c38103430 2024-09-21T17:44:30.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c404a3640 1 -- 172.21.15.162:0/2550571062 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c381991f0 con 0x7f8c38103430 2024-09-21T17:44:30.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.763+0000 7f8c377fe640 1 -- 172.21.15.162:0/2550571062 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30035070 con 0x7f8c38103430 2024-09-21T17:44:30.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.764+0000 7f8c404a3640 1 -- 172.21.15.162:0/2550571062 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c3819f760 con 0x7f8c38103430 2024-09-21T17:44:30.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.764+0000 7f8c404a3640 1 -- 172.21.15.162:0/2550571062 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c38101d10 con 0x7f8c38103430 2024-09-21T17:44:30.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.765+0000 7f8c377fe640 1 -- 172.21.15.162:0/2550571062 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7f8c30042030 con 0x7f8c38103430 2024-09-21T17:44:30.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.766+0000 7f8c377fe640 1 --2- 172.21.15.162:0/2550571062 >> v2:172.21.15.42:6800/92962027 conn(0x7f8c2007b020 0x7f8c2007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:30.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.766+0000 7f8c377fe640 1 -- 172.21.15.162:0/2550571062 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 3497+0+0 (secure 0 0 0) 0x7f8c300bde80 con 0x7f8c38103430 2024-09-21T17:44:30.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.766+0000 7f8c3e23f640 1 --2- 172.21.15.162:0/2550571062 >> v2:172.21.15.42:6800/92962027 conn(0x7f8c2007b020 0x7f8c2007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:30.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.766+0000 7f8c3e23f640 1 --2- 172.21.15.162:0/2550571062 >> v2:172.21.15.42:6800/92962027 conn(0x7f8c2007b020 0x7f8c2007d4e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c28005fd0 tx=0x7f8c28009870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:44:30.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.770+0000 7f8c377fe640 1 -- 172.21.15.162:0/2550571062 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f8c30085b00 con 0x7f8c38103430 2024-09-21T17:44:30.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:30.958+0000 7f8c404a3640 1 -- 172.21.15.162:0/2550571062 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8c3802e840 con 0x7f8c2007b020 2024-09-21T17:44:31.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:31 smithi162 ceph-mon[32106]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T17:44:31.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:31 smithi162 ceph-mon[32106]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 430 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:31.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:31 smithi162 ceph-mon[32106]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:44:31.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:31 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:44:31.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:31 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:44:31.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:31 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:31.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[29361]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T17:44:31.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[29361]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 430 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:31.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[29361]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:44:31.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:44:31.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:44:31.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:31.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[38309]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T17:44:31.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[38309]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 430 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:31.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[38309]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:44:31.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:44:31.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:44:31.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:31 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:33.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:33 smithi162 ceph-mon[32106]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 430 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:33.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/2805009239' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e0bbf2-8a36-4546-865c-694ce6a59196"} : dispatch 2024-09-21T17:44:33.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e0bbf2-8a36-4546-865c-694ce6a59196"} : dispatch 2024-09-21T17:44:33.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21e0bbf2-8a36-4546-865c-694ce6a59196"}]': finished 2024-09-21T17:44:33.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:33 smithi162 ceph-mon[32106]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T17:44:33.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:33 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[38309]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 430 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/2805009239' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e0bbf2-8a36-4546-865c-694ce6a59196"} : dispatch 2024-09-21T17:44:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e0bbf2-8a36-4546-865c-694ce6a59196"} : dispatch 2024-09-21T17:44:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21e0bbf2-8a36-4546-865c-694ce6a59196"}]': finished 2024-09-21T17:44:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[38309]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T17:44:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[29361]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 430 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/2805009239' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e0bbf2-8a36-4546-865c-694ce6a59196"} : dispatch 2024-09-21T17:44:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e0bbf2-8a36-4546-865c-694ce6a59196"} : dispatch 2024-09-21T17:44:33.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21e0bbf2-8a36-4546-865c-694ce6a59196"}]': finished 2024-09-21T17:44:33.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[29361]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T17:44:33.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:33 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/1897971639' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:44:34.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/1897971639' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:44:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/1897971639' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:44:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:35 smithi162 ceph-mon[32106]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:35.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:35 smithi042 ceph-mon[29361]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:35 smithi042 ceph-mon[38309]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:37 smithi162 ceph-mon[32106]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:37 smithi042 ceph-mon[29361]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:37 smithi042 ceph-mon[38309]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:39.451 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:39 smithi162 ceph-mon[32106]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:39.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:39 smithi042 ceph-mon[29361]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:39 smithi042 ceph-mon[38309]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:41 smithi162 ceph-mon[32106]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:41.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T17:44:41.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:41 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:41.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:41 smithi162 ceph-mon[32106]: Deploying daemon osd.6 on smithi162 2024-09-21T17:44:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:41 smithi042 ceph-mon[29361]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T17:44:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:41 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:41 smithi042 ceph-mon[29361]: Deploying daemon osd.6 on smithi162 2024-09-21T17:44:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:41 smithi042 ceph-mon[38309]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T17:44:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:41 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:41 smithi042 ceph-mon[38309]: Deploying daemon osd.6 on smithi162 2024-09-21T17:44:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:43 smithi162 ceph-mon[32106]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:43 smithi042 ceph-mon[29361]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:43 smithi042 ceph-mon[38309]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:45.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:45 smithi162 ceph-mon[32106]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:45 smithi042 ceph-mon[29361]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:45 smithi042 ceph-mon[38309]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:47 smithi162 ceph-mon[32106]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:47 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:47 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:47 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:47.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:47 smithi042 ceph-mon[29361]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:47 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:47 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:47 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:47 smithi042 ceph-mon[38309]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:47 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:47 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:47 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:49.931 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 6 on host 'smithi162' 2024-09-21T17:44:49.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.929+0000 7f8c377fe640 1 -- 172.21.15.162:0/2550571062 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8c3802e840 con 0x7f8c2007b020 2024-09-21T17:44:49.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.931+0000 7f8c404a3640 1 -- 172.21.15.162:0/2550571062 >> v2:172.21.15.42:6800/92962027 conn(0x7f8c2007b020 msgr2=0x7f8c2007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:49.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.931+0000 7f8c404a3640 1 --2- 172.21.15.162:0/2550571062 >> v2:172.21.15.42:6800/92962027 conn(0x7f8c2007b020 0x7f8c2007d4e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c28005fd0 tx=0x7f8c28009870 comp rx=0 tx=0).stop 2024-09-21T17:44:49.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.931+0000 7f8c404a3640 1 -- 172.21.15.162:0/2550571062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c38103430 msgr2=0x7f8c381986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:49.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.931+0000 7f8c404a3640 1 --2- 172.21.15.162:0/2550571062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c38103430 0x7f8c381986c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c30005940 tx=0x7f8c30032bc0 comp rx=0 tx=0).stop 2024-09-21T17:44:49.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.931+0000 7f8c404a3640 1 -- 172.21.15.162:0/2550571062 shutdown_connections 2024-09-21T17:44:49.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.931+0000 7f8c404a3640 1 --2- 172.21.15.162:0/2550571062 >> v2:172.21.15.42:6800/92962027 conn(0x7f8c2007b020 0x7f8c2007d4e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:49.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.931+0000 7f8c404a3640 1 --2- 172.21.15.162:0/2550571062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c38103430 0x7f8c381986c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:49.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.931+0000 7f8c404a3640 1 --2- 172.21.15.162:0/2550571062 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8c38102a70 0x7f8c38197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:49.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.931+0000 7f8c404a3640 1 --2- 172.21.15.162:0/2550571062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c38101910 0x7f8c38197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:49.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.931+0000 7f8c404a3640 1 -- 172.21.15.162:0/2550571062 >> 172.21.15.162:0/2550571062 conn(0x7f8c380fd200 msgr2=0x7f8c380fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:44:49.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.932+0000 7f8c404a3640 1 -- 172.21.15.162:0/2550571062 shutdown_connections 2024-09-21T17:44:49.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:49.932+0000 7f8c404a3640 1 -- 172.21.15.162:0/2550571062 wait complete. 2024-09-21T17:44:50.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[38309]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[29361]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:49 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:50.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:49 smithi162 ceph-mon[32106]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:50.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:49 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:50.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:49 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:50.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:49 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:50.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:49 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:50.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:49 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:50.527 DEBUG:teuthology.orchestra.run.smithi162:osd.6> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.6.service 2024-09-21T17:44:50.530 INFO:tasks.cephadm:Deploying osd.7 on smithi162 with /dev/vg_nvme/lv_1... 2024-09-21T17:44:50.530 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T17:44:51.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:50 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:51.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:50 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:51.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:50 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:51.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:50 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:51.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:50 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:51.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:50 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:50 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:44:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:50 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:50 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:51.670 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:44:51.746 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 17:44:51 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T17:44:51.416+0000 7f30d8fb7640 -1 osd.6 0 log_to_monitors true 2024-09-21T17:44:51.999 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:51 smithi162 ceph-mon[32106]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:51.999 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:51 smithi162 ceph-mon[32106]: from='osd.6 v2:172.21.15.162:6808/1056184078' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T17:44:51.999 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:51 smithi162 ceph-mon[32106]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T17:44:52.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:51 smithi042 ceph-mon[29361]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:52.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:51 smithi042 ceph-mon[29361]: from='osd.6 v2:172.21.15.162:6808/1056184078' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T17:44:52.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:51 smithi042 ceph-mon[29361]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T17:44:52.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:51 smithi042 ceph-mon[38309]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:52.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:51 smithi042 ceph-mon[38309]: from='osd.6 v2:172.21.15.162:6808/1056184078' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T17:44:52.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:51 smithi042 ceph-mon[38309]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T17:44:53.248 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 17:44:52 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T17:44:52.940+0000 7f30d4f3a640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T17:44:53.248 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 17:44:52 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T17:44:52.947+0000 7f30d0d61640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T17:44:53.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:52 smithi162 ceph-mon[32106]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T17:44:53.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:52 smithi162 ceph-mon[32106]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T17:44:53.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:52 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:53.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:52 smithi162 ceph-mon[32106]: from='osd.6 v2:172.21.15.162:6808/1056184078' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:53.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:52 smithi162 ceph-mon[32106]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:53.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:52 smithi042 ceph-mon[29361]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T17:44:53.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:52 smithi042 ceph-mon[29361]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T17:44:53.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:52 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:53.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:52 smithi042 ceph-mon[29361]: from='osd.6 v2:172.21.15.162:6808/1056184078' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:53.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:52 smithi042 ceph-mon[29361]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:53.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:52 smithi042 ceph-mon[38309]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T17:44:53.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:52 smithi042 ceph-mon[38309]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T17:44:53.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:52 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:53.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:52 smithi042 ceph-mon[38309]: from='osd.6 v2:172.21.15.162:6808/1056184078' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:53.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:52 smithi042 ceph-mon[38309]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:44:54.157 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:54.158 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:53 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:54.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:54.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:54.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:54.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:44:54.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:53 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:44:55.228 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:54 smithi162 ceph-mon[32106]: purged_snaps scrub starts 2024-09-21T17:44:55.228 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:54 smithi162 ceph-mon[32106]: purged_snaps scrub ok 2024-09-21T17:44:55.228 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:54 smithi162 ceph-mon[32106]: Detected new or changed devices on smithi162 2024-09-21T17:44:55.228 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:54 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T17:44:55.228 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:54 smithi162 ceph-mon[32106]: osd.6 v2:172.21.15.162:6808/1056184078 boot 2024-09-21T17:44:55.228 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:54 smithi162 ceph-mon[32106]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T17:44:55.228 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:54 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:55.229 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:54 smithi162 ceph-mon[32106]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T17:44:55.231 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T17:44:55.257 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2024-09-21T17:44:55.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[29361]: purged_snaps scrub starts 2024-09-21T17:44:55.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[29361]: purged_snaps scrub ok 2024-09-21T17:44:55.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[29361]: Detected new or changed devices on smithi162 2024-09-21T17:44:55.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T17:44:55.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[29361]: osd.6 v2:172.21.15.162:6808/1056184078 boot 2024-09-21T17:44:55.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[29361]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T17:44:55.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:55.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[29361]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T17:44:55.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[38309]: purged_snaps scrub starts 2024-09-21T17:44:55.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[38309]: purged_snaps scrub ok 2024-09-21T17:44:55.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[38309]: Detected new or changed devices on smithi162 2024-09-21T17:44:55.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T17:44:55.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[38309]: osd.6 v2:172.21.15.162:6808/1056184078 boot 2024-09-21T17:44:55.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[38309]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T17:44:55.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:44:55.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:54 smithi042 ceph-mon[38309]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T17:44:55.502 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:44:55.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.903+0000 7f31f2392640 1 -- 172.21.15.162:0/3402471121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31ec102a40 msgr2=0x7f31ec102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:55.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.903+0000 7f31f2392640 1 --2- 172.21.15.162:0/3402471121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31ec102a40 0x7f31ec102ec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009930 tx=0x7f31e002a420 comp rx=0 tx=0).stop 2024-09-21T17:44:55.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.903+0000 7f31f2392640 1 -- 172.21.15.162:0/3402471121 shutdown_connections 2024-09-21T17:44:55.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.903+0000 7f31f2392640 1 --2- 172.21.15.162:0/3402471121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ec103400 0x7f31ec109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:55.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.903+0000 7f31f2392640 1 --2- 172.21.15.162:0/3402471121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31ec102a40 0x7f31ec102ec0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:55.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.903+0000 7f31f2392640 1 --2- 172.21.15.162:0/3402471121 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f31ec1018e0 0x7f31ec101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:55.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.903+0000 7f31f2392640 1 -- 172.21.15.162:0/3402471121 >> 172.21.15.162:0/3402471121 conn(0x7f31ec0fd1b0 msgr2=0x7f31ec0ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:44:55.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.903+0000 7f31f2392640 1 -- 172.21.15.162:0/3402471121 shutdown_connections 2024-09-21T17:44:55.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.903+0000 7f31f2392640 1 -- 172.21.15.162:0/3402471121 wait complete. 2024-09-21T17:44:55.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.904+0000 7f31f2392640 1 Processor -- start 2024-09-21T17:44:55.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.904+0000 7f31f2392640 1 -- start start 2024-09-21T17:44:55.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.904+0000 7f31f2392640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31ec1018e0 0x7f31ec1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:55.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.904+0000 7f31f2392640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ec102a40 0x7f31ec198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:55.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.904+0000 7f31f2392640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f31ec103400 0x7f31ec199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:55.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.904+0000 7f31f2392640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec10dd90 con 0x7f31ec102a40 2024-09-21T17:44:55.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.904+0000 7f31f2392640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec10dc10 con 0x7f31ec1018e0 2024-09-21T17:44:55.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.904+0000 7f31f2392640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec10df10 con 0x7f31ec103400 2024-09-21T17:44:55.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31ebfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31ec1018e0 0x7f31ec1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:55.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31ebfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31ec1018e0 0x7f31ec1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:37840/0 (socket says 172.21.15.162:37840) 2024-09-21T17:44:55.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31ebfff640 1 -- 172.21.15.162:0/1187162755 learned_addr learned my addr 172.21.15.162:0/1187162755 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:44:55.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31eb7fe640 1 --2- 172.21.15.162:0/1187162755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ec102a40 0x7f31ec198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31f092f640 1 --2- 172.21.15.162:0/1187162755 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f31ec103400 0x7f31ec199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31ebfff640 1 -- 172.21.15.162:0/1187162755 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f31ec103400 msgr2=0x7f31ec199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31ebfff640 1 --2- 172.21.15.162:0/1187162755 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f31ec103400 0x7f31ec199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31ebfff640 1 -- 172.21.15.162:0/1187162755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ec102a40 msgr2=0x7f31ec198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31ebfff640 1 --2- 172.21.15.162:0/1187162755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ec102a40 0x7f31ec198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31ebfff640 1 -- 172.21.15.162:0/1187162755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec19a020 con 0x7f31ec1018e0 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31eb7fe640 1 --2- 172.21.15.162:0/1187162755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ec102a40 0x7f31ec198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31ebfff640 1 --2- 172.21.15.162:0/1187162755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31ec1018e0 0x7f31ec1984f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00d770 tx=0x7f31dc00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31e97fa640 1 -- 172.21.15.162:0/1187162755 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc017070 con 0x7f31ec1018e0 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31e97fa640 1 -- 172.21.15.162:0/1187162755 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f31dc0054a0 con 0x7f31ec1018e0 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31f2392640 1 -- 172.21.15.162:0/1187162755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ec19a310 con 0x7f31ec1018e0 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31e97fa640 1 -- 172.21.15.162:0/1187162755 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc004c40 con 0x7f31ec1018e0 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.905+0000 7f31f2392640 1 -- 172.21.15.162:0/1187162755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ec1a09f0 con 0x7f31ec1018e0 2024-09-21T17:44:55.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.906+0000 7f31f2392640 1 -- 172.21.15.162:0/1187162755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ec101ce0 con 0x7f31ec1018e0 2024-09-21T17:44:55.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.907+0000 7f31e97fa640 1 -- 172.21.15.162:0/1187162755 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7f31dc004de0 con 0x7f31ec1018e0 2024-09-21T17:44:55.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.907+0000 7f31e97fa640 1 --2- 172.21.15.162:0/1187162755 >> v2:172.21.15.42:6800/92962027 conn(0x7f31d407b020 0x7f31d407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:44:55.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.907+0000 7f31e97fa640 1 -- 172.21.15.162:0/1187162755 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 3789+0+0 (secure 0 0 0) 0x7f31dc09d400 con 0x7f31ec1018e0 2024-09-21T17:44:55.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.907+0000 7f31eb7fe640 1 --2- 172.21.15.162:0/1187162755 >> v2:172.21.15.42:6800/92962027 conn(0x7f31d407b020 0x7f31d407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:44:55.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.908+0000 7f31eb7fe640 1 --2- 172.21.15.162:0/1187162755 >> v2:172.21.15.42:6800/92962027 conn(0x7f31d407b020 0x7f31d407d4e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f31e0000c00 tx=0x7f31e0031610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:44:55.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:55.912+0000 7f31e97fa640 1 -- 172.21.15.162:0/1187162755 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f31dc064f60 con 0x7f31ec1018e0 2024-09-21T17:44:56.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:44:56.102+0000 7f31f2392640 1 -- 172.21.15.162:0/1187162755 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f31ec02e780 con 0x7f31d407b020 2024-09-21T17:44:56.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:55 smithi162 ceph-mon[32106]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:44:56.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:55 smithi162 ceph-mon[32106]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T17:44:56.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:55 smithi042 ceph-mon[29361]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:44:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:55 smithi042 ceph-mon[29361]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T17:44:56.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:55 smithi042 ceph-mon[38309]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:44:56.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:55 smithi042 ceph-mon[38309]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T17:44:57.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:56 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:44:57.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:56 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:44:57.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:56 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:57.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:56 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:44:57.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:56 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:44:57.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:56 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:57.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:56 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T17:44:57.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:56 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T17:44:57.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:56 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:44:58.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:57 smithi162 ceph-mon[32106]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:44:58.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:57 smithi162 ceph-mon[32106]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:44:58.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:57 smithi042 ceph-mon[29361]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:44:58.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:57 smithi042 ceph-mon[29361]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:44:58.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:57 smithi042 ceph-mon[38309]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:44:58.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:57 smithi042 ceph-mon[38309]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:44:59.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/1439434155' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd25c4ad-3134-4199-aa32-18895d561ccf"} : dispatch 2024-09-21T17:44:59.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd25c4ad-3134-4199-aa32-18895d561ccf"} : dispatch 2024-09-21T17:44:59.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd25c4ad-3134-4199-aa32-18895d561ccf"}]': finished 2024-09-21T17:44:59.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:58 smithi162 ceph-mon[32106]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T17:44:59.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:58 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:44:59.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/1439434155' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd25c4ad-3134-4199-aa32-18895d561ccf"} : dispatch 2024-09-21T17:44:59.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd25c4ad-3134-4199-aa32-18895d561ccf"} : dispatch 2024-09-21T17:44:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd25c4ad-3134-4199-aa32-18895d561ccf"}]': finished 2024-09-21T17:44:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:58 smithi042 ceph-mon[29361]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T17:44:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:58 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:44:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/1439434155' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd25c4ad-3134-4199-aa32-18895d561ccf"} : dispatch 2024-09-21T17:44:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd25c4ad-3134-4199-aa32-18895d561ccf"} : dispatch 2024-09-21T17:44:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd25c4ad-3134-4199-aa32-18895d561ccf"}]': finished 2024-09-21T17:44:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:58 smithi042 ceph-mon[38309]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T17:44:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:58 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:00.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:59 smithi162 ceph-mon[32106]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:00.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:44:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/3850263635' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:45:00.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:59 smithi042 ceph-mon[29361]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:00.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:44:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/3850263635' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:45:00.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:59 smithi042 ceph-mon[38309]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:00.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:44:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/3850263635' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T17:45:02.306 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:01 smithi162 ceph-mon[32106]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:02.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:01 smithi042 ceph-mon[29361]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:02.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:01 smithi042 ceph-mon[38309]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:04.047 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:03 smithi162 ceph-mon[32106]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:04.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:03 smithi042 ceph-mon[29361]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:04.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:03 smithi042 ceph-mon[38309]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:06.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:05 smithi162 ceph-mon[32106]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:06.249 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:05 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T17:45:06.249 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:05 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:06.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:05 smithi042 ceph-mon[29361]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:05 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T17:45:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:05 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:06.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:05 smithi042 ceph-mon[38309]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:06.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:05 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T17:45:06.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:05 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:07.230 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:06 smithi162 ceph-mon[32106]: Deploying daemon osd.7 on smithi162 2024-09-21T17:45:07.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:06 smithi042 ceph-mon[29361]: Deploying daemon osd.7 on smithi162 2024-09-21T17:45:07.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:06 smithi042 ceph-mon[38309]: Deploying daemon osd.7 on smithi162 2024-09-21T17:45:08.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:07 smithi162 ceph-mon[32106]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:08.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:07 smithi042 ceph-mon[29361]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:08.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:07 smithi042 ceph-mon[38309]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:10.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:09 smithi162 ceph-mon[32106]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:10.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:09 smithi042 ceph-mon[29361]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:10.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:09 smithi042 ceph-mon[38309]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:12.200 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:11 smithi162 ceph-mon[32106]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:12.200 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:11 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:12.200 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:11 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:12.200 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:11 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:12.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:11 smithi042 ceph-mon[29361]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:11 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:11 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:11 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:12.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:11 smithi042 ceph-mon[38309]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:12.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:11 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:12.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:11 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:12.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:11 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:14.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:13 smithi162 ceph-mon[32106]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:14.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:13 smithi042 ceph-mon[29361]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:14.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:13 smithi042 ceph-mon[38309]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:14.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.850+0000 7f31e97fa640 1 -- 172.21.15.162:0/1187162755 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f31ec02e780 con 0x7f31d407b020 2024-09-21T17:45:14.854 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 7 on host 'smithi162' 2024-09-21T17:45:14.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.852+0000 7f31f2392640 1 -- 172.21.15.162:0/1187162755 >> v2:172.21.15.42:6800/92962027 conn(0x7f31d407b020 msgr2=0x7f31d407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:14.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.853+0000 7f31f2392640 1 --2- 172.21.15.162:0/1187162755 >> v2:172.21.15.42:6800/92962027 conn(0x7f31d407b020 0x7f31d407d4e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f31e0000c00 tx=0x7f31e0031610 comp rx=0 tx=0).stop 2024-09-21T17:45:14.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.853+0000 7f31f2392640 1 -- 172.21.15.162:0/1187162755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31ec1018e0 msgr2=0x7f31ec1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:14.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.853+0000 7f31f2392640 1 --2- 172.21.15.162:0/1187162755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31ec1018e0 0x7f31ec1984f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00d770 tx=0x7f31dc00dc30 comp rx=0 tx=0).stop 2024-09-21T17:45:14.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.853+0000 7f31f2392640 1 -- 172.21.15.162:0/1187162755 shutdown_connections 2024-09-21T17:45:14.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.853+0000 7f31f2392640 1 --2- 172.21.15.162:0/1187162755 >> v2:172.21.15.42:6800/92962027 conn(0x7f31d407b020 0x7f31d407d4e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:14.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.853+0000 7f31f2392640 1 --2- 172.21.15.162:0/1187162755 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f31ec103400 0x7f31ec199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:14.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.853+0000 7f31f2392640 1 --2- 172.21.15.162:0/1187162755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ec102a40 0x7f31ec198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:14.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.853+0000 7f31f2392640 1 --2- 172.21.15.162:0/1187162755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31ec1018e0 0x7f31ec1984f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:14.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.853+0000 7f31f2392640 1 -- 172.21.15.162:0/1187162755 >> 172.21.15.162:0/1187162755 conn(0x7f31ec0fd1b0 msgr2=0x7f31ec0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:14.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.853+0000 7f31f2392640 1 -- 172.21.15.162:0/1187162755 shutdown_connections 2024-09-21T17:45:14.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:14.853+0000 7f31f2392640 1 -- 172.21.15.162:0/1187162755 wait complete. 2024-09-21T17:45:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:15 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:15 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:15 smithi162 ceph-mon[32106]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:15.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:15 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:15.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:15 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:15.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:15 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:15 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:15.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:15 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:15 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[29361]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[38309]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:15 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:15.522 DEBUG:teuthology.orchestra.run.smithi162:osd.7> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.7.service 2024-09-21T17:45:15.525 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-09-21T17:45:15.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T17:45:15.792 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.230+0000 7fb0cce61640 1 -- 172.21.15.42:0/690986525 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0c8101920 msgr2=0x7fb0c8101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.230+0000 7fb0cce61640 1 --2- 172.21.15.42:0/690986525 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0c8101920 0x7fb0c8101d20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8009960 tx=0x7fb0b802a460 comp rx=0 tx=0).stop 2024-09-21T17:45:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.230+0000 7fb0cce61640 1 -- 172.21.15.42:0/690986525 shutdown_connections 2024-09-21T17:45:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.230+0000 7fb0cce61640 1 --2- 172.21.15.42:0/690986525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0c8103440 0x7fb0c8109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.230+0000 7fb0cce61640 1 --2- 172.21.15.42:0/690986525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0c8102a80 0x7fb0c8102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.230+0000 7fb0cce61640 1 --2- 172.21.15.42:0/690986525 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0c8101920 0x7fb0c8101d20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.230+0000 7fb0cce61640 1 -- 172.21.15.42:0/690986525 >> 172.21.15.42:0/690986525 conn(0x7fb0c80fd1d0 msgr2=0x7fb0c80ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.230+0000 7fb0cce61640 1 -- 172.21.15.42:0/690986525 shutdown_connections 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.230+0000 7fb0cce61640 1 -- 172.21.15.42:0/690986525 wait complete. 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0cce61640 1 Processor -- start 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0cce61640 1 -- start start 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0cce61640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0c8101920 0x7fb0c806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0cce61640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0c8102a80 0x7fb0c819d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0cce61640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0c8103440 0x7fb0c819f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0cce61640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c810ccc0 con 0x7fb0c8101920 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0cce61640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c810cb40 con 0x7fb0c8102a80 2024-09-21T17:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0cce61640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c810ce40 con 0x7fb0c8103440 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0c6d9d640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0c8103440 0x7fb0c819f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0c659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0c8101920 0x7fb0c806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0c6d9d640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0c8103440 0x7fb0c819f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:35994/0 (socket says 172.21.15.42:35994) 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0c6d9d640 1 -- 172.21.15.42:0/1472341487 learned_addr learned my addr 172.21.15.42:0/1472341487 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0c659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0c8101920 0x7fb0c806bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51988/0 (socket says 172.21.15.42:51988) 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.231+0000 7fb0c5d9b640 1 --2- 172.21.15.42:0/1472341487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0c8102a80 0x7fb0c819d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0c6d9d640 1 -- 172.21.15.42:0/1472341487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0c8102a80 msgr2=0x7fb0c819d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0c6d9d640 1 --2- 172.21.15.42:0/1472341487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0c8102a80 0x7fb0c819d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0c6d9d640 1 -- 172.21.15.42:0/1472341487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0c8101920 msgr2=0x7fb0c806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0c6d9d640 1 --2- 172.21.15.42:0/1472341487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0c8101920 0x7fb0c806bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0c6d9d640 1 -- 172.21.15.42:0/1472341487 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c81a01c0 con 0x7fb0c8103440 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0c659c640 1 --2- 172.21.15.42:0/1472341487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0c8101920 0x7fb0c806bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0c6d9d640 1 --2- 172.21.15.42:0/1472341487 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0c8103440 0x7fb0c819f900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000eaa0 tx=0x7fb0c000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0b77fe640 1 -- 172.21.15.42:0/1472341487 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000cdb0 con 0x7fb0c8103440 2024-09-21T17:45:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0cce61640 1 -- 172.21.15.42:0/1472341487 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c81a04b0 con 0x7fb0c8103440 2024-09-21T17:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0b77fe640 1 -- 172.21.15.42:0/1472341487 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fb0c0005020 con 0x7fb0c8103440 2024-09-21T17:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0b77fe640 1 -- 172.21.15.42:0/1472341487 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00116d0 con 0x7fb0c8103440 2024-09-21T17:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.232+0000 7fb0cce61640 1 -- 172.21.15.42:0/1472341487 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c81a09f0 con 0x7fb0c8103440 2024-09-21T17:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.233+0000 7fb0cce61640 1 -- 172.21.15.42:0/1472341487 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c8101d20 con 0x7fb0c8103440 2024-09-21T17:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.234+0000 7fb0b77fe640 1 -- 172.21.15.42:0/1472341487 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7fb0c0004a40 con 0x7fb0c8103440 2024-09-21T17:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.234+0000 7fb0b77fe640 1 --2- 172.21.15.42:0/1472341487 >> v2:172.21.15.42:6800/92962027 conn(0x7fb0b007b020 0x7fb0b007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.234+0000 7fb0b77fe640 1 -- 172.21.15.42:0/1472341487 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(45..45 src has 1..45) ==== 3904+0+0 (secure 0 0 0) 0x7fb0c009dad0 con 0x7fb0c8103440 2024-09-21T17:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.234+0000 7fb0c659c640 1 --2- 172.21.15.42:0/1472341487 >> v2:172.21.15.42:6800/92962027 conn(0x7fb0b007b020 0x7fb0b007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.235+0000 7fb0c659c640 1 --2- 172.21.15.42:0/1472341487 >> v2:172.21.15.42:6800/92962027 conn(0x7fb0b007b020 0x7fb0b007d4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8005ab0 tx=0x7fb0b8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.239+0000 7fb0b77fe640 1 -- 172.21.15.42:0/1472341487 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fb0c0016030 con 0x7fb0c8103440 2024-09-21T17:45:16.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.430+0000 7fb0cce61640 1 -- 172.21.15.42:0/1472341487 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb0c802e810 con 0x7fb0c8103440 2024-09-21T17:45:16.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:16 smithi042 ceph-mon[29361]: from='osd.7 v2:172.21.15.162:6812/1372332480' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T17:45:16.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:16 smithi042 ceph-mon[29361]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T17:45:16.433 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:16 smithi042 ceph-mon[38309]: from='osd.7 v2:172.21.15.162:6812/1372332480' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T17:45:16.434 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:16 smithi042 ceph-mon[38309]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T17:45:16.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.431+0000 7fb0b77fe640 1 -- 172.21.15.42:0/1472341487 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v46) ==== 74+0+130 (secure 0 0 0) 0x7fb0c00699a0 con 0x7fb0c8103440 2024-09-21T17:45:16.434 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:45:16.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 -- 172.21.15.42:0/1472341487 >> v2:172.21.15.42:6800/92962027 conn(0x7fb0b007b020 msgr2=0x7fb0b007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:16.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 --2- 172.21.15.42:0/1472341487 >> v2:172.21.15.42:6800/92962027 conn(0x7fb0b007b020 0x7fb0b007d4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8005ab0 tx=0x7fb0b8005a20 comp rx=0 tx=0).stop 2024-09-21T17:45:16.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 -- 172.21.15.42:0/1472341487 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0c8103440 msgr2=0x7fb0c819f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:16.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 --2- 172.21.15.42:0/1472341487 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0c8103440 0x7fb0c819f900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000eaa0 tx=0x7fb0c000ef60 comp rx=0 tx=0).stop 2024-09-21T17:45:16.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 -- 172.21.15.42:0/1472341487 shutdown_connections 2024-09-21T17:45:16.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 --2- 172.21.15.42:0/1472341487 >> v2:172.21.15.42:6800/92962027 conn(0x7fb0b007b020 0x7fb0b007d4e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:16.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 --2- 172.21.15.42:0/1472341487 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0c8103440 0x7fb0c819f900 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:16.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 --2- 172.21.15.42:0/1472341487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0c8102a80 0x7fb0c819d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:16.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 --2- 172.21.15.42:0/1472341487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0c8101920 0x7fb0c806bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:16.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 -- 172.21.15.42:0/1472341487 >> 172.21.15.42:0/1472341487 conn(0x7fb0c80fd1d0 msgr2=0x7fb0c80fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:16.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 -- 172.21.15.42:0/1472341487 shutdown_connections 2024-09-21T17:45:16.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:16.433+0000 7fb0cce61640 1 -- 172.21.15.42:0/1472341487 wait complete. 2024-09-21T17:45:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:16 smithi162 ceph-mon[32106]: from='osd.7 v2:172.21.15.162:6812/1372332480' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T17:45:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:16 smithi162 ceph-mon[32106]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T17:45:16.576 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 17:45:16 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T17:45:16.239+0000 7fc3f55fc640 -1 osd.7 0 log_to_monitors true 2024-09-21T17:45:17.248 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":46,"num_osds":8,"num_up_osds":7,"osd_up_since":1726940693,"num_in_osds":8,"osd_in_since":1726940698,"num_remapped_pgs":0} 2024-09-21T17:45:17.560 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 17:45:17 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T17:45:17.313+0000 7fc3f157f640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T17:45:17.560 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 17:45:17 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T17:45:17.318+0000 7fc3ed3a6640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T17:45:17.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:17 smithi162 ceph-mon[32106]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:17.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:17 smithi162 ceph-mon[32106]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T17:45:17.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:17 smithi162 ceph-mon[32106]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T17:45:17.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:17 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:17.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:17 smithi162 ceph-mon[32106]: from='osd.7 v2:172.21.15.162:6812/1372332480' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:45:17.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:17 smithi162 ceph-mon[32106]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:45:17.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1472341487' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T17:45:17.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[29361]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[29361]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T17:45:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[29361]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T17:45:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[29361]: from='osd.7 v2:172.21.15.162:6812/1372332480' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:45:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[29361]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:45:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1472341487' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T17:45:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[38309]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[38309]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T17:45:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[38309]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T17:45:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[38309]: from='osd.7 v2:172.21.15.162:6812/1372332480' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:45:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[38309]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T17:45:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1472341487' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T17:45:18.250 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T17:45:18.518 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:18.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:45:18.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:18.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:18 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.639 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:45:18.639 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T17:45:18.639 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:18.639 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:18.639 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.639 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.639 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.640 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.641 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.641 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.641 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.641 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T17:45:18.641 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.641 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:18.641 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:18.641 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:18 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:18.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.977+0000 7fbe178f4640 1 -- 172.21.15.42:0/927157723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe10108750 msgr2=0x7fbe1010ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:18.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.977+0000 7fbe178f4640 1 --2- 172.21.15.42:0/927157723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe10108750 0x7fbe1010ac10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009ca0 tx=0x7fbe0802a8c0 comp rx=0 tx=0).stop 2024-09-21T17:45:18.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.977+0000 7fbe178f4640 1 -- 172.21.15.42:0/927157723 shutdown_connections 2024-09-21T17:45:18.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.977+0000 7fbe178f4640 1 --2- 172.21.15.42:0/927157723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe10108750 0x7fbe1010ac10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:18.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.977+0000 7fbe178f4640 1 --2- 172.21.15.42:0/927157723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe10105ba0 0x7fbe10108010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:18.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.977+0000 7fbe178f4640 1 --2- 172.21.15.42:0/927157723 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbe1006c090 0x7fbe10105610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.977+0000 7fbe178f4640 1 -- 172.21.15.42:0/927157723 >> 172.21.15.42:0/927157723 conn(0x7fbe100fd200 msgr2=0x7fbe100ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.977+0000 7fbe178f4640 1 -- 172.21.15.42:0/927157723 shutdown_connections 2024-09-21T17:45:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.977+0000 7fbe178f4640 1 -- 172.21.15.42:0/927157723 wait complete. 2024-09-21T17:45:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe178f4640 1 Processor -- start 2024-09-21T17:45:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe178f4640 1 -- start start 2024-09-21T17:45:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe178f4640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbe1006c090 0x7fbe101984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe178f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe10105ba0 0x7fbe10198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe178f4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe10108750 0x7fbe10199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe178f4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1010dd50 con 0x7fbe10108750 2024-09-21T17:45:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe178f4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1010dbd0 con 0x7fbe10105ba0 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe178f4640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fbe1010ded0 con 0x7fbe1006c090 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe15690640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbe1006c090 0x7fbe101984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe15690640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbe1006c090 0x7fbe101984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:36008/0 (socket says 172.21.15.42:36008) 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe15690640 1 -- 172.21.15.42:0/552811785 learned_addr learned my addr 172.21.15.42:0/552811785 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe15e91640 1 --2- 172.21.15.42:0/552811785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe10108750 0x7fbe10199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.978+0000 7fbe14e8f640 1 --2- 172.21.15.42:0/552811785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe10105ba0 0x7fbe10198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.979+0000 7fbe15690640 1 -- 172.21.15.42:0/552811785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe10105ba0 msgr2=0x7fbe10198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.979+0000 7fbe15690640 1 --2- 172.21.15.42:0/552811785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe10105ba0 0x7fbe10198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.979+0000 7fbe15690640 1 -- 172.21.15.42:0/552811785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe10108750 msgr2=0x7fbe10199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.979+0000 7fbe15690640 1 --2- 172.21.15.42:0/552811785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe10108750 0x7fbe10199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.979+0000 7fbe15690640 1 -- 172.21.15.42:0/552811785 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1019a010 con 0x7fbe1006c090 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.979+0000 7fbe15690640 1 --2- 172.21.15.42:0/552811785 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbe1006c090 0x7fbe101984e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00ea60 tx=0x7fbe0c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.979+0000 7fbe067fc640 1 -- 172.21.15.42:0/552811785 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00cde0 con 0x7fbe1006c090 2024-09-21T17:45:18.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.979+0000 7fbe067fc640 1 -- 172.21.15.42:0/552811785 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fbe0c0035f0 con 0x7fbe1006c090 2024-09-21T17:45:18.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.979+0000 7fbe067fc640 1 -- 172.21.15.42:0/552811785 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0044a0 con 0x7fbe1006c090 2024-09-21T17:45:18.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.979+0000 7fbe178f4640 1 -- 172.21.15.42:0/552811785 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1019a300 con 0x7fbe1006c090 2024-09-21T17:45:18.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.979+0000 7fbe178f4640 1 -- 172.21.15.42:0/552811785 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe101a09e0 con 0x7fbe1006c090 2024-09-21T17:45:18.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.980+0000 7fbe178f4640 1 -- 172.21.15.42:0/552811785 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe10106000 con 0x7fbe1006c090 2024-09-21T17:45:18.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.981+0000 7fbe067fc640 1 -- 172.21.15.42:0/552811785 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7fbe0c004000 con 0x7fbe1006c090 2024-09-21T17:45:18.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.982+0000 7fbe067fc640 1 --2- 172.21.15.42:0/552811785 >> v2:172.21.15.42:6800/92962027 conn(0x7fbdfc07b020 0x7fbdfc07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:18.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.982+0000 7fbe14e8f640 1 --2- 172.21.15.42:0/552811785 >> v2:172.21.15.42:6800/92962027 conn(0x7fbdfc07b020 0x7fbdfc07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:18.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.982+0000 7fbe067fc640 1 -- 172.21.15.42:0/552811785 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(48..48 src has 1..48) ==== 4114+0+0 (secure 0 0 0) 0x7fbe0c09dcc0 con 0x7fbe1006c090 2024-09-21T17:45:18.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.982+0000 7fbe14e8f640 1 --2- 172.21.15.42:0/552811785 >> v2:172.21.15.42:6800/92962027 conn(0x7fbdfc07b020 0x7fbdfc07d4e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe1006c540 tx=0x7fbe0000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:18.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:18.986+0000 7fbe067fc640 1 -- 172.21.15.42:0/552811785 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fbe0c069b30 con 0x7fbe1006c090 2024-09-21T17:45:19.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.178+0000 7fbe178f4640 1 -- 172.21.15.42:0/552811785 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fbe1002e7a0 con 0x7fbe1006c090 2024-09-21T17:45:19.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.178+0000 7fbe067fc640 1 -- 172.21.15.42:0/552811785 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v49) ==== 74+0+130 (secure 0 0 0) 0x7fbe0c06ce20 con 0x7fbe1006c090 2024-09-21T17:45:19.181 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:45:19.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.180+0000 7fbe178f4640 1 -- 172.21.15.42:0/552811785 >> v2:172.21.15.42:6800/92962027 conn(0x7fbdfc07b020 msgr2=0x7fbdfc07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:19.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.180+0000 7fbe178f4640 1 --2- 172.21.15.42:0/552811785 >> v2:172.21.15.42:6800/92962027 conn(0x7fbdfc07b020 0x7fbdfc07d4e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe1006c540 tx=0x7fbe0000b390 comp rx=0 tx=0).stop 2024-09-21T17:45:19.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.180+0000 7fbe178f4640 1 -- 172.21.15.42:0/552811785 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbe1006c090 msgr2=0x7fbe101984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:19.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.180+0000 7fbe178f4640 1 --2- 172.21.15.42:0/552811785 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbe1006c090 0x7fbe101984e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00ea60 tx=0x7fbe0c00ef20 comp rx=0 tx=0).stop 2024-09-21T17:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.181+0000 7fbe178f4640 1 -- 172.21.15.42:0/552811785 shutdown_connections 2024-09-21T17:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.181+0000 7fbe178f4640 1 --2- 172.21.15.42:0/552811785 >> v2:172.21.15.42:6800/92962027 conn(0x7fbdfc07b020 0x7fbdfc07d4e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.181+0000 7fbe178f4640 1 --2- 172.21.15.42:0/552811785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe10108750 0x7fbe10199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.181+0000 7fbe178f4640 1 --2- 172.21.15.42:0/552811785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe10105ba0 0x7fbe10198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.181+0000 7fbe178f4640 1 --2- 172.21.15.42:0/552811785 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbe1006c090 0x7fbe101984e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.181+0000 7fbe178f4640 1 -- 172.21.15.42:0/552811785 >> 172.21.15.42:0/552811785 conn(0x7fbe100fd200 msgr2=0x7fbe10103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.181+0000 7fbe178f4640 1 -- 172.21.15.42:0/552811785 shutdown_connections 2024-09-21T17:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:19.181+0000 7fbe178f4640 1 -- 172.21.15.42:0/552811785 wait complete. 2024-09-21T17:45:19.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[29361]: purged_snaps scrub starts 2024-09-21T17:45:19.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[29361]: purged_snaps scrub ok 2024-09-21T17:45:19.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[29361]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:19.495 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[29361]: Detected new or changed devices on smithi162 2024-09-21T17:45:19.495 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T17:45:19.495 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[29361]: osd.7 v2:172.21.15.162:6812/1372332480 boot 2024-09-21T17:45:19.495 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[29361]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T17:45:19.495 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:19.495 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[29361]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T17:45:19.495 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/552811785' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T17:45:19.495 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[38309]: purged_snaps scrub starts 2024-09-21T17:45:19.495 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[38309]: purged_snaps scrub ok 2024-09-21T17:45:19.495 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[38309]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:19.495 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[38309]: Detected new or changed devices on smithi162 2024-09-21T17:45:19.496 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T17:45:19.496 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[38309]: osd.7 v2:172.21.15.162:6812/1372332480 boot 2024-09-21T17:45:19.496 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[38309]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T17:45:19.496 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:19.496 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[38309]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T17:45:19.496 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/552811785' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T17:45:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:19 smithi162 ceph-mon[32106]: purged_snaps scrub starts 2024-09-21T17:45:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:19 smithi162 ceph-mon[32106]: purged_snaps scrub ok 2024-09-21T17:45:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:19 smithi162 ceph-mon[32106]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T17:45:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:19 smithi162 ceph-mon[32106]: Detected new or changed devices on smithi162 2024-09-21T17:45:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:19 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T17:45:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:19 smithi162 ceph-mon[32106]: osd.7 v2:172.21.15.162:6812/1372332480 boot 2024-09-21T17:45:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:19 smithi162 ceph-mon[32106]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T17:45:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:19 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:19 smithi162 ceph-mon[32106]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T17:45:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/552811785' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T17:45:19.912 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":49,"num_osds":8,"num_up_osds":8,"osd_up_since":1726940718,"num_in_osds":8,"osd_in_since":1726940698,"num_remapped_pgs":0} 2024-09-21T17:45:19.912 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T17:45:20.174 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.595+0000 7f8002660640 1 -- 172.21.15.42:0/1535211789 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7ffc108790 msgr2=0x7f7ffc108bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.595+0000 7f8002660640 1 --2- 172.21.15.42:0/1535211789 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7ffc108790 0x7f7ffc108bd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009900 tx=0x7f7ff002a410 comp rx=0 tx=0).stop 2024-09-21T17:45:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.596+0000 7f8002660640 1 -- 172.21.15.42:0/1535211789 shutdown_connections 2024-09-21T17:45:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.596+0000 7f8002660640 1 --2- 172.21.15.42:0/1535211789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc109110 0x7f7ffc10f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.596+0000 7f8002660640 1 --2- 172.21.15.42:0/1535211789 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7ffc108790 0x7f7ffc108bd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.596+0000 7f8002660640 1 --2- 172.21.15.42:0/1535211789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ffc102d80 0x7f7ffc103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.596+0000 7f8002660640 1 -- 172.21.15.42:0/1535211789 >> 172.21.15.42:0/1535211789 conn(0x7f7ffc0fe7d0 msgr2=0x7f7ffc100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.596+0000 7f8002660640 1 -- 172.21.15.42:0/1535211789 shutdown_connections 2024-09-21T17:45:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.596+0000 7f8002660640 1 -- 172.21.15.42:0/1535211789 wait complete. 2024-09-21T17:45:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.596+0000 7f8002660640 1 Processor -- start 2024-09-21T17:45:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.596+0000 7f8002660640 1 -- start start 2024-09-21T17:45:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8002660640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ffc102d80 0x7f7ffc198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8002660640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7ffc108790 0x7f7ffc198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8002660640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc109110 0x7f7ffc19e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8002660640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1124e0 con 0x7f7ffc109110 2024-09-21T17:45:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8002660640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc112360 con 0x7f7ffc102d80 2024-09-21T17:45:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8002660640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f7ffc112660 con 0x7f7ffc108790 2024-09-21T17:45:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8000bfd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc109110 0x7f7ffc19e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7ffc108790 0x7f7ffc198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8000bfd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc109110 0x7f7ffc19e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52008/0 (socket says 172.21.15.42:52008) 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8000bfd640 1 -- 172.21.15.42:0/731114398 learned_addr learned my addr 172.21.15.42:0/731114398 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f7ffbfff640 1 --2- 172.21.15.42:0/731114398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ffc102d80 0x7f7ffc198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8000bfd640 1 -- 172.21.15.42:0/731114398 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7ffc108790 msgr2=0x7f7ffc198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8000bfd640 1 --2- 172.21.15.42:0/731114398 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7ffc108790 0x7f7ffc198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8000bfd640 1 -- 172.21.15.42:0/731114398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ffc102d80 msgr2=0x7f7ffc198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8000bfd640 1 --2- 172.21.15.42:0/731114398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ffc102d80 0x7f7ffc198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8000bfd640 1 -- 172.21.15.42:0/731114398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc19ea20 con 0x7f7ffc109110 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f7ffb7fe640 1 --2- 172.21.15.42:0/731114398 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7ffc108790 0x7f7ffc198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8000bfd640 1 --2- 172.21.15.42:0/731114398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc109110 0x7f7ffc19e250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400efd0 tx=0x7f7ff400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f7ff97fa640 1 -- 172.21.15.42:0/731114398 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4003b70 con 0x7f7ffc109110 2024-09-21T17:45:20.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f8002660640 1 -- 172.21.15.42:0/731114398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ffc19ed10 con 0x7f7ffc109110 2024-09-21T17:45:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f7ff97fa640 1 -- 172.21.15.42:0/731114398 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7ff4003d10 con 0x7f7ffc109110 2024-09-21T17:45:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.597+0000 7f7ff97fa640 1 -- 172.21.15.42:0/731114398 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4010840 con 0x7f7ffc109110 2024-09-21T17:45:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.598+0000 7f8002660640 1 -- 172.21.15.42:0/731114398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ffc1a53d0 con 0x7f7ffc109110 2024-09-21T17:45:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.599+0000 7f8002660640 1 -- 172.21.15.42:0/731114398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ffc103160 con 0x7f7ffc109110 2024-09-21T17:45:20.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.599+0000 7f7ff97fa640 1 -- 172.21.15.42:0/731114398 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7f7ff4004020 con 0x7f7ffc109110 2024-09-21T17:45:20.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.600+0000 7f7ff97fa640 1 --2- 172.21.15.42:0/731114398 >> v2:172.21.15.42:6800/92962027 conn(0x7f7fe407b020 0x7f7fe407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:20.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.600+0000 7f7ffbfff640 1 --2- 172.21.15.42:0/731114398 >> v2:172.21.15.42:6800/92962027 conn(0x7f7fe407b020 0x7f7fe407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:20.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.600+0000 7f7ff97fa640 1 -- 172.21.15.42:0/731114398 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4081+0+0 (secure 0 0 0) 0x7f7ff409de30 con 0x7f7ffc109110 2024-09-21T17:45:20.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.601+0000 7f7ffbfff640 1 --2- 172.21.15.42:0/731114398 >> v2:172.21.15.42:6800/92962027 conn(0x7f7fe407b020 0x7f7fe407d4e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7fec005fd0 tx=0x7f7fec005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:20.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.605+0000 7f7ff97fa640 1 -- 172.21.15.42:0/731114398 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f7ff4065860 con 0x7f7ffc109110 2024-09-21T17:45:20.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.792+0000 7f8002660640 1 -- 172.21.15.42:0/731114398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ffc10aef0 con 0x7f7ffc109110 2024-09-21T17:45:20.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.793+0000 7f7ff97fa640 1 -- 172.21.15.42:0/731114398 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+11503 (secure 0 0 0) 0x7f7ff4069c40 con 0x7f7ffc109110 2024-09-21T17:45:20.796 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:45:20.796 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":50,"fsid":"6e3cf65a-7840-11ef-baf6-efdc52797490","created":"2024-09-21T17:40:19.412453+0000","modified":"2024-09-21T17:45:20.058468+0000","last_up_change":"2024-09-21T17:45:18.308925+0000","last_in_change":"2024-09-21T17:44:58.503216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T17:43:16.619277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9400dd6c-acd8-4ab6-a2a0-7ae899d85554","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6801","nonce":443738680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":443738680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":443738680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6803","nonce":443738680}]},"public_addr":"172.21.15.42:6801/443738680","cluster_addr":"172.21.15.42:6802/443738680","heartbeat_back_addr":"172.21.15.42:6804/443738680","heartbeat_front_addr":"172.21.15.42:6803/443738680","state":["exists","up"]},{"osd":1,"uuid":"087fa35f-aafd-4879-8b78-d47dc2a7f5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6805","nonce":555179714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":555179714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":555179714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6807","nonce":555179714}]},"public_addr":"172.21.15.42:6805/555179714","cluster_addr":"172.21.15.42:6806/555179714","heartbeat_back_addr":"172.21.15.42:6808/555179714","heartbeat_front_addr":"172.21.15.42:6807/555179714","state":["exists","up"]},{"osd":2,"uuid":"c7346df3-244f-4c4e-a0c0-6058b91388a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":429996625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":429996625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":429996625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6811","nonce":429996625}]},"public_addr":"172.21.15.42:6809/429996625","cluster_addr":"172.21.15.42:6810/429996625","heartbeat_back_addr":"172.21.15.42:6812/429996625","heartbeat_front_addr":"172.21.15.42:6811/429996625","state":["exists","up"]},{"osd":3,"uuid":"2099cf75-c0ab-4de5-bc44-dace0d4ee6b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":2988176462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2988176462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2988176462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":2988176462}]},"public_addr":"172.21.15.42:6813/2988176462","cluster_addr":"172.21.15.42:6814/2988176462","heartbeat_back_addr":"172.21.15.42:6816/2988176462","heartbeat_front_addr":"172.21.15.42:6815/2988176462","state":["exists","up"]},{"osd":4,"uuid":"df62f00f-2873-4de2-9e6f-d558f53a0ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4286045529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6801","nonce":4286045529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":4286045529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4286045529}]},"public_addr":"172.21.15.162:6800/4286045529","cluster_addr":"172.21.15.162:6801/4286045529","heartbeat_back_addr":"172.21.15.162:6803/4286045529","heartbeat_front_addr":"172.21.15.162:6802/4286045529","state":["exists","up"]},{"osd":5,"uuid":"103163e6-b14d-4ee6-9d77-d4b4dff5307d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":338151964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6805","nonce":338151964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":338151964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":338151964}]},"public_addr":"172.21.15.162:6804/338151964","cluster_addr":"172.21.15.162:6805/338151964","heartbeat_back_addr":"172.21.15.162:6807/338151964","heartbeat_front_addr":"172.21.15.162:6806/338151964","state":["exists","up"]},{"osd":6,"uuid":"21e0bbf2-8a36-4546-865c-694ce6a59196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1056184078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":1056184078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6811","nonce":1056184078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1056184078}]},"public_addr":"172.21.15.162:6808/1056184078","cluster_addr":"172.21.15.162:6809/1056184078","heartbeat_back_addr":"172.21.15.162:6811/1056184078","heartbeat_front_addr":"172.21.15.162:6810/1056184078","state":["exists","up"]},{"osd":7,"uuid":"bd25c4ad-3134-4199-aa32-18895d561ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1372332480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":1372332480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6815","nonce":1372332480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1372332480}]},"public_addr":"172.21.15.162:6812/1372332480","cluster_addr":"172.21.15.162:6813/1372332480","heartbeat_back_addr":"172.21.15.162:6815/1372332480","heartbeat_front_addr":"172.21.15.162:6814/1372332480","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:42:24.270262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:42:48.477554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:43:14.571386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:43:38.936951+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:44:01.676387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:44:27.149819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:44:52.398018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:45:17.234160+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6800/475923179":"2024-09-22T17:41:08.165193+0000","172.21.15.42:0/1455617248":"2024-09-22T17:41:08.165193+0000","172.21.15.42:0/308194918":"2024-09-22T17:41:08.165193+0000","172.21.15.42:0/1268303256":"2024-09-22T17:41:08.165193+0000","172.21.15.42:6800/604611129":"2024-09-22T17:40:41.532199+0000","172.21.15.42:0/1858133559":"2024-09-22T17:40:41.532199+0000","172.21.15.42:0/3833944364":"2024-09-22T17:40:41.532199+0000","172.21.15.42:0/4184585510":"2024-09-22T17:40:41.532199+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T17:45:20.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 -- 172.21.15.42:0/731114398 >> v2:172.21.15.42:6800/92962027 conn(0x7f7fe407b020 msgr2=0x7f7fe407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:20.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 --2- 172.21.15.42:0/731114398 >> v2:172.21.15.42:6800/92962027 conn(0x7f7fe407b020 0x7f7fe407d4e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7fec005fd0 tx=0x7f7fec005850 comp rx=0 tx=0).stop 2024-09-21T17:45:20.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 -- 172.21.15.42:0/731114398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc109110 msgr2=0x7f7ffc19e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:20.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 --2- 172.21.15.42:0/731114398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc109110 0x7f7ffc19e250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400efd0 tx=0x7f7ff400c6a0 comp rx=0 tx=0).stop 2024-09-21T17:45:20.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 -- 172.21.15.42:0/731114398 shutdown_connections 2024-09-21T17:45:20.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 --2- 172.21.15.42:0/731114398 >> v2:172.21.15.42:6800/92962027 conn(0x7f7fe407b020 0x7f7fe407d4e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 --2- 172.21.15.42:0/731114398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc109110 0x7f7ffc19e250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 --2- 172.21.15.42:0/731114398 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7ffc108790 0x7f7ffc198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 --2- 172.21.15.42:0/731114398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ffc102d80 0x7f7ffc198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 -- 172.21.15.42:0/731114398 >> 172.21.15.42:0/731114398 conn(0x7f7ffc0fe7d0 msgr2=0x7f7ffc100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 -- 172.21.15.42:0/731114398 shutdown_connections 2024-09-21T17:45:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:20.795+0000 7f8002660640 1 -- 172.21.15.42:0/731114398 wait complete. 2024-09-21T17:45:21.323 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:21 smithi042 ceph-mon[29361]: osdmap e50: 8 total, 8 up, 8 in 2024-09-21T17:45:21.323 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:21 smithi042 ceph-mon[29361]: pgmap v166: 1 pgs: 1 peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:21.324 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/731114398' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T17:45:21.324 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:21 smithi042 ceph-mon[38309]: osdmap e50: 8 total, 8 up, 8 in 2024-09-21T17:45:21.324 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:21 smithi042 ceph-mon[38309]: pgmap v166: 1 pgs: 1 peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:21.324 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/731114398' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T17:45:21.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:21 smithi162 ceph-mon[32106]: osdmap e50: 8 total, 8 up, 8 in 2024-09-21T17:45:21.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:21 smithi162 ceph-mon[32106]: pgmap v166: 1 pgs: 1 peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:21.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/731114398' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T17:45:21.805 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T17:43:16.619277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T17:45:21.805 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T17:45:22.067 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:22.324 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:22 smithi042 ceph-mon[29361]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T17:45:22.325 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:22 smithi042 ceph-mon[38309]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T17:45:22.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:22 smithi162 ceph-mon[32106]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T17:45:22.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.512+0000 7ff3459f4640 1 -- 172.21.15.42:0/2948841108 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff340108030 msgr2=0x7ff34010e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:22.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.512+0000 7ff3459f4640 1 --2- 172.21.15.42:0/2948841108 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff340108030 0x7ff34010e830 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff338009900 tx=0x7ff33802a410 comp rx=0 tx=0).stop 2024-09-21T17:45:22.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.513+0000 7ff3459f4640 1 -- 172.21.15.42:0/2948841108 shutdown_connections 2024-09-21T17:45:22.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.513+0000 7ff3459f4640 1 --2- 172.21.15.42:0/2948841108 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff340108030 0x7ff34010e830 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:22.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.513+0000 7ff3459f4640 1 --2- 172.21.15.42:0/2948841108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3401076b0 0x7ff340107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:22.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.513+0000 7ff3459f4640 1 --2- 172.21.15.42:0/2948841108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff340101ca0 0x7ff340102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:22.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.513+0000 7ff3459f4640 1 -- 172.21.15.42:0/2948841108 >> 172.21.15.42:0/2948841108 conn(0x7ff3400fd710 msgr2=0x7ff3400ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:22.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.513+0000 7ff3459f4640 1 -- 172.21.15.42:0/2948841108 shutdown_connections 2024-09-21T17:45:22.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.513+0000 7ff3459f4640 1 -- 172.21.15.42:0/2948841108 wait complete. 2024-09-21T17:45:22.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.513+0000 7ff3459f4640 1 Processor -- start 2024-09-21T17:45:22.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.513+0000 7ff3459f4640 1 -- start start 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff3459f4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff340101ca0 0x7ff34019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff3459f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3401076b0 0x7ff34019b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff3459f4640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff340108030 0x7ff3401a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff3459f4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff3401113c0 con 0x7ff340101ca0 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff3459f4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff340111240 con 0x7ff3401076b0 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff3459f4640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7ff340111540 con 0x7ff340108030 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff340101ca0 0x7ff34019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff340101ca0 0x7ff34019aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51544/0 (socket says 172.21.15.42:51544) 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33effd640 1 -- 172.21.15.42:0/907555849 learned_addr learned my addr 172.21.15.42:0/907555849 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33f7fe640 1 --2- 172.21.15.42:0/907555849 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff340108030 0x7ff3401a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33e7fc640 1 --2- 172.21.15.42:0/907555849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3401076b0 0x7ff34019b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:22.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33effd640 1 -- 172.21.15.42:0/907555849 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff340108030 msgr2=0x7ff3401a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33effd640 1 --2- 172.21.15.42:0/907555849 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff340108030 0x7ff3401a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33effd640 1 -- 172.21.15.42:0/907555849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3401076b0 msgr2=0x7ff34019b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33effd640 1 --2- 172.21.15.42:0/907555849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3401076b0 0x7ff34019b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33effd640 1 -- 172.21.15.42:0/907555849 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3401a0b90 con 0x7ff340101ca0 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33f7fe640 1 --2- 172.21.15.42:0/907555849 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff340108030 0x7ff3401a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33e7fc640 1 --2- 172.21.15.42:0/907555849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3401076b0 0x7ff34019b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff33effd640 1 --2- 172.21.15.42:0/907555849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff340101ca0 0x7ff34019aae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff330009d50 tx=0x7ff33000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.514+0000 7ff3449f2640 1 -- 172.21.15.42:0/907555849 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330003b70 con 0x7ff340101ca0 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.515+0000 7ff3459f4640 1 -- 172.21.15.42:0/907555849 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3401a0e80 con 0x7ff340101ca0 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.515+0000 7ff3449f2640 1 -- 172.21.15.42:0/907555849 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff330003d10 con 0x7ff340101ca0 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.515+0000 7ff3449f2640 1 -- 172.21.15.42:0/907555849 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3300107d0 con 0x7ff340101ca0 2024-09-21T17:45:22.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.515+0000 7ff3459f4640 1 -- 172.21.15.42:0/907555849 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3401a7540 con 0x7ff340101ca0 2024-09-21T17:45:22.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.516+0000 7ff3459f4640 1 -- 172.21.15.42:0/907555849 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff340102080 con 0x7ff340101ca0 2024-09-21T17:45:22.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.516+0000 7ff3449f2640 1 -- 172.21.15.42:0/907555849 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7ff330004020 con 0x7ff340101ca0 2024-09-21T17:45:22.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.517+0000 7ff3449f2640 1 --2- 172.21.15.42:0/907555849 >> v2:172.21.15.42:6800/92962027 conn(0x7ff32807b020 0x7ff32807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:22.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.517+0000 7ff3449f2640 1 -- 172.21.15.42:0/907555849 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4081+0+0 (secure 0 0 0) 0x7ff33009e0c0 con 0x7ff340101ca0 2024-09-21T17:45:22.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.517+0000 7ff33e7fc640 1 --2- 172.21.15.42:0/907555849 >> v2:172.21.15.42:6800/92962027 conn(0x7ff32807b020 0x7ff32807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.517+0000 7ff33e7fc640 1 --2- 172.21.15.42:0/907555849 >> v2:172.21.15.42:6800/92962027 conn(0x7ff32807b020 0x7ff32807d4e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff340100b90 tx=0x7ff334005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:22.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.522+0000 7ff3449f2640 1 -- 172.21.15.42:0/907555849 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7ff330065af0 con 0x7ff340101ca0 2024-09-21T17:45:22.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.708+0000 7ff3459f4640 1 -- 172.21.15.42:0/907555849 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff3401a7800 con 0x7ff340101ca0 2024-09-21T17:45:22.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.708+0000 7ff3449f2640 1 -- 172.21.15.42:0/907555849 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7ff330069ed0 con 0x7ff340101ca0 2024-09-21T17:45:22.711 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-21T17:45:22.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.710+0000 7ff3459f4640 1 -- 172.21.15.42:0/907555849 >> v2:172.21.15.42:6800/92962027 conn(0x7ff32807b020 msgr2=0x7ff32807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:22.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.710+0000 7ff3459f4640 1 --2- 172.21.15.42:0/907555849 >> v2:172.21.15.42:6800/92962027 conn(0x7ff32807b020 0x7ff32807d4e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff340100b90 tx=0x7ff334005d30 comp rx=0 tx=0).stop 2024-09-21T17:45:22.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.710+0000 7ff3459f4640 1 -- 172.21.15.42:0/907555849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff340101ca0 msgr2=0x7ff34019aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.710+0000 7ff3459f4640 1 --2- 172.21.15.42:0/907555849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff340101ca0 0x7ff34019aae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff330009d50 tx=0x7ff33000c6a0 comp rx=0 tx=0).stop 2024-09-21T17:45:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.711+0000 7ff3459f4640 1 -- 172.21.15.42:0/907555849 shutdown_connections 2024-09-21T17:45:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.711+0000 7ff3459f4640 1 --2- 172.21.15.42:0/907555849 >> v2:172.21.15.42:6800/92962027 conn(0x7ff32807b020 0x7ff32807d4e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.711+0000 7ff3459f4640 1 --2- 172.21.15.42:0/907555849 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff340108030 0x7ff3401a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.711+0000 7ff3459f4640 1 --2- 172.21.15.42:0/907555849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3401076b0 0x7ff34019b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.711+0000 7ff3459f4640 1 --2- 172.21.15.42:0/907555849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff340101ca0 0x7ff34019aae0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.711+0000 7ff3459f4640 1 -- 172.21.15.42:0/907555849 >> 172.21.15.42:0/907555849 conn(0x7ff3400fd710 msgr2=0x7ff34006bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.711+0000 7ff3459f4640 1 -- 172.21.15.42:0/907555849 shutdown_connections 2024-09-21T17:45:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:22.711+0000 7ff3459f4640 1 -- 172.21.15.42:0/907555849 wait complete. 2024-09-21T17:45:23.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:23 smithi162 ceph-mon[32106]: pgmap v167: 1 pgs: 1 peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:23.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:23 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/907555849' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T17:45:23.352 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:23 smithi042 ceph-mon[29361]: pgmap v167: 1 pgs: 1 peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:23.352 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:23 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/907555849' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T17:45:23.352 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:23 smithi042 ceph-mon[38309]: pgmap v167: 1 pgs: 1 peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:23.352 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:23 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/907555849' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T17:45:23.385 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi042 2024-09-21T17:45:23.385 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch apply rgw foo.a --placement '1;smithi042=foo.a' 2024-09-21T17:45:23.646 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:45:24.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.036+0000 7f45d7f52640 1 -- 172.21.15.162:0/107165911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d006b630 msgr2=0x7f45d0105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:24.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.036+0000 7f45d7f52640 1 --2- 172.21.15.162:0/107165911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d006b630 0x7f45d0105640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009900 tx=0x7f45cc02a410 comp rx=0 tx=0).stop 2024-09-21T17:45:24.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.036+0000 7f45d7f52640 1 -- 172.21.15.162:0/107165911 shutdown_connections 2024-09-21T17:45:24.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.036+0000 7f45d7f52640 1 --2- 172.21.15.162:0/107165911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d01086f0 0x7f45d010abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:24.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.036+0000 7f45d7f52640 1 --2- 172.21.15.162:0/107165911 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f45d0105b80 0x7f45d0107fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:24.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.036+0000 7f45d7f52640 1 --2- 172.21.15.162:0/107165911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d006b630 0x7f45d0105640 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:24.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.036+0000 7f45d7f52640 1 -- 172.21.15.162:0/107165911 >> 172.21.15.162:0/107165911 conn(0x7f45d00fd1b0 msgr2=0x7f45d00ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:24.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.036+0000 7f45d7f52640 1 -- 172.21.15.162:0/107165911 shutdown_connections 2024-09-21T17:45:24.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.036+0000 7f45d7f52640 1 -- 172.21.15.162:0/107165911 wait complete. 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.036+0000 7f45d7f52640 1 Processor -- start 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.036+0000 7f45d7f52640 1 -- start start 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d7f52640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f45d006b630 0x7f45d01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d7f52640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0105b80 0x7f45d01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d7f52640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d01086f0 0x7f45d0199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d7f52640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45d010dcd0 con 0x7f45d0105b80 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d7f52640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45d010db50 con 0x7f45d01086f0 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d7f52640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f45d010de50 con 0x7f45d006b630 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d64ef640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d01086f0 0x7f45d0199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d64ef640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d01086f0 0x7f45d0199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43322/0 (socket says 172.21.15.162:43322) 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d64ef640 1 -- 172.21.15.162:0/2525112903 learned_addr learned my addr 172.21.15.162:0/2525112903 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d5cee640 1 --2- 172.21.15.162:0/2525112903 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f45d006b630 0x7f45d01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d54ed640 1 --2- 172.21.15.162:0/2525112903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0105b80 0x7f45d01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:24.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d64ef640 1 -- 172.21.15.162:0/2525112903 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f45d006b630 msgr2=0x7f45d01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:24.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d64ef640 1 --2- 172.21.15.162:0/2525112903 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f45d006b630 0x7f45d01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:24.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d64ef640 1 -- 172.21.15.162:0/2525112903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0105b80 msgr2=0x7f45d01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:24.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d64ef640 1 --2- 172.21.15.162:0/2525112903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0105b80 0x7f45d01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:24.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d64ef640 1 -- 172.21.15.162:0/2525112903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d0199ed0 con 0x7f45d01086f0 2024-09-21T17:45:24.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d54ed640 1 --2- 172.21.15.162:0/2525112903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0105b80 0x7f45d01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T17:45:24.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d64ef640 1 --2- 172.21.15.162:0/2525112903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d01086f0 0x7f45d0199630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f45c800cce0 tx=0x7f45c800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:24.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45c6ffd640 1 -- 172.21.15.162:0/2525112903 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c800f450 con 0x7f45d01086f0 2024-09-21T17:45:24.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.037+0000 7f45d7f52640 1 -- 172.21.15.162:0/2525112903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d019a1c0 con 0x7f45d01086f0 2024-09-21T17:45:24.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.038+0000 7f45c6ffd640 1 -- 172.21.15.162:0/2525112903 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f45c800fa70 con 0x7f45d01086f0 2024-09-21T17:45:24.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.038+0000 7f45c6ffd640 1 -- 172.21.15.162:0/2525112903 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c80189d0 con 0x7f45d01086f0 2024-09-21T17:45:24.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.038+0000 7f45d7f52640 1 -- 172.21.15.162:0/2525112903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d01a08a0 con 0x7f45d01086f0 2024-09-21T17:45:24.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.038+0000 7f45d7f52640 1 -- 172.21.15.162:0/2525112903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d0105fa0 con 0x7f45d01086f0 2024-09-21T17:45:24.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.039+0000 7f45c6ffd640 1 -- 172.21.15.162:0/2525112903 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7f45c800f5f0 con 0x7f45d01086f0 2024-09-21T17:45:24.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.040+0000 7f45c6ffd640 1 --2- 172.21.15.162:0/2525112903 >> v2:172.21.15.42:6800/92962027 conn(0x7f45bc07b020 0x7f45bc07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:24.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.040+0000 7f45c6ffd640 1 -- 172.21.15.162:0/2525112903 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4081+0+0 (secure 0 0 0) 0x7f45c809dea0 con 0x7f45d01086f0 2024-09-21T17:45:24.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.040+0000 7f45d5cee640 1 --2- 172.21.15.162:0/2525112903 >> v2:172.21.15.42:6800/92962027 conn(0x7f45bc07b020 0x7f45bc07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:24.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.041+0000 7f45d5cee640 1 --2- 172.21.15.162:0/2525112903 >> v2:172.21.15.42:6800/92962027 conn(0x7f45bc07b020 0x7f45bc07d4e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45cc000c00 tx=0x7f45cc0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:24.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.044+0000 7f45c6ffd640 1 -- 172.21.15.162:0/2525112903 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f45c8014030 con 0x7f45d01086f0 2024-09-21T17:45:24.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.232+0000 7f45d7f52640 1 -- 172.21.15.162:0/2525112903 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi042=foo.a", "target": ["mon-mgr", ""]}) -- 0x7f45d010a2c0 con 0x7f45bc07b020 2024-09-21T17:45:24.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.239+0000 7f45c6ffd640 1 -- 172.21.15.162:0/2525112903 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f45d010a2c0 con 0x7f45bc07b020 2024-09-21T17:45:24.242 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled rgw.foo.a update... 2024-09-21T17:45:24.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 -- 172.21.15.162:0/2525112903 >> v2:172.21.15.42:6800/92962027 conn(0x7f45bc07b020 msgr2=0x7f45bc07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:24.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 --2- 172.21.15.162:0/2525112903 >> v2:172.21.15.42:6800/92962027 conn(0x7f45bc07b020 0x7f45bc07d4e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45cc000c00 tx=0x7f45cc0058d0 comp rx=0 tx=0).stop 2024-09-21T17:45:24.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 -- 172.21.15.162:0/2525112903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d01086f0 msgr2=0x7f45d0199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:24.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 --2- 172.21.15.162:0/2525112903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d01086f0 0x7f45d0199630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f45c800cce0 tx=0x7f45c800a620 comp rx=0 tx=0).stop 2024-09-21T17:45:24.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 -- 172.21.15.162:0/2525112903 shutdown_connections 2024-09-21T17:45:24.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 --2- 172.21.15.162:0/2525112903 >> v2:172.21.15.42:6800/92962027 conn(0x7f45bc07b020 0x7f45bc07d4e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:24.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 --2- 172.21.15.162:0/2525112903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d01086f0 0x7f45d0199630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:24.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 --2- 172.21.15.162:0/2525112903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0105b80 0x7f45d01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:24.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 --2- 172.21.15.162:0/2525112903 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f45d006b630 0x7f45d01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:24.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 -- 172.21.15.162:0/2525112903 >> 172.21.15.162:0/2525112903 conn(0x7f45d00fd1b0 msgr2=0x7f45d0108ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:24.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 -- 172.21.15.162:0/2525112903 shutdown_connections 2024-09-21T17:45:24.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:24.242+0000 7f45d7f52640 1 -- 172.21.15.162:0/2525112903 wait complete. 2024-09-21T17:45:24.952 DEBUG:teuthology.orchestra.run.smithi042:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@rgw.foo.a.service 2024-09-21T17:45:24.955 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi162 2024-09-21T17:45:24.956 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd pool create datapool 3 3 replicated 2024-09-21T17:45:25.199 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:45:25.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: pgmap v168: 1 pgs: 1 peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:25.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi042=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:25.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-21T17:45:25.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:25.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:25.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:25.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:25.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:25.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T17:45:25.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T17:45:25.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:25.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:25.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:25 smithi162 ceph-mon[32106]: Deploying daemon rgw.foo.a on smithi042 2024-09-21T17:45:25.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.609+0000 7fbbc8875640 1 -- 172.21.15.162:0/3755308393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc4102a10 msgr2=0x7fbbc4102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:25.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.609+0000 7fbbc8875640 1 --2- 172.21.15.162:0/3755308393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc4102a10 0x7fbbc4102e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009930 tx=0x7fbbb402a420 comp rx=0 tx=0).stop 2024-09-21T17:45:25.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.609+0000 7fbbc8875640 1 -- 172.21.15.162:0/3755308393 shutdown_connections 2024-09-21T17:45:25.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.609+0000 7fbbc8875640 1 --2- 172.21.15.162:0/3755308393 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbc4104530 0x7fbbc410aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:25.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.609+0000 7fbbc8875640 1 --2- 172.21.15.162:0/3755308393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4103b70 0x7fbbc4103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:25.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.609+0000 7fbbc8875640 1 --2- 172.21.15.162:0/3755308393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc4102a10 0x7fbbc4102e10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:25.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.609+0000 7fbbc8875640 1 -- 172.21.15.162:0/3755308393 >> 172.21.15.162:0/3755308393 conn(0x7fbbc40fe2c0 msgr2=0x7fbbc4100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:25.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.609+0000 7fbbc8875640 1 -- 172.21.15.162:0/3755308393 shutdown_connections 2024-09-21T17:45:25.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.609+0000 7fbbc8875640 1 -- 172.21.15.162:0/3755308393 wait complete. 2024-09-21T17:45:25.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.610+0000 7fbbc8875640 1 Processor -- start 2024-09-21T17:45:25.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.610+0000 7fbbc8875640 1 -- start start 2024-09-21T17:45:25.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.610+0000 7fbbc8875640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4102a10 0x7fbbc419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.610+0000 7fbbc8875640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc4103b70 0x7fbbc419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.610+0000 7fbbc8875640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbc4104530 0x7fbbc419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.610+0000 7fbbc8875640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc410dd20 con 0x7fbbc4102a10 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.610+0000 7fbbc8875640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc410dba0 con 0x7fbbc4103b70 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.610+0000 7fbbc8875640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc410dea0 con 0x7fbbc4104530 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbb9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc4103b70 0x7fbbc419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbb9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc4103b70 0x7fbbc419ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43342/0 (socket says 172.21.15.162:43342) 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbb9d9b640 1 -- 172.21.15.162:0/2602870820 learned_addr learned my addr 172.21.15.162:0/2602870820 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbc259c640 1 --2- 172.21.15.162:0/2602870820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4102a10 0x7fbbc419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbc2d9d640 1 --2- 172.21.15.162:0/2602870820 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbc4104530 0x7fbbc419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbb9d9b640 1 -- 172.21.15.162:0/2602870820 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbc4104530 msgr2=0x7fbbc419b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbb9d9b640 1 --2- 172.21.15.162:0/2602870820 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbc4104530 0x7fbbc419b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbb9d9b640 1 -- 172.21.15.162:0/2602870820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4102a10 msgr2=0x7fbbc419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:25.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbb9d9b640 1 --2- 172.21.15.162:0/2602870820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4102a10 0x7fbbc419a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbb9d9b640 1 -- 172.21.15.162:0/2602870820 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc419c220 con 0x7fbbc4103b70 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbb9d9b640 1 --2- 172.21.15.162:0/2602870820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc4103b70 0x7fbbc419ad40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00d950 tx=0x7fbbac00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbbbfff640 1 -- 172.21.15.162:0/2602870820 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac017030 con 0x7fbbc4103b70 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbc8875640 1 -- 172.21.15.162:0/2602870820 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc419c510 con 0x7fbbc4103b70 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbbbfff640 1 -- 172.21.15.162:0/2602870820 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fbbac004020 con 0x7fbbc4103b70 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbbbfff640 1 -- 172.21.15.162:0/2602870820 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0055a0 con 0x7fbbc4103b70 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.611+0000 7fbbc8875640 1 -- 172.21.15.162:0/2602870820 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc41a2bf0 con 0x7fbbc4103b70 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.612+0000 7fbbc8875640 1 -- 172.21.15.162:0/2602870820 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc4102e10 con 0x7fbbc4103b70 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.613+0000 7fbbbbfff640 1 -- 172.21.15.162:0/2602870820 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7fbbac009a30 con 0x7fbbc4103b70 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.613+0000 7fbbbbfff640 1 --2- 172.21.15.162:0/2602870820 >> v2:172.21.15.42:6800/92962027 conn(0x7fbbb007b020 0x7fbbb007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.613+0000 7fbbbbfff640 1 -- 172.21.15.162:0/2602870820 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4081+0+0 (secure 0 0 0) 0x7fbbac09d530 con 0x7fbbc4103b70 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.614+0000 7fbbc259c640 1 --2- 172.21.15.162:0/2602870820 >> v2:172.21.15.42:6800/92962027 conn(0x7fbbb007b020 0x7fbbb007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.614+0000 7fbbc259c640 1 --2- 172.21.15.162:0/2602870820 >> v2:172.21.15.42:6800/92962027 conn(0x7fbbb007b020 0x7fbbb007d4e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40096c0 tx=0x7fbbb4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:25.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.618+0000 7fbbbbfff640 1 -- 172.21.15.162:0/2602870820 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fbbac064f60 con 0x7fbbc4103b70 2024-09-21T17:45:25.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: pgmap v168: 1 pgs: 1 peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:25.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi042=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:25.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[29361]: Deploying daemon rgw.foo.a on smithi042 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: pgmap v168: 1 pgs: 1 peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:25.652 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi042=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:25.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-21T17:45:25.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:25.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:25.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:25.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:25.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:25.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T17:45:25.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T17:45:25.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:25.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:25.653 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:25 smithi042 ceph-mon[38309]: Deploying daemon rgw.foo.a on smithi042 2024-09-21T17:45:25.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:25.797+0000 7fbbc8875640 1 -- 172.21.15.162:0/2602870820 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) -- 0x7fbbc41a3270 con 0x7fbbc4103b70 2024-09-21T17:45:26.241 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 17:45:26 smithi042 systemd[1]: Starting Ceph rgw.foo.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:45:26.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.248+0000 7fbbbbfff640 1 -- 172.21.15.162:0/2602870820 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v51) ==== 160+0+0 (secure 0 0 0) 0x7fbbac069340 con 0x7fbbc4103b70 2024-09-21T17:45:26.251 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'datapool' created 2024-09-21T17:45:26.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 -- 172.21.15.162:0/2602870820 >> v2:172.21.15.42:6800/92962027 conn(0x7fbbb007b020 msgr2=0x7fbbb007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:26.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 --2- 172.21.15.162:0/2602870820 >> v2:172.21.15.42:6800/92962027 conn(0x7fbbb007b020 0x7fbbb007d4e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40096c0 tx=0x7fbbb4000bc0 comp rx=0 tx=0).stop 2024-09-21T17:45:26.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 -- 172.21.15.162:0/2602870820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc4103b70 msgr2=0x7fbbc419ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:26.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 --2- 172.21.15.162:0/2602870820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc4103b70 0x7fbbc419ad40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00d950 tx=0x7fbbac00de10 comp rx=0 tx=0).stop 2024-09-21T17:45:26.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 -- 172.21.15.162:0/2602870820 shutdown_connections 2024-09-21T17:45:26.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 --2- 172.21.15.162:0/2602870820 >> v2:172.21.15.42:6800/92962027 conn(0x7fbbb007b020 0x7fbbb007d4e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:26.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 --2- 172.21.15.162:0/2602870820 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbc4104530 0x7fbbc419b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:26.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 --2- 172.21.15.162:0/2602870820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc4103b70 0x7fbbc419ad40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:26.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 --2- 172.21.15.162:0/2602870820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4102a10 0x7fbbc419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:26.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 -- 172.21.15.162:0/2602870820 >> 172.21.15.162:0/2602870820 conn(0x7fbbc40fe2c0 msgr2=0x7fbbc40ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:26.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 -- 172.21.15.162:0/2602870820 shutdown_connections 2024-09-21T17:45:26.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:26.251+0000 7fbbc8875640 1 -- 172.21.15.162:0/2602870820 wait complete. 2024-09-21T17:45:26.507 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/2602870820' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T17:45:26.507 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T17:45:26.508 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 17:45:26 smithi042 podman[62643]: 2024-09-21 17:45:26.257534543 +0000 UTC m=+0.019487413 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5 2024-09-21T17:45:26.508 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 17:45:26 smithi042 podman[62643]: 2024-09-21 17:45:26.393163499 +0000 UTC m=+0.155116386 container create c0eca6926a819da0f0ca1305c0eadcd4149156dc389691053bda8315bcf1d8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-rgw-foo-a, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T17:45:26.508 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/2602870820' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T17:45:26.508 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T17:45:26.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/2602870820' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T17:45:26.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T17:45:26.847 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 17:45:26 smithi042 podman[62643]: 2024-09-21 17:45:26.620998452 +0000 UTC m=+0.382951343 container init c0eca6926a819da0f0ca1305c0eadcd4149156dc389691053bda8315bcf1d8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-rgw-foo-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T17:45:26.847 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 17:45:26 smithi042 podman[62643]: 2024-09-21 17:45:26.624212688 +0000 UTC m=+0.386165562 container start c0eca6926a819da0f0ca1305c0eadcd4149156dc389691053bda8315bcf1d8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-rgw-foo-a, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T17:45:26.878 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- rbd pool init datapool 2024-09-21T17:45:27.126 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:45:27.164 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 17:45:26 smithi042 bash[62643]: c0eca6926a819da0f0ca1305c0eadcd4149156dc389691053bda8315bcf1d8d9 2024-09-21T17:45:27.164 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 17:45:26 smithi042 systemd[1]: Started Ceph rgw.foo.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:45:27.501 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:27.501 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T17:45:27.501 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: Cluster is now healthy 2024-09-21T17:45:27.501 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-21T17:45:27.501 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: osdmap e51: 8 total, 8 up, 8 in 2024-09-21T17:45:27.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-21T17:45:27.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:27 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:27.503 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:27.503 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T17:45:27.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: Cluster is now healthy 2024-09-21T17:45:27.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-21T17:45:27.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: osdmap e51: 8 total, 8 up, 8 in 2024-09-21T17:45:27.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-21T17:45:27.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: Cluster is now healthy 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: osdmap e51: 8 total, 8 up, 8 in 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:27.505 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:27 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:28.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:28 smithi162 ceph-mon[32106]: osdmap e52: 8 total, 8 up, 8 in 2024-09-21T17:45:28.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3999746323' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-21T17:45:28.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/968360542' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T17:45:28.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T17:45:28.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:28.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:28.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:28.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:28 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[29361]: osdmap e52: 8 total, 8 up, 8 in 2024-09-21T17:45:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3999746323' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-21T17:45:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/968360542' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T17:45:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T17:45:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[38309]: osdmap e52: 8 total, 8 up, 8 in 2024-09-21T17:45:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3999746323' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-21T17:45:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/968360542' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T17:45:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T17:45:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:28.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:28.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:28.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:28 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:45:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:29 smithi162 ceph-mon[32106]: pgmap v172: 36 pgs: 5 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T17:45:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:29 smithi162 ceph-mon[32106]: Checking dashboard <-> RGW credentials 2024-09-21T17:45:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:29 smithi162 ceph-mon[32106]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:45:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3999746323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-21T17:45:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-21T17:45:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:29 smithi162 ceph-mon[32106]: osdmap e53: 8 total, 8 up, 8 in 2024-09-21T17:45:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:29 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[29361]: pgmap v172: 36 pgs: 5 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T17:45:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[29361]: Checking dashboard <-> RGW credentials 2024-09-21T17:45:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[29361]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:45:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3999746323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-21T17:45:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-21T17:45:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[29361]: osdmap e53: 8 total, 8 up, 8 in 2024-09-21T17:45:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[38309]: pgmap v172: 36 pgs: 5 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T17:45:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[38309]: Checking dashboard <-> RGW credentials 2024-09-21T17:45:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[38309]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:45:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3999746323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-21T17:45:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-21T17:45:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[38309]: osdmap e53: 8 total, 8 up, 8 in 2024-09-21T17:45:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:29 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:30 smithi162 ceph-mon[32106]: osdmap e54: 8 total, 8 up, 8 in 2024-09-21T17:45:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:30 smithi162 ceph-mon[32106]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:30 smithi042 ceph-mon[29361]: osdmap e54: 8 total, 8 up, 8 in 2024-09-21T17:45:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:30 smithi042 ceph-mon[29361]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:30 smithi042 ceph-mon[38309]: osdmap e54: 8 total, 8 up, 8 in 2024-09-21T17:45:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:30 smithi042 ceph-mon[38309]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T17:45:30.932 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.162 --placement '1;smithi162=iscsi.a' 2024-09-21T17:45:31.183 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:45:31.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:31 smithi162 ceph-mon[32106]: pgmap v175: 68 pgs: 10 creating+peering, 39 unknown, 19 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T17:45:31.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T17:45:31.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:31 smithi162 ceph-mon[32106]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T17:45:31.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:31 smithi162 ceph-mon[32106]: osdmap e55: 8 total, 8 up, 8 in 2024-09-21T17:45:31.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.625+0000 7f2baa427640 1 -- 172.21.15.162:0/925826365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4103b60 msgr2=0x7f2ba4103fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:31.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.625+0000 7f2baa427640 1 --2- 172.21.15.162:0/925826365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4103b60 0x7f2ba4103fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009930 tx=0x7f2b9802a420 comp rx=0 tx=0).stop 2024-09-21T17:45:31.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.625+0000 7f2baa427640 1 -- 172.21.15.162:0/925826365 shutdown_connections 2024-09-21T17:45:31.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.625+0000 7f2baa427640 1 --2- 172.21.15.162:0/925826365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba4104520 0x7f2ba410aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:31.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.625+0000 7f2baa427640 1 --2- 172.21.15.162:0/925826365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4103b60 0x7f2ba4103fe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:31.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.625+0000 7f2baa427640 1 --2- 172.21.15.162:0/925826365 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ba4102a00 0x7f2ba4102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:31.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.625+0000 7f2baa427640 1 -- 172.21.15.162:0/925826365 >> 172.21.15.162:0/925826365 conn(0x7f2ba40fe2f0 msgr2=0x7f2ba4100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:31.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.625+0000 7f2baa427640 1 -- 172.21.15.162:0/925826365 shutdown_connections 2024-09-21T17:45:31.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.625+0000 7f2baa427640 1 -- 172.21.15.162:0/925826365 wait complete. 2024-09-21T17:45:31.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.626+0000 7f2baa427640 1 Processor -- start 2024-09-21T17:45:31.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.626+0000 7f2baa427640 1 -- start start 2024-09-21T17:45:31.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.626+0000 7f2baa427640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ba4102a00 0x7f2ba4198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:31.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.626+0000 7f2baa427640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4103b60 0x7f2ba4198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:31.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.626+0000 7f2baa427640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba4104520 0x7f2ba41997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:31.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.626+0000 7f2baa427640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba410ddb0 con 0x7f2ba4104520 2024-09-21T17:45:31.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.626+0000 7f2baa427640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba410dc30 con 0x7f2ba4103b60 2024-09-21T17:45:31.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.626+0000 7f2baa427640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba410df30 con 0x7f2ba4102a00 2024-09-21T17:45:31.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.626+0000 7f2ba37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4103b60 0x7f2ba4198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:31.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.626+0000 7f2ba37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4103b60 0x7f2ba4198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34598/0 (socket says 172.21.15.162:34598) 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.626+0000 7f2ba37fe640 1 -- 172.21.15.162:0/3737502139 learned_addr learned my addr 172.21.15.162:0/3737502139 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba3fff640 1 --2- 172.21.15.162:0/3737502139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ba4102a00 0x7f2ba4198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba89c4640 1 --2- 172.21.15.162:0/3737502139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba4104520 0x7f2ba41997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba37fe640 1 -- 172.21.15.162:0/3737502139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ba4102a00 msgr2=0x7f2ba4198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba37fe640 1 --2- 172.21.15.162:0/3737502139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ba4102a00 0x7f2ba4198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba37fe640 1 -- 172.21.15.162:0/3737502139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba4104520 msgr2=0x7f2ba41997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba37fe640 1 --2- 172.21.15.162:0/3737502139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba4104520 0x7f2ba41997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba37fe640 1 -- 172.21.15.162:0/3737502139 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba419a090 con 0x7f2ba4103b60 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba89c4640 1 --2- 172.21.15.162:0/3737502139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba4104520 0x7f2ba41997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba37fe640 1 --2- 172.21.15.162:0/3737502139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4103b60 0x7f2ba4198bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009230 tx=0x7f2b98032c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba17fa640 1 -- 172.21.15.162:0/3737502139 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9803f030 con 0x7f2ba4103b60 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba17fa640 1 -- 172.21.15.162:0/3737502139 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2b98003c80 con 0x7f2ba4103b60 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2ba17fa640 1 -- 172.21.15.162:0/3737502139 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b98035070 con 0x7f2ba4103b60 2024-09-21T17:45:31.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2baa427640 1 -- 172.21.15.162:0/3737502139 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba419a320 con 0x7f2ba4103b60 2024-09-21T17:45:31.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.627+0000 7f2baa427640 1 -- 172.21.15.162:0/3737502139 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba41a0910 con 0x7f2ba4103b60 2024-09-21T17:45:31.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.628+0000 7f2baa427640 1 -- 172.21.15.162:0/3737502139 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba4102e00 con 0x7f2ba4103b60 2024-09-21T17:45:31.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.629+0000 7f2ba17fa640 1 -- 172.21.15.162:0/3737502139 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7f2b98042030 con 0x7f2ba4103b60 2024-09-21T17:45:31.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.629+0000 7f2ba17fa640 1 --2- 172.21.15.162:0/3737502139 >> v2:172.21.15.42:6800/92962027 conn(0x7f2b8c07b020 0x7f2b8c07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:31.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.629+0000 7f2ba17fa640 1 -- 172.21.15.162:0/3737502139 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5549+0+0 (secure 0 0 0) 0x7f2b980be750 con 0x7f2ba4103b60 2024-09-21T17:45:31.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.629+0000 7f2ba3fff640 1 --2- 172.21.15.162:0/3737502139 >> v2:172.21.15.42:6800/92962027 conn(0x7f2b8c07b020 0x7f2b8c07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:31.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.630+0000 7f2ba3fff640 1 --2- 172.21.15.162:0/3737502139 >> v2:172.21.15.42:6800/92962027 conn(0x7f2b8c07b020 0x7f2b8c07d4e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2b94005fd0 tx=0x7f2b94005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:31.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.634+0000 7f2ba17fa640 1 -- 172.21.15.162:0/3737502139 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f2b98085bd0 con 0x7f2ba4103b60 2024-09-21T17:45:31.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:31 smithi042 ceph-mon[29361]: pgmap v175: 68 pgs: 10 creating+peering, 39 unknown, 19 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T17:45:31.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T17:45:31.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:31 smithi042 ceph-mon[29361]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T17:45:31.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:31 smithi042 ceph-mon[29361]: osdmap e55: 8 total, 8 up, 8 in 2024-09-21T17:45:31.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:31 smithi042 ceph-mon[38309]: pgmap v175: 68 pgs: 10 creating+peering, 39 unknown, 19 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T17:45:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T17:45:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:31 smithi042 ceph-mon[38309]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T17:45:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:31 smithi042 ceph-mon[38309]: osdmap e55: 8 total, 8 up, 8 in 2024-09-21T17:45:31.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.822+0000 7f2baa427640 1 -- 172.21.15.162:0/3737502139 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.162", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}) -- 0x7f2ba4063590 con 0x7f2b8c07b020 2024-09-21T17:45:31.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.830+0000 7f2ba17fa640 1 -- 172.21.15.162:0/3737502139 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+35 (secure 0 0 0) 0x7f2ba4063590 con 0x7f2b8c07b020 2024-09-21T17:45:31.832 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled iscsi.datapool update... 2024-09-21T17:45:31.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 -- 172.21.15.162:0/3737502139 >> v2:172.21.15.42:6800/92962027 conn(0x7f2b8c07b020 msgr2=0x7f2b8c07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 --2- 172.21.15.162:0/3737502139 >> v2:172.21.15.42:6800/92962027 conn(0x7f2b8c07b020 0x7f2b8c07d4e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2b94005fd0 tx=0x7f2b94005e20 comp rx=0 tx=0).stop 2024-09-21T17:45:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 -- 172.21.15.162:0/3737502139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4103b60 msgr2=0x7f2ba4198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 --2- 172.21.15.162:0/3737502139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4103b60 0x7f2ba4198bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009230 tx=0x7f2b98032c40 comp rx=0 tx=0).stop 2024-09-21T17:45:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 -- 172.21.15.162:0/3737502139 shutdown_connections 2024-09-21T17:45:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 --2- 172.21.15.162:0/3737502139 >> v2:172.21.15.42:6800/92962027 conn(0x7f2b8c07b020 0x7f2b8c07d4e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 --2- 172.21.15.162:0/3737502139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba4104520 0x7f2ba41997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 --2- 172.21.15.162:0/3737502139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4103b60 0x7f2ba4198bb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 --2- 172.21.15.162:0/3737502139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ba4102a00 0x7f2ba4198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 -- 172.21.15.162:0/3737502139 >> 172.21.15.162:0/3737502139 conn(0x7f2ba40fe2f0 msgr2=0x7f2ba40ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 -- 172.21.15.162:0/3737502139 shutdown_connections 2024-09-21T17:45:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:31.833+0000 7f2baa427640 1 -- 172.21.15.162:0/3737502139 wait complete. 2024-09-21T17:45:32.378 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:32 smithi162 ceph-mon[32106]: osdmap e56: 8 total, 8 up, 8 in 2024-09-21T17:45:32.378 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.378 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.378 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:32 smithi162 ceph-mon[32106]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.378 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.378 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:32 smithi162 ceph-mon[32106]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.162", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:32.378 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:32 smithi162 ceph-mon[32106]: Saving service iscsi.datapool spec with placement smithi162=iscsi.a;count:1 2024-09-21T17:45:32.378 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:32 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:32.404 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-09-21T17:45:32.405 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:45:32.405 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-21T17:45:32.435 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:45:32.435 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-21T17:45:32.461 DEBUG:teuthology.orchestra.run.smithi162:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@iscsi.iscsi.a.service 2024-09-21T17:45:32.505 INFO:tasks.cephadm:Adding prometheus.a on smithi162 2024-09-21T17:45:32.505 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch apply prometheus '1;smithi162=a' 2024-09-21T17:45:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[29361]: osdmap e56: 8 total, 8 up, 8 in 2024-09-21T17:45:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[29361]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[29361]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.162", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[29361]: Saving service iscsi.datapool spec with placement smithi162=iscsi.a;count:1 2024-09-21T17:45:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[38309]: osdmap e56: 8 total, 8 up, 8 in 2024-09-21T17:45:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[38309]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T17:45:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[38309]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.162", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[38309]: Saving service iscsi.datapool spec with placement smithi162=iscsi.a;count:1 2024-09-21T17:45:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:32 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:32.786 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:45:33.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.211+0000 7fd6258d2640 1 -- 172.21.15.162:0/179446211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd620103450 msgr2=0x7fd620109dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:33.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.211+0000 7fd6258d2640 1 --2- 172.21.15.162:0/179446211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd620103450 0x7fd620109dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd618009cd0 tx=0x7fd61802a8e0 comp rx=0 tx=0).stop 2024-09-21T17:45:33.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.211+0000 7fd6258d2640 1 -- 172.21.15.162:0/179446211 shutdown_connections 2024-09-21T17:45:33.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.211+0000 7fd6258d2640 1 --2- 172.21.15.162:0/179446211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd620103450 0x7fd620109dd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:33.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.211+0000 7fd6258d2640 1 --2- 172.21.15.162:0/179446211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd620102a90 0x7fd620102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.211+0000 7fd6258d2640 1 --2- 172.21.15.162:0/179446211 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd620101930 0x7fd620101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.211+0000 7fd6258d2640 1 -- 172.21.15.162:0/179446211 >> 172.21.15.162:0/179446211 conn(0x7fd6200fd200 msgr2=0x7fd6200ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.211+0000 7fd6258d2640 1 -- 172.21.15.162:0/179446211 shutdown_connections 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.211+0000 7fd6258d2640 1 -- 172.21.15.162:0/179446211 wait complete. 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd6258d2640 1 Processor -- start 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd6258d2640 1 -- start start 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd6258d2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd620101930 0x7fd6201056f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd6258d2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd620102a90 0x7fd620103f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd6258d2640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd620103450 0x7fd6201044a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd6258d2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd62010cd40 con 0x7fd620101930 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd6258d2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd62010cbc0 con 0x7fd620102a90 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd6258d2640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fd62010cec0 con 0x7fd620103450 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd6167fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd620102a90 0x7fd620103f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd6167fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd620102a90 0x7fd620103f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34614/0 (socket says 172.21.15.162:34614) 2024-09-21T17:45:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd6167fc640 1 -- 172.21.15.162:0/2746384672 learned_addr learned my addr 172.21.15.162:0/2746384672 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd61f7fe640 1 --2- 172.21.15.162:0/2746384672 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd620103450 0x7fd6201044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.212+0000 7fd61effd640 1 --2- 172.21.15.162:0/2746384672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd620101930 0x7fd6201056f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.213+0000 7fd6167fc640 1 -- 172.21.15.162:0/2746384672 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd620103450 msgr2=0x7fd6201044a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.213+0000 7fd6167fc640 1 --2- 172.21.15.162:0/2746384672 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd620103450 0x7fd6201044a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.213+0000 7fd6167fc640 1 -- 172.21.15.162:0/2746384672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd620101930 msgr2=0x7fd6201056f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.213+0000 7fd6167fc640 1 --2- 172.21.15.162:0/2746384672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd620101930 0x7fd6201056f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.213+0000 7fd6167fc640 1 -- 172.21.15.162:0/2746384672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd620104d60 con 0x7fd620102a90 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.213+0000 7fd6167fc640 1 --2- 172.21.15.162:0/2746384672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd620102a90 0x7fd620103f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd60800b4a0 tx=0x7fd60800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.213+0000 7fd6248d0640 1 -- 172.21.15.162:0/2746384672 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608014070 con 0x7fd620102a90 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.213+0000 7fd6248d0640 1 -- 172.21.15.162:0/2746384672 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fd608010a90 con 0x7fd620102a90 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.213+0000 7fd6258d2640 1 -- 172.21.15.162:0/2746384672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6201a2750 con 0x7fd620102a90 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.213+0000 7fd6248d0640 1 -- 172.21.15.162:0/2746384672 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608017b80 con 0x7fd620102a90 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.213+0000 7fd6258d2640 1 -- 172.21.15.162:0/2746384672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6201a2d30 con 0x7fd620102a90 2024-09-21T17:45:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.214+0000 7fd6258d2640 1 -- 172.21.15.162:0/2746384672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd620101db0 con 0x7fd620102a90 2024-09-21T17:45:33.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.215+0000 7fd6248d0640 1 -- 172.21.15.162:0/2746384672 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7fd608017070 con 0x7fd620102a90 2024-09-21T17:45:33.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.215+0000 7fd6248d0640 1 --2- 172.21.15.162:0/2746384672 >> v2:172.21.15.42:6800/92962027 conn(0x7fd60c07b020 0x7fd60c07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:33.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.215+0000 7fd6248d0640 1 -- 172.21.15.162:0/2746384672 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5560+0+0 (secure 0 0 0) 0x7fd60809d590 con 0x7fd620102a90 2024-09-21T17:45:33.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.215+0000 7fd61effd640 1 --2- 172.21.15.162:0/2746384672 >> v2:172.21.15.42:6800/92962027 conn(0x7fd60c07b020 0x7fd60c07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:33.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.216+0000 7fd61effd640 1 --2- 172.21.15.162:0/2746384672 >> v2:172.21.15.42:6800/92962027 conn(0x7fd60c07b020 0x7fd60c07d4e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd610009890 tx=0x7fd610008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:33.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.219+0000 7fd6248d0640 1 -- 172.21.15.162:0/2746384672 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fd608064a80 con 0x7fd620102a90 2024-09-21T17:45:33.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.430+0000 7fd6258d2640 1 -- 172.21.15.162:0/2746384672 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}) -- 0x7fd62002e880 con 0x7fd60c07b020 2024-09-21T17:45:33.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.437+0000 7fd6248d0640 1 -- 172.21.15.162:0/2746384672 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+31 (secure 0 0 0) 0x7fd62002e880 con 0x7fd60c07b020 2024-09-21T17:45:33.439 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled prometheus update... 2024-09-21T17:45:33.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 -- 172.21.15.162:0/2746384672 >> v2:172.21.15.42:6800/92962027 conn(0x7fd60c07b020 msgr2=0x7fd60c07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:33.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 --2- 172.21.15.162:0/2746384672 >> v2:172.21.15.42:6800/92962027 conn(0x7fd60c07b020 0x7fd60c07d4e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd610009890 tx=0x7fd610008040 comp rx=0 tx=0).stop 2024-09-21T17:45:33.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 -- 172.21.15.162:0/2746384672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd620102a90 msgr2=0x7fd620103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:33.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 --2- 172.21.15.162:0/2746384672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd620102a90 0x7fd620103f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd60800b4a0 tx=0x7fd60800b960 comp rx=0 tx=0).stop 2024-09-21T17:45:33.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 -- 172.21.15.162:0/2746384672 shutdown_connections 2024-09-21T17:45:33.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 --2- 172.21.15.162:0/2746384672 >> v2:172.21.15.42:6800/92962027 conn(0x7fd60c07b020 0x7fd60c07d4e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:33.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 --2- 172.21.15.162:0/2746384672 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd620103450 0x7fd6201044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:33.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 --2- 172.21.15.162:0/2746384672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd620102a90 0x7fd620103f60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:33.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 --2- 172.21.15.162:0/2746384672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd620101930 0x7fd6201056f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:33.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 -- 172.21.15.162:0/2746384672 >> 172.21.15.162:0/2746384672 conn(0x7fd6200fd200 msgr2=0x7fd62006bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:33.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 -- 172.21.15.162:0/2746384672 shutdown_connections 2024-09-21T17:45:33.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:33.441+0000 7fd6258d2640 1 -- 172.21.15.162:0/2746384672 wait complete. 2024-09-21T17:45:33.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:33 smithi162 ceph-mon[32106]: pgmap v178: 100 pgs: 13 creating+peering, 44 unknown, 43 active+clean; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-21T17:45:33.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:33 smithi162 ceph-mon[32106]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T17:45:33.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T17:45:33.485 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:33 smithi162 ceph-mon[32106]: osdmap e57: 8 total, 8 up, 8 in 2024-09-21T17:45:33.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:33 smithi042 ceph-mon[29361]: pgmap v178: 100 pgs: 13 creating+peering, 44 unknown, 43 active+clean; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-21T17:45:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:33 smithi042 ceph-mon[29361]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T17:45:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T17:45:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:33 smithi042 ceph-mon[29361]: osdmap e57: 8 total, 8 up, 8 in 2024-09-21T17:45:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:33 smithi042 ceph-mon[38309]: pgmap v178: 100 pgs: 13 creating+peering, 44 unknown, 43 active+clean; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-21T17:45:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:33 smithi042 ceph-mon[38309]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T17:45:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T17:45:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:33 smithi042 ceph-mon[38309]: osdmap e57: 8 total, 8 up, 8 in 2024-09-21T17:45:34.004 DEBUG:teuthology.orchestra.run.smithi162:prometheus.a> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@prometheus.a.service 2024-09-21T17:45:34.006 INFO:tasks.cephadm:Adding node-exporter.a on smithi042 2024-09-21T17:45:34.006 INFO:tasks.cephadm:Adding node-exporter.b on smithi162 2024-09-21T17:45:34.006 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch apply node-exporter '2;smithi042=a;smithi162=b' 2024-09-21T17:45:34.289 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:45:34.305 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:34 smithi162 ceph-mon[32106]: osdmap e58: 8 total, 8 up, 8 in 2024-09-21T17:45:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:34 smithi162 ceph-mon[32106]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:34 smithi162 ceph-mon[32106]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:34 smithi162 ceph-mon[32106]: Saving service prometheus spec with placement smithi162=a;count:1 2024-09-21T17:45:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:34 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:34 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:45:34.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[29361]: osdmap e58: 8 total, 8 up, 8 in 2024-09-21T17:45:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[29361]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[29361]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[29361]: Saving service prometheus spec with placement smithi162=a;count:1 2024-09-21T17:45:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:45:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[38309]: osdmap e58: 8 total, 8 up, 8 in 2024-09-21T17:45:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[38309]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T17:45:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[38309]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[38309]: Saving service prometheus spec with placement smithi162=a;count:1 2024-09-21T17:45:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:34 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:45:34.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.908+0000 7f630c002640 1 -- 172.21.15.162:0/2687584367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6304103b60 msgr2=0x7f6304103fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:34.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.908+0000 7f630c002640 1 --2- 172.21.15.162:0/2687584367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6304103b60 0x7f6304103fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009930 tx=0x7f62f402a420 comp rx=0 tx=0).stop 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.908+0000 7f630c002640 1 -- 172.21.15.162:0/2687584367 shutdown_connections 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.908+0000 7f630c002640 1 --2- 172.21.15.162:0/2687584367 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6304104520 0x7f630410aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.908+0000 7f630c002640 1 --2- 172.21.15.162:0/2687584367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6304103b60 0x7f6304103fe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.908+0000 7f630c002640 1 --2- 172.21.15.162:0/2687584367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6304102a00 0x7f6304102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.908+0000 7f630c002640 1 -- 172.21.15.162:0/2687584367 >> 172.21.15.162:0/2687584367 conn(0x7f63040fe2f0 msgr2=0x7f6304100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f630c002640 1 -- 172.21.15.162:0/2687584367 shutdown_connections 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f630c002640 1 -- 172.21.15.162:0/2687584367 wait complete. 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f630c002640 1 Processor -- start 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f630c002640 1 -- start start 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f630c002640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6304102a00 0x7f6304198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f630c002640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6304103b60 0x7f6304198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f630c002640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6304104520 0x7f63041998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f630c002640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f630410de10 con 0x7f6304104520 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f630c002640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f630410dc90 con 0x7f6304102a00 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f630c002640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f630410df90 con 0x7f6304103b60 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f6309d9e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6304102a00 0x7f6304198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f6309d9e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6304102a00 0x7f6304198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34632/0 (socket says 172.21.15.162:34632) 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.909+0000 7f6309d9e640 1 -- 172.21.15.162:0/567219527 learned_addr learned my addr 172.21.15.162:0/567219527 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f630959d640 1 --2- 172.21.15.162:0/567219527 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6304103b60 0x7f6304198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f630a59f640 1 --2- 172.21.15.162:0/567219527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6304104520 0x7f63041998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f6309d9e640 1 -- 172.21.15.162:0/567219527 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6304103b60 msgr2=0x7f6304198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f6309d9e640 1 --2- 172.21.15.162:0/567219527 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6304103b60 0x7f6304198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f6309d9e640 1 -- 172.21.15.162:0/567219527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6304104520 msgr2=0x7f63041998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f6309d9e640 1 --2- 172.21.15.162:0/567219527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6304104520 0x7f63041998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f6309d9e640 1 -- 172.21.15.162:0/567219527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630419a180 con 0x7f6304102a00 2024-09-21T17:45:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f630a59f640 1 --2- 172.21.15.162:0/567219527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6304104520 0x7f63041998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f630959d640 1 --2- 172.21.15.162:0/567219527 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6304103b60 0x7f6304198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f6309d9e640 1 --2- 172.21.15.162:0/567219527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6304102a00 0x7f6304198650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f630000b4a0 tx=0x7f630000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f62faffd640 1 -- 172.21.15.162:0/567219527 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300014070 con 0x7f6304102a00 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f62faffd640 1 -- 172.21.15.162:0/567219527 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f6300010a90 con 0x7f6304102a00 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f630c002640 1 -- 172.21.15.162:0/567219527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630419a470 con 0x7f6304102a00 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f62faffd640 1 -- 172.21.15.162:0/567219527 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300017b80 con 0x7f6304102a00 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.910+0000 7f630c002640 1 -- 172.21.15.162:0/567219527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63041a0b50 con 0x7f6304102a00 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.911+0000 7f630c002640 1 -- 172.21.15.162:0/567219527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6304102e80 con 0x7f6304102a00 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.912+0000 7f62faffd640 1 -- 172.21.15.162:0/567219527 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7f6300017070 con 0x7f6304102a00 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.912+0000 7f62faffd640 1 --2- 172.21.15.162:0/567219527 >> v2:172.21.15.42:6800/92962027 conn(0x7f62f007b020 0x7f62f007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.913+0000 7f62faffd640 1 -- 172.21.15.162:0/567219527 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5926+0+0 (secure 0 0 0) 0x7f630009d7a0 con 0x7f6304102a00 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.913+0000 7f630959d640 1 --2- 172.21.15.162:0/567219527 >> v2:172.21.15.42:6800/92962027 conn(0x7f62f007b020 0x7f62f007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.913+0000 7f630959d640 1 --2- 172.21.15.162:0/567219527 >> v2:172.21.15.42:6800/92962027 conn(0x7f62f007b020 0x7f62f007d4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62f4000c00 tx=0x7f62f40316f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:34.917+0000 7f62faffd640 1 -- 172.21.15.162:0/567219527 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f6300064aa0 con 0x7f6304102a00 2024-09-21T17:45:35.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.111+0000 7f630c002640 1 -- 172.21.15.162:0/567219527 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi042=a;smithi162=b", "target": ["mon-mgr", ""]}) -- 0x7f630402e7f0 con 0x7f62f007b020 2024-09-21T17:45:35.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.119+0000 7f62faffd640 1 -- 172.21.15.162:0/567219527 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (secure 0 0 0) 0x7f630402e7f0 con 0x7f62f007b020 2024-09-21T17:45:35.121 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled node-exporter update... 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 -- 172.21.15.162:0/567219527 >> v2:172.21.15.42:6800/92962027 conn(0x7f62f007b020 msgr2=0x7f62f007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 --2- 172.21.15.162:0/567219527 >> v2:172.21.15.42:6800/92962027 conn(0x7f62f007b020 0x7f62f007d4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62f4000c00 tx=0x7f62f40316f0 comp rx=0 tx=0).stop 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 -- 172.21.15.162:0/567219527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6304102a00 msgr2=0x7f6304198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 --2- 172.21.15.162:0/567219527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6304102a00 0x7f6304198650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f630000b4a0 tx=0x7f630000b960 comp rx=0 tx=0).stop 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 -- 172.21.15.162:0/567219527 shutdown_connections 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 --2- 172.21.15.162:0/567219527 >> v2:172.21.15.42:6800/92962027 conn(0x7f62f007b020 0x7f62f007d4e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 --2- 172.21.15.162:0/567219527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6304104520 0x7f63041998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 --2- 172.21.15.162:0/567219527 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6304103b60 0x7f6304198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 --2- 172.21.15.162:0/567219527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6304102a00 0x7f6304198650 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 -- 172.21.15.162:0/567219527 >> 172.21.15.162:0/567219527 conn(0x7f63040fe2f0 msgr2=0x7f63040ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 -- 172.21.15.162:0/567219527 shutdown_connections 2024-09-21T17:45:35.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:35.121+0000 7f630c002640 1 -- 172.21.15.162:0/567219527 wait complete. 2024-09-21T17:45:35.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:35 smithi162 ceph-mon[32106]: pgmap v181: 132 pgs: 17 creating+peering, 40 unknown, 75 active+clean; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T17:45:35.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T17:45:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:35 smithi162 ceph-mon[32106]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T17:45:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:35 smithi162 ceph-mon[32106]: osdmap e59: 8 total, 8 up, 8 in 2024-09-21T17:45:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:35 smithi162 ceph-mon[32106]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:35 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:35.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[38309]: pgmap v181: 132 pgs: 17 creating+peering, 40 unknown, 75 active+clean; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T17:45:35.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T17:45:35.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[38309]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T17:45:35.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[38309]: osdmap e59: 8 total, 8 up, 8 in 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[38309]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[29361]: pgmap v181: 132 pgs: 17 creating+peering, 40 unknown, 75 active+clean; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[29361]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[29361]: osdmap e59: 8 total, 8 up, 8 in 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/358400444' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1888852982' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[29361]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T17:45:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:35 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:35.895 DEBUG:teuthology.orchestra.run.smithi042:node-exporter.a> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@node-exporter.a.service 2024-09-21T17:45:35.898 DEBUG:teuthology.orchestra.run.smithi162:node-exporter.b> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@node-exporter.b.service 2024-09-21T17:45:35.900 INFO:tasks.cephadm:Adding alertmanager.a on smithi042 2024-09-21T17:45:35.900 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch apply alertmanager '1;smithi042=a' 2024-09-21T17:45:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi042=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: Saving service node-exporter spec with placement smithi042=a;smithi162=b;count:2 2024-09-21T17:45:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T17:45:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T17:45:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: osdmap e60: 8 total, 8 up, 8 in 2024-09-21T17:45:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-21T17:45:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-21T17:45:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:36 smithi162 ceph-mon[32106]: Deploying daemon iscsi.iscsi.a on smithi162 2024-09-21T17:45:36.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi042=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: Saving service node-exporter spec with placement smithi042=a;smithi162=b;count:2 2024-09-21T17:45:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T17:45:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T17:45:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: osdmap e60: 8 total, 8 up, 8 in 2024-09-21T17:45:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-21T17:45:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-21T17:45:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[29361]: Deploying daemon iscsi.iscsi.a on smithi162 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi042=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: Saving service node-exporter spec with placement smithi042=a;smithi162=b;count:2 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: osdmap e60: 8 total, 8 up, 8 in 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:45:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:36 smithi042 ceph-mon[38309]: Deploying daemon iscsi.iscsi.a on smithi162 2024-09-21T17:45:36.952 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:45:37.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:37 smithi162 ceph-mon[32106]: pgmap v184: 132 pgs: 12 creating+peering, 12 unknown, 108 active+clean; 579 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 2.7 KiB/s wr, 58 op/s 2024-09-21T17:45:37.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:37 smithi162 ceph-mon[32106]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T17:45:37.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:37 smithi162 ceph-mon[32106]: Cluster is now healthy 2024-09-21T17:45:37.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.553+0000 7f694975f640 1 -- 172.21.15.162:0/2580152062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6944103400 msgr2=0x7f6944109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:37.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.553+0000 7f694975f640 1 --2- 172.21.15.162:0/2580152062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6944103400 0x7f6944109d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f693c009cd0 tx=0x7f693c02a8e0 comp rx=0 tx=0).stop 2024-09-21T17:45:37.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.553+0000 7f694975f640 1 -- 172.21.15.162:0/2580152062 shutdown_connections 2024-09-21T17:45:37.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.553+0000 7f694975f640 1 --2- 172.21.15.162:0/2580152062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6944103400 0x7f6944109d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:37.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.553+0000 7f694975f640 1 --2- 172.21.15.162:0/2580152062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6944102a40 0x7f6944102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:37.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.553+0000 7f694975f640 1 --2- 172.21.15.162:0/2580152062 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f69441018e0 0x7f6944101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:37.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.553+0000 7f694975f640 1 -- 172.21.15.162:0/2580152062 >> 172.21.15.162:0/2580152062 conn(0x7f69440fd1b0 msgr2=0x7f69440ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:37.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.553+0000 7f694975f640 1 -- 172.21.15.162:0/2580152062 shutdown_connections 2024-09-21T17:45:37.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.553+0000 7f694975f640 1 -- 172.21.15.162:0/2580152062 wait complete. 2024-09-21T17:45:37.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f694975f640 1 Processor -- start 2024-09-21T17:45:37.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f694975f640 1 -- start start 2024-09-21T17:45:37.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f694975f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69441018e0 0x7f694410bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:37.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f694975f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6944102a40 0x7f694410a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:37.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f694975f640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6944103400 0x7f694410ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:37.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f694975f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f694410ddb0 con 0x7f69441018e0 2024-09-21T17:45:37.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f694975f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f694410dc30 con 0x7f6944102a40 2024-09-21T17:45:37.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f694975f640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f694410df30 con 0x7f6944103400 2024-09-21T17:45:37.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f69427fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6944102a40 0x7f694410a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:37.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f69427fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6944102a40 0x7f694410a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34650/0 (socket says 172.21.15.162:34650) 2024-09-21T17:45:37.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f69427fc640 1 -- 172.21.15.162:0/1162250014 learned_addr learned my addr 172.21.15.162:0/1162250014 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.554+0000 7f69437fe640 1 --2- 172.21.15.162:0/1162250014 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6944103400 0x7f694410ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f6942ffd640 1 --2- 172.21.15.162:0/1162250014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69441018e0 0x7f694410bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f69427fc640 1 -- 172.21.15.162:0/1162250014 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6944103400 msgr2=0x7f694410ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f69427fc640 1 --2- 172.21.15.162:0/1162250014 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6944103400 0x7f694410ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f69427fc640 1 -- 172.21.15.162:0/1162250014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69441018e0 msgr2=0x7f694410bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f69427fc640 1 --2- 172.21.15.162:0/1162250014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69441018e0 0x7f694410bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f69427fc640 1 -- 172.21.15.162:0/1162250014 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694410b510 con 0x7f6944102a40 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f6942ffd640 1 --2- 172.21.15.162:0/1162250014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69441018e0 0x7f694410bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f69427fc640 1 --2- 172.21.15.162:0/1162250014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6944102a40 0x7f694410a7d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f693800c890 tx=0x7f693800cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f692bfff640 1 -- 172.21.15.162:0/1162250014 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938004220 con 0x7f6944102a40 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f692bfff640 1 -- 172.21.15.162:0/1162250014 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f6938007e30 con 0x7f6944102a40 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f692bfff640 1 -- 172.21.15.162:0/1162250014 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69380047a0 con 0x7f6944102a40 2024-09-21T17:45:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f694975f640 1 -- 172.21.15.162:0/1162250014 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69441a2570 con 0x7f6944102a40 2024-09-21T17:45:37.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.555+0000 7f694975f640 1 -- 172.21.15.162:0/1162250014 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69441a2a80 con 0x7f6944102a40 2024-09-21T17:45:37.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.556+0000 7f694975f640 1 -- 172.21.15.162:0/1162250014 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f694410e510 con 0x7f6944102a40 2024-09-21T17:45:37.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.557+0000 7f692bfff640 1 -- 172.21.15.162:0/1162250014 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7f69380079b0 con 0x7f6944102a40 2024-09-21T17:45:37.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.558+0000 7f692bfff640 1 --2- 172.21.15.162:0/1162250014 >> v2:172.21.15.42:6800/92962027 conn(0x7f692c07b070 0x7f692c07d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:37.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.558+0000 7f692bfff640 1 -- 172.21.15.162:0/1162250014 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5942+0+0 (secure 0 0 0) 0x7f693809dd00 con 0x7f6944102a40 2024-09-21T17:45:37.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.558+0000 7f6942ffd640 1 --2- 172.21.15.162:0/1162250014 >> v2:172.21.15.42:6800/92962027 conn(0x7f692c07b070 0x7f692c07d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:37.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.559+0000 7f6942ffd640 1 --2- 172.21.15.162:0/1162250014 >> v2:172.21.15.42:6800/92962027 conn(0x7f692c07b070 0x7f692c07d530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69340058c0 tx=0x7f6934005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:37.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.562+0000 7f692bfff640 1 -- 172.21.15.162:0/1162250014 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f6938014030 con 0x7f6944102a40 2024-09-21T17:45:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:37 smithi042 ceph-mon[29361]: pgmap v184: 132 pgs: 12 creating+peering, 12 unknown, 108 active+clean; 579 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 2.7 KiB/s wr, 58 op/s 2024-09-21T17:45:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:37 smithi042 ceph-mon[29361]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T17:45:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:37 smithi042 ceph-mon[29361]: Cluster is now healthy 2024-09-21T17:45:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:37 smithi042 ceph-mon[38309]: pgmap v184: 132 pgs: 12 creating+peering, 12 unknown, 108 active+clean; 579 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 2.7 KiB/s wr, 58 op/s 2024-09-21T17:45:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:37 smithi042 ceph-mon[38309]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T17:45:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:37 smithi042 ceph-mon[38309]: Cluster is now healthy 2024-09-21T17:45:37.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.774+0000 7f694975f640 1 -- 172.21.15.162:0/1162250014 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi042=a", "target": ["mon-mgr", ""]}) -- 0x7f694402e810 con 0x7f692c07b070 2024-09-21T17:45:37.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.782+0000 7f692bfff640 1 -- 172.21.15.162:0/1162250014 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+33 (secure 0 0 0) 0x7f694402e810 con 0x7f692c07b070 2024-09-21T17:45:37.786 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled alertmanager update... 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.784+0000 7f694975f640 1 -- 172.21.15.162:0/1162250014 >> v2:172.21.15.42:6800/92962027 conn(0x7f692c07b070 msgr2=0x7f692c07d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.784+0000 7f694975f640 1 --2- 172.21.15.162:0/1162250014 >> v2:172.21.15.42:6800/92962027 conn(0x7f692c07b070 0x7f692c07d530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69340058c0 tx=0x7f6934005d30 comp rx=0 tx=0).stop 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.784+0000 7f694975f640 1 -- 172.21.15.162:0/1162250014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6944102a40 msgr2=0x7f694410a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.784+0000 7f694975f640 1 --2- 172.21.15.162:0/1162250014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6944102a40 0x7f694410a7d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f693800c890 tx=0x7f693800cd50 comp rx=0 tx=0).stop 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.784+0000 7f694975f640 1 -- 172.21.15.162:0/1162250014 shutdown_connections 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.784+0000 7f694975f640 1 --2- 172.21.15.162:0/1162250014 >> v2:172.21.15.42:6800/92962027 conn(0x7f692c07b070 0x7f692c07d530 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.784+0000 7f694975f640 1 --2- 172.21.15.162:0/1162250014 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6944103400 0x7f694410ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.784+0000 7f694975f640 1 --2- 172.21.15.162:0/1162250014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6944102a40 0x7f694410a7d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.784+0000 7f694975f640 1 --2- 172.21.15.162:0/1162250014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69441018e0 0x7f694410bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.784+0000 7f694975f640 1 -- 172.21.15.162:0/1162250014 >> 172.21.15.162:0/1162250014 conn(0x7f69440fd1b0 msgr2=0x7f6944105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.785+0000 7f694975f640 1 -- 172.21.15.162:0/1162250014 shutdown_connections 2024-09-21T17:45:37.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:37.785+0000 7f694975f640 1 -- 172.21.15.162:0/1162250014 wait complete. 2024-09-21T17:45:38.673 DEBUG:teuthology.orchestra.run.smithi042:alertmanager.a> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@alertmanager.a.service 2024-09-21T17:45:38.676 INFO:tasks.cephadm:Adding grafana.a on smithi162 2024-09-21T17:45:38.676 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph orch apply grafana '1;smithi162=a' 2024-09-21T17:45:38.762 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 bash[57219]: 61c2ae96780141ffbf94ff8d036fbf6eadac7e082a0737a79379dff84a7af42e 2024-09-21T17:45:39.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-mon[32106]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi042=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:39.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-mon[32106]: Saving service alertmanager spec with placement smithi042=a;count:1 2024-09-21T17:45:39.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:39.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 systemd[1]: Started Ceph iscsi.iscsi.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:45:39.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug Reading the configuration object to update local LIO configuration 2024-09-21T17:45:39.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug Configuration does not have an entry for this host(smithi162.front.sepia.ceph.com) - nothing to define to LIO 2024-09-21T17:45:39.076 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: * Serving Flask app 'rbd-target-api' (lazy loading) 2024-09-21T17:45:39.076 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: * Environment: production 2024-09-21T17:45:39.076 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-21T17:45:39.076 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: Use a production WSGI server instead. 2024-09-21T17:45:39.076 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: * Debug mode: off 2024-09-21T17:45:39.076 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug * Running on all addresses. 2024-09-21T17:45:39.076 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-21T17:45:39.076 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: * Running on all addresses. 2024-09-21T17:45:39.076 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-21T17:45:39.076 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug * Running on http://[fe80::ec4:7aff:fe88:7f41]:5000/ (Press CTRL+C to quit) 2024-09-21T17:45:39.076 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: * Running on http://[fe80::ec4:7aff:fe88:7f41]:5000/ (Press CTRL+C to quit) 2024-09-21T17:45:39.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:38 smithi042 ceph-mon[29361]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi042=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:39.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:38 smithi042 ceph-mon[29361]: Saving service alertmanager spec with placement smithi042=a;count:1 2024-09-21T17:45:39.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:38 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:39.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:38 smithi042 ceph-mon[38309]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi042=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:39.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:38 smithi042 ceph-mon[38309]: Saving service alertmanager spec with placement smithi042=a;count:1 2024-09-21T17:45:39.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:38 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:39.415 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:45:39.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.865+0000 7f3b1e297640 1 -- 172.21.15.162:0/2964199761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b18102a40 msgr2=0x7f3b18102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:39.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.865+0000 7f3b1e297640 1 --2- 172.21.15.162:0/2964199761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b18102a40 0x7f3b18102ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009930 tx=0x7f3b0002a420 comp rx=0 tx=0).stop 2024-09-21T17:45:39.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.865+0000 7f3b1e297640 1 -- 172.21.15.162:0/2964199761 shutdown_connections 2024-09-21T17:45:39.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.865+0000 7f3b1e297640 1 --2- 172.21.15.162:0/2964199761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b18103400 0x7f3b18109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:39.901 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.865+0000 7f3b1e297640 1 --2- 172.21.15.162:0/2964199761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b18102a40 0x7f3b18102ec0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:39.901 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.865+0000 7f3b1e297640 1 --2- 172.21.15.162:0/2964199761 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b181018e0 0x7f3b18101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:39.901 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.865+0000 7f3b1e297640 1 -- 172.21.15.162:0/2964199761 >> 172.21.15.162:0/2964199761 conn(0x7f3b180fd1b0 msgr2=0x7f3b180ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:39.901 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.865+0000 7f3b1e297640 1 -- 172.21.15.162:0/2964199761 shutdown_connections 2024-09-21T17:45:39.901 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.865+0000 7f3b1e297640 1 -- 172.21.15.162:0/2964199761 wait complete. 2024-09-21T17:45:39.901 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.865+0000 7f3b1e297640 1 Processor -- start 2024-09-21T17:45:39.901 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.865+0000 7f3b1e297640 1 -- start start 2024-09-21T17:45:39.901 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1e297640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b181018e0 0x7f3b1806b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:39.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1e297640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b18102a40 0x7f3b1819d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:39.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1e297640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b18103400 0x7f3b1819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:39.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1e297640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1810cbf0 con 0x7f3b181018e0 2024-09-21T17:45:39.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1e297640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1810ca70 con 0x7f3b18103400 2024-09-21T17:45:39.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1e297640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1810cd70 con 0x7f3b18102a40 2024-09-21T17:45:39.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1c834640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b18103400 0x7f3b1819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:39.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1c834640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b18103400 0x7f3b1819f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34736/0 (socket says 172.21.15.162:34736) 2024-09-21T17:45:39.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1c834640 1 -- 172.21.15.162:0/3088992455 learned_addr learned my addr 172.21.15.162:0/3088992455 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:45:39.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b0ffff640 1 --2- 172.21.15.162:0/3088992455 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b18102a40 0x7f3b1819d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:39.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b17fff640 1 --2- 172.21.15.162:0/3088992455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b181018e0 0x7f3b1806b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:39.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1c834640 1 -- 172.21.15.162:0/3088992455 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b18102a40 msgr2=0x7f3b1819d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:39.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1c834640 1 --2- 172.21.15.162:0/3088992455 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b18102a40 0x7f3b1819d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:39.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1c834640 1 -- 172.21.15.162:0/3088992455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b181018e0 msgr2=0x7f3b1806b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:39.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1c834640 1 --2- 172.21.15.162:0/3088992455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b181018e0 0x7f3b1806b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:39.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1c834640 1 -- 172.21.15.162:0/3088992455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b181a00a0 con 0x7f3b18103400 2024-09-21T17:45:39.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1c834640 1 --2- 172.21.15.162:0/3088992455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b18103400 0x7f3b1819f7e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000eaa0 tx=0x7f3b1000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b15ffb640 1 -- 172.21.15.162:0/3088992455 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000cdb0 con 0x7f3b18103400 2024-09-21T17:45:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b15ffb640 1 -- 172.21.15.162:0/3088992455 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f3b10005020 con 0x7f3b18103400 2024-09-21T17:45:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1e297640 1 -- 172.21.15.162:0/3088992455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b181a0390 con 0x7f3b18103400 2024-09-21T17:45:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b15ffb640 1 -- 172.21.15.162:0/3088992455 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b100116d0 con 0x7f3b18103400 2024-09-21T17:45:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.866+0000 7f3b1e297640 1 -- 172.21.15.162:0/3088992455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b181a0880 con 0x7f3b18103400 2024-09-21T17:45:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.867+0000 7f3b1e297640 1 -- 172.21.15.162:0/3088992455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b18101ce0 con 0x7f3b18103400 2024-09-21T17:45:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.868+0000 7f3b15ffb640 1 -- 172.21.15.162:0/3088992455 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103198+0+0 (secure 0 0 0) 0x7f3b10004a40 con 0x7f3b18103400 2024-09-21T17:45:39.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.869+0000 7f3b15ffb640 1 --2- 172.21.15.162:0/3088992455 >> v2:172.21.15.42:6800/92962027 conn(0x7f3b0407b020 0x7f3b0407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.869+0000 7f3b15ffb640 1 -- 172.21.15.162:0/3088992455 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5942+0+0 (secure 0 0 0) 0x7f3b1009e390 con 0x7f3b18103400 2024-09-21T17:45:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.869+0000 7f3b17fff640 1 --2- 172.21.15.162:0/3088992455 >> v2:172.21.15.42:6800/92962027 conn(0x7f3b0407b020 0x7f3b0407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.869+0000 7f3b17fff640 1 --2- 172.21.15.162:0/3088992455 >> v2:172.21.15.42:6800/92962027 conn(0x7f3b0407b020 0x7f3b0407d4e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3b08005fd0 tx=0x7f3b08005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:39.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:39.873+0000 7f3b15ffb640 1 -- 172.21.15.162:0/3088992455 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f3b10016030 con 0x7f3b18103400 2024-09-21T17:45:40.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:39 smithi162 ceph-mon[32106]: pgmap v185: 132 pgs: 4 creating+peering, 128 active+clean; 580 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s rd, 4.2 KiB/s wr, 122 op/s 2024-09-21T17:45:40.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/1648442352' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T17:45:40.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:39 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:39 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:39 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:39 smithi162 ceph-mon[32106]: Checking pool "datapool" exists for service iscsi.datapool 2024-09-21T17:45:40.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:39 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:39 smithi162 ceph-mon[32106]: osdmap e61: 8 total, 8 up, 8 in 2024-09-21T17:45:40.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.096+0000 7f3b1e297640 1 -- 172.21.15.162:0/3088992455 --> v2:172.21.15.42:6800/92962027 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}) -- 0x7f3b1802e860 con 0x7f3b0407b020 2024-09-21T17:45:40.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.104+0000 7f3b15ffb640 1 -- 172.21.15.162:0/3088992455 <== mgr.14152 v2:172.21.15.42:6800/92962027 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3b1802e860 con 0x7f3b0407b020 2024-09-21T17:45:40.106 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled grafana update... 2024-09-21T17:45:40.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 -- 172.21.15.162:0/3088992455 >> v2:172.21.15.42:6800/92962027 conn(0x7f3b0407b020 msgr2=0x7f3b0407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:40.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 --2- 172.21.15.162:0/3088992455 >> v2:172.21.15.42:6800/92962027 conn(0x7f3b0407b020 0x7f3b0407d4e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3b08005fd0 tx=0x7f3b08005850 comp rx=0 tx=0).stop 2024-09-21T17:45:40.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 -- 172.21.15.162:0/3088992455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b18103400 msgr2=0x7f3b1819f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:40.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 --2- 172.21.15.162:0/3088992455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b18103400 0x7f3b1819f7e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000eaa0 tx=0x7f3b1000ef60 comp rx=0 tx=0).stop 2024-09-21T17:45:40.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 -- 172.21.15.162:0/3088992455 shutdown_connections 2024-09-21T17:45:40.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 --2- 172.21.15.162:0/3088992455 >> v2:172.21.15.42:6800/92962027 conn(0x7f3b0407b020 0x7f3b0407d4e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:40.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 --2- 172.21.15.162:0/3088992455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b18103400 0x7f3b1819f7e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:40.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 --2- 172.21.15.162:0/3088992455 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b18102a40 0x7f3b1819d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:40.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 --2- 172.21.15.162:0/3088992455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b181018e0 0x7f3b1806b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:40.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 -- 172.21.15.162:0/3088992455 >> 172.21.15.162:0/3088992455 conn(0x7f3b180fd1b0 msgr2=0x7f3b180fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:40.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 -- 172.21.15.162:0/3088992455 shutdown_connections 2024-09-21T17:45:40.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:40.106+0000 7f3b1e297640 1 -- 172.21.15.162:0/3088992455 wait complete. 2024-09-21T17:45:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[29361]: pgmap v185: 132 pgs: 4 creating+peering, 128 active+clean; 580 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s rd, 4.2 KiB/s wr, 122 op/s 2024-09-21T17:45:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/1648442352' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T17:45:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[29361]: Checking pool "datapool" exists for service iscsi.datapool 2024-09-21T17:45:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[29361]: osdmap e61: 8 total, 8 up, 8 in 2024-09-21T17:45:40.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[38309]: pgmap v185: 132 pgs: 4 creating+peering, 128 active+clean; 580 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s rd, 4.2 KiB/s wr, 122 op/s 2024-09-21T17:45:40.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/1648442352' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T17:45:40.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[38309]: Checking pool "datapool" exists for service iscsi.datapool 2024-09-21T17:45:40.167 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:40.167 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:39 smithi042 ceph-mon[38309]: osdmap e61: 8 total, 8 up, 8 in 2024-09-21T17:45:40.850 DEBUG:teuthology.orchestra.run.smithi162:grafana.a> sudo journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@grafana.a.service 2024-09-21T17:45:40.852 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T17:45:40.853 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T17:45:41.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:40 smithi162 ceph-mon[32106]: Deploying daemon prometheus.a on smithi162 2024-09-21T17:45:41.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:40 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:41.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:40 smithi042 ceph-mon[29361]: Deploying daemon prometheus.a on smithi162 2024-09-21T17:45:41.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:40 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:41.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:40 smithi042 ceph-mon[38309]: Deploying daemon prometheus.a on smithi162 2024-09-21T17:45:41.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:40 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:41.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.603+0000 7ff66f866640 1 -- 172.21.15.42:0/3443853173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff668103400 msgr2=0x7ff668109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:41.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.603+0000 7ff66f866640 1 --2- 172.21.15.42:0/3443853173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff668103400 0x7ff668109d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff660009c10 tx=0x7ff66002a6e0 comp rx=0 tx=0).stop 2024-09-21T17:45:41.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.603+0000 7ff66f866640 1 -- 172.21.15.42:0/3443853173 shutdown_connections 2024-09-21T17:45:41.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.603+0000 7ff66f866640 1 --2- 172.21.15.42:0/3443853173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff668103400 0x7ff668109d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:41.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.603+0000 7ff66f866640 1 --2- 172.21.15.42:0/3443853173 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff668102a40 0x7ff668102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:41.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.603+0000 7ff66f866640 1 --2- 172.21.15.42:0/3443853173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6681018e0 0x7ff668101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:41.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.603+0000 7ff66f866640 1 -- 172.21.15.42:0/3443853173 >> 172.21.15.42:0/3443853173 conn(0x7ff6680fd1b0 msgr2=0x7ff6680ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:41.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.603+0000 7ff66f866640 1 -- 172.21.15.42:0/3443853173 shutdown_connections 2024-09-21T17:45:41.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.603+0000 7ff66f866640 1 -- 172.21.15.42:0/3443853173 wait complete. 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66f866640 1 Processor -- start 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66f866640 1 -- start start 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66f866640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6681018e0 0x7ff668198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66f866640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff668102a40 0x7ff668198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66f866640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff668103400 0x7ff668199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66f866640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff66810cbf0 con 0x7ff668102a40 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66f866640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff66810ca70 con 0x7ff668103400 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66f866640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7ff66810cd70 con 0x7ff6681018e0 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66d602640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6681018e0 0x7ff668198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66ce01640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff668102a40 0x7ff668198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66d602640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6681018e0 0x7ff668198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:53670/0 (socket says 172.21.15.42:53670) 2024-09-21T17:45:41.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.604+0000 7ff66d602640 1 -- 172.21.15.42:0/713415386 learned_addr learned my addr 172.21.15.42:0/713415386 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff66de03640 1 --2- 172.21.15.42:0/713415386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff668103400 0x7ff668199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff66d602640 1 -- 172.21.15.42:0/713415386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff668103400 msgr2=0x7ff668199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff66d602640 1 --2- 172.21.15.42:0/713415386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff668103400 0x7ff668199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff66d602640 1 -- 172.21.15.42:0/713415386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff668102a40 msgr2=0x7ff668198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff66d602640 1 --2- 172.21.15.42:0/713415386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff668102a40 0x7ff668198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff66d602640 1 -- 172.21.15.42:0/713415386 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff668199fa0 con 0x7ff6681018e0 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff66ce01640 1 --2- 172.21.15.42:0/713415386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff668102a40 0x7ff668198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff66d602640 1 --2- 172.21.15.42:0/713415386 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6681018e0 0x7ff668198470 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff66400e9f0 tx=0x7ff66400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff65e7fc640 1 -- 172.21.15.42:0/713415386 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66400cd80 con 0x7ff6681018e0 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff65e7fc640 1 -- 172.21.15.42:0/713415386 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff6640108b0 con 0x7ff6681018e0 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff66f866640 1 -- 172.21.15.42:0/713415386 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66819a290 con 0x7ff6681018e0 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff65e7fc640 1 -- 172.21.15.42:0/713415386 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664018870 con 0x7ff6681018e0 2024-09-21T17:45:41.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.605+0000 7ff66f866640 1 -- 172.21.15.42:0/713415386 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6681a0970 con 0x7ff6681018e0 2024-09-21T17:45:41.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.606+0000 7ff66f866640 1 -- 172.21.15.42:0/713415386 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff668101ce0 con 0x7ff6681018e0 2024-09-21T17:45:41.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.607+0000 7ff65e7fc640 1 -- 172.21.15.42:0/713415386 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 17) ==== 103249+0+0 (secure 0 0 0) 0x7ff664010430 con 0x7ff6681018e0 2024-09-21T17:45:41.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.607+0000 7ff65e7fc640 1 --2- 172.21.15.42:0/713415386 >> v2:172.21.15.42:6800/92962027 conn(0x7ff65407b0b0 0x7ff65407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:41.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.608+0000 7ff66ce01640 1 --2- 172.21.15.42:0/713415386 >> v2:172.21.15.42:6800/92962027 conn(0x7ff65407b0b0 0x7ff65407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:41.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.608+0000 7ff65e7fc640 1 -- 172.21.15.42:0/713415386 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(61..61 src has 1..61) ==== 5942+0+0 (secure 0 0 0) 0x7ff66409e580 con 0x7ff6681018e0 2024-09-21T17:45:41.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.608+0000 7ff66ce01640 1 --2- 172.21.15.42:0/713415386 >> v2:172.21.15.42:6800/92962027 conn(0x7ff65407b0b0 0x7ff65407d570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff6580096c0 tx=0x7ff658009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:41.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.612+0000 7ff65e7fc640 1 -- 172.21.15.42:0/713415386 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7ff664069c10 con 0x7ff6681018e0 2024-09-21T17:45:41.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.872+0000 7ff66f866640 1 -- 172.21.15.42:0/713415386 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7ff66802e5c0 con 0x7ff6681018e0 2024-09-21T17:45:41.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.876+0000 7ff65e7fc640 1 -- 172.21.15.42:0/713415386 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7ff66406eac0 con 0x7ff6681018e0 2024-09-21T17:45:41.879 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-21T17:45:41.879 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBFBu9mkdIgNBAAteUdl1Z+0d/KvMA2vKWLgA== 2024-09-21T17:45:41.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 -- 172.21.15.42:0/713415386 >> v2:172.21.15.42:6800/92962027 conn(0x7ff65407b0b0 msgr2=0x7ff65407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:41.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 --2- 172.21.15.42:0/713415386 >> v2:172.21.15.42:6800/92962027 conn(0x7ff65407b0b0 0x7ff65407d570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff6580096c0 tx=0x7ff658009260 comp rx=0 tx=0).stop 2024-09-21T17:45:41.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 -- 172.21.15.42:0/713415386 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6681018e0 msgr2=0x7ff668198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:41.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 --2- 172.21.15.42:0/713415386 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6681018e0 0x7ff668198470 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff66400e9f0 tx=0x7ff66400eeb0 comp rx=0 tx=0).stop 2024-09-21T17:45:41.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 -- 172.21.15.42:0/713415386 shutdown_connections 2024-09-21T17:45:41.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 --2- 172.21.15.42:0/713415386 >> v2:172.21.15.42:6800/92962027 conn(0x7ff65407b0b0 0x7ff65407d570 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:41.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 --2- 172.21.15.42:0/713415386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff668103400 0x7ff668199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:41.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 --2- 172.21.15.42:0/713415386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff668102a40 0x7ff668198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:41.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 --2- 172.21.15.42:0/713415386 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6681018e0 0x7ff668198470 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:41.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 -- 172.21.15.42:0/713415386 >> 172.21.15.42:0/713415386 conn(0x7ff6680fd1b0 msgr2=0x7ff66806b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:41.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 -- 172.21.15.42:0/713415386 shutdown_connections 2024-09-21T17:45:41.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:41.879+0000 7ff66f866640 1 -- 172.21.15.42:0/713415386 wait complete. 2024-09-21T17:45:42.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:41 smithi162 ceph-mon[32106]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:42.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:41 smithi162 ceph-mon[32106]: Saving service grafana spec with placement smithi162=a;count:1 2024-09-21T17:45:42.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:41 smithi162 ceph-mon[32106]: pgmap v187: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 6.0 KiB/s wr, 188 op/s 2024-09-21T17:45:42.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:41 smithi162 ceph-mon[32106]: mgrmap e17: y(active, since 4m), standbys: x 2024-09-21T17:45:42.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:41 smithi042 ceph-mon[38309]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:42.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:41 smithi042 ceph-mon[38309]: Saving service grafana spec with placement smithi162=a;count:1 2024-09-21T17:45:42.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:41 smithi042 ceph-mon[38309]: pgmap v187: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 6.0 KiB/s wr, 188 op/s 2024-09-21T17:45:42.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:41 smithi042 ceph-mon[38309]: mgrmap e17: y(active, since 4m), standbys: x 2024-09-21T17:45:42.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:41 smithi042 ceph-mon[29361]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T17:45:42.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:41 smithi042 ceph-mon[29361]: Saving service grafana spec with placement smithi162=a;count:1 2024-09-21T17:45:42.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:41 smithi042 ceph-mon[29361]: pgmap v187: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 6.0 KiB/s wr, 188 op/s 2024-09-21T17:45:42.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:41 smithi042 ceph-mon[29361]: mgrmap e17: y(active, since 4m), standbys: x 2024-09-21T17:45:42.581 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:45:42.581 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T17:45:42.581 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T17:45:42.620 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T17:45:42.864 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T17:45:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/713415386' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T17:45:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/713415386' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T17:45:42.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/713415386' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:42.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:42.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T17:45:43.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.448+0000 7f44184d5640 1 -- 172.21.15.162:0/392032487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4410103400 msgr2=0x7f4410109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:43.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.448+0000 7f44184d5640 1 --2- 172.21.15.162:0/392032487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4410103400 0x7f4410109d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4408009cd0 tx=0x7f440802a8e0 comp rx=0 tx=0).stop 2024-09-21T17:45:43.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.448+0000 7f44184d5640 1 -- 172.21.15.162:0/392032487 shutdown_connections 2024-09-21T17:45:43.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.448+0000 7f44184d5640 1 --2- 172.21.15.162:0/392032487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4410103400 0x7f4410109d80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:43.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.448+0000 7f44184d5640 1 --2- 172.21.15.162:0/392032487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4410102a40 0x7f4410102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:43.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.448+0000 7f44184d5640 1 --2- 172.21.15.162:0/392032487 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f44101018e0 0x7f4410101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:43.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.449+0000 7f44184d5640 1 -- 172.21.15.162:0/392032487 >> 172.21.15.162:0/392032487 conn(0x7f44100fd1b0 msgr2=0x7f44100ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:43.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.449+0000 7f44184d5640 1 -- 172.21.15.162:0/392032487 shutdown_connections 2024-09-21T17:45:43.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.449+0000 7f44184d5640 1 -- 172.21.15.162:0/392032487 wait complete. 2024-09-21T17:45:43.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.449+0000 7f44184d5640 1 Processor -- start 2024-09-21T17:45:43.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.449+0000 7f44184d5640 1 -- start start 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.449+0000 7f44184d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44101018e0 0x7f4410198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f44184d5640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4410102a40 0x7f4410198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f44184d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4410103400 0x7f4410199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f44184d5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f441010ddf0 con 0x7f4410103400 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f44184d5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f441010dc70 con 0x7f44101018e0 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f44184d5640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f441010df70 con 0x7f4410102a40 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4416271640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44101018e0 0x7f4410198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4416271640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44101018e0 0x7f4410198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58182/0 (socket says 172.21.15.162:58182) 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4416271640 1 -- 172.21.15.162:0/4069373832 learned_addr learned my addr 172.21.15.162:0/4069373832 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4415a70640 1 --2- 172.21.15.162:0/4069373832 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4410102a40 0x7f4410198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4416a72640 1 --2- 172.21.15.162:0/4069373832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4410103400 0x7f4410199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4416271640 1 -- 172.21.15.162:0/4069373832 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4410102a40 msgr2=0x7f4410198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4416271640 1 --2- 172.21.15.162:0/4069373832 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4410102a40 0x7f4410198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4416271640 1 -- 172.21.15.162:0/4069373832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4410103400 msgr2=0x7f4410199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4416271640 1 --2- 172.21.15.162:0/4069373832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4410103400 0x7f4410199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:43.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4416271640 1 -- 172.21.15.162:0/4069373832 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441019a130 con 0x7f44101018e0 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4415a70640 1 --2- 172.21.15.162:0/4069373832 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4410102a40 0x7f4410198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4416a72640 1 --2- 172.21.15.162:0/4069373832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4410103400 0x7f4410199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f4416271640 1 --2- 172.21.15.162:0/4069373832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44101018e0 0x7f4410198600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f440c00b4a0 tx=0x7f440c00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f44077fe640 1 -- 172.21.15.162:0/4069373832 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c014070 con 0x7f44101018e0 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f44077fe640 1 -- 172.21.15.162:0/4069373832 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f440c010a90 con 0x7f44101018e0 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f44077fe640 1 -- 172.21.15.162:0/4069373832 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c017b80 con 0x7f44101018e0 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f44184d5640 1 -- 172.21.15.162:0/4069373832 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441019a420 con 0x7f44101018e0 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.450+0000 7f44184d5640 1 -- 172.21.15.162:0/4069373832 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44101a0b00 con 0x7f44101018e0 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.452+0000 7f44184d5640 1 -- 172.21.15.162:0/4069373832 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4410101d60 con 0x7f44101018e0 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.452+0000 7f44077fe640 1 -- 172.21.15.162:0/4069373832 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 17) ==== 103249+0+0 (secure 0 0 0) 0x7f440c017070 con 0x7f44101018e0 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.453+0000 7f44077fe640 1 --2- 172.21.15.162:0/4069373832 >> v2:172.21.15.42:6800/92962027 conn(0x7f43fc07b0b0 0x7f43fc07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.453+0000 7f44077fe640 1 -- 172.21.15.162:0/4069373832 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5942+0+0 (secure 0 0 0) 0x7f440c09d840 con 0x7f44101018e0 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.453+0000 7f4415a70640 1 --2- 172.21.15.162:0/4069373832 >> v2:172.21.15.42:6800/92962027 conn(0x7f43fc07b0b0 0x7f43fc07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:43.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.453+0000 7f4415a70640 1 --2- 172.21.15.162:0/4069373832 >> v2:172.21.15.42:6800/92962027 conn(0x7f43fc07b0b0 0x7f43fc07d570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4400006fd0 tx=0x7f4400008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:43.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.457+0000 7f44077fe640 1 -- 172.21.15.162:0/4069373832 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f440c064ab0 con 0x7f44101018e0 2024-09-21T17:45:43.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.721+0000 7f44184d5640 1 -- 172.21.15.162:0/4069373832 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f441002e7a0 con 0x7f44101018e0 2024-09-21T17:45:43.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.726+0000 7f44077fe640 1 -- 172.21.15.162:0/4069373832 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f440c068e90 con 0x7f44101018e0 2024-09-21T17:45:43.728 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2024-09-21T17:45:43.729 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBHBu9mV40jKxAA2ZCQ1QT6Cm7YKWd6EsmtsA== 2024-09-21T17:45:43.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 -- 172.21.15.162:0/4069373832 >> v2:172.21.15.42:6800/92962027 conn(0x7f43fc07b0b0 msgr2=0x7f43fc07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:43.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 --2- 172.21.15.162:0/4069373832 >> v2:172.21.15.42:6800/92962027 conn(0x7f43fc07b0b0 0x7f43fc07d570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4400006fd0 tx=0x7f4400008040 comp rx=0 tx=0).stop 2024-09-21T17:45:43.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 -- 172.21.15.162:0/4069373832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44101018e0 msgr2=0x7f4410198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:43.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 --2- 172.21.15.162:0/4069373832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44101018e0 0x7f4410198600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f440c00b4a0 tx=0x7f440c00b960 comp rx=0 tx=0).stop 2024-09-21T17:45:43.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 -- 172.21.15.162:0/4069373832 shutdown_connections 2024-09-21T17:45:43.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 --2- 172.21.15.162:0/4069373832 >> v2:172.21.15.42:6800/92962027 conn(0x7f43fc07b0b0 0x7f43fc07d570 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:43.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 --2- 172.21.15.162:0/4069373832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4410103400 0x7f4410199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:43.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 --2- 172.21.15.162:0/4069373832 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4410102a40 0x7f4410198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:43.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 --2- 172.21.15.162:0/4069373832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44101018e0 0x7f4410198600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:43.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 -- 172.21.15.162:0/4069373832 >> 172.21.15.162:0/4069373832 conn(0x7f44100fd1b0 msgr2=0x7f44100fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:43.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 -- 172.21.15.162:0/4069373832 shutdown_connections 2024-09-21T17:45:43.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T17:45:43.729+0000 7f44184d5640 1 -- 172.21.15.162:0/4069373832 wait complete. 2024-09-21T17:45:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:43 smithi162 ceph-mon[32106]: pgmap v188: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 4.5 KiB/s wr, 142 op/s 2024-09-21T17:45:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:43 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.162:0/4069373832' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T17:45:44.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:43 smithi042 ceph-mon[29361]: pgmap v188: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 4.5 KiB/s wr, 142 op/s 2024-09-21T17:45:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:43 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.162:0/4069373832' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T17:45:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:43 smithi042 ceph-mon[38309]: pgmap v188: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 4.5 KiB/s wr, 142 op/s 2024-09-21T17:45:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:43 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.162:0/4069373832' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T17:45:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T17:45:45.796 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T17:45:45.796 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-21T17:45:45.796 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T17:45:45.833 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T17:45:46.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:45 smithi162 ceph-mon[32106]: pgmap v189: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 3.9 KiB/s wr, 126 op/s 2024-09-21T17:45:46.100 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:46.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:45 smithi042 ceph-mon[29361]: pgmap v189: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 3.9 KiB/s wr, 126 op/s 2024-09-21T17:45:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:45 smithi042 ceph-mon[38309]: pgmap v189: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 3.9 KiB/s wr, 126 op/s 2024-09-21T17:45:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.534+0000 7f88a8f20640 1 -- 172.21.15.42:0/215751268 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88a4107ff0 msgr2=0x7f88a410e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.534+0000 7f88a8f20640 1 --2- 172.21.15.42:0/215751268 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88a4107ff0 0x7f88a410e7f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f889c009ca0 tx=0x7f889c02a8c0 comp rx=0 tx=0).stop 2024-09-21T17:45:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.534+0000 7f88a8f20640 1 -- 172.21.15.42:0/215751268 shutdown_connections 2024-09-21T17:45:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.534+0000 7f88a8f20640 1 --2- 172.21.15.42:0/215751268 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88a4107ff0 0x7f88a410e7f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.534+0000 7f88a8f20640 1 --2- 172.21.15.42:0/215751268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88a4107670 0x7f88a4107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.534+0000 7f88a8f20640 1 --2- 172.21.15.42:0/215751268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a4101c60 0x7f88a4102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.534+0000 7f88a8f20640 1 -- 172.21.15.42:0/215751268 >> 172.21.15.42:0/215751268 conn(0x7f88a40fd6d0 msgr2=0x7f88a40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.534+0000 7f88a8f20640 1 -- 172.21.15.42:0/215751268 shutdown_connections 2024-09-21T17:45:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.534+0000 7f88a8f20640 1 -- 172.21.15.42:0/215751268 wait complete. 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.535+0000 7f88a8f20640 1 Processor -- start 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.535+0000 7f88a8f20640 1 -- start start 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.535+0000 7f88a8f20640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88a4101c60 0x7f88a4197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a8f20640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a4107670 0x7f88a4197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a8f20640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88a4107ff0 0x7f88a4197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a8f20640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88a41113c0 con 0x7f88a4107ff0 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a8f20640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4111240 con 0x7f88a4107670 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a8f20640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f88a4111540 con 0x7f88a4101c60 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a259c640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88a4101c60 0x7f88a4197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88a4107ff0 0x7f88a4197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a259c640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88a4101c60 0x7f88a4197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:53678/0 (socket says 172.21.15.42:53678) 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a259c640 1 -- 172.21.15.42:0/1273673319 learned_addr learned my addr 172.21.15.42:0/1273673319 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f889bfff640 1 --2- 172.21.15.42:0/1273673319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a4107670 0x7f88a4197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a2d9d640 1 -- 172.21.15.42:0/1273673319 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88a4101c60 msgr2=0x7f88a4197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a2d9d640 1 --2- 172.21.15.42:0/1273673319 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88a4101c60 0x7f88a4197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a2d9d640 1 -- 172.21.15.42:0/1273673319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a4107670 msgr2=0x7f88a4197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a2d9d640 1 --2- 172.21.15.42:0/1273673319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a4107670 0x7f88a4197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a2d9d640 1 -- 172.21.15.42:0/1273673319 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a419c8d0 con 0x7f88a4107ff0 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f889bfff640 1 --2- 172.21.15.42:0/1273673319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a4107670 0x7f88a4197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a2d9d640 1 --2- 172.21.15.42:0/1273673319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88a4107ff0 0x7f88a4197fc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f889c033040 tx=0x7f889c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f889b7fe640 1 -- 172.21.15.42:0/1273673319 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c003db0 con 0x7f88a4107ff0 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f889b7fe640 1 -- 172.21.15.42:0/1273673319 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f889c0044c0 con 0x7f88a4107ff0 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f889b7fe640 1 -- 172.21.15.42:0/1273673319 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c030b80 con 0x7f88a4107ff0 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.536+0000 7f88a8f20640 1 -- 172.21.15.42:0/1273673319 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a419cb60 con 0x7f88a4107ff0 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.537+0000 7f88a8f20640 1 -- 172.21.15.42:0/1273673319 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a419d0f0 con 0x7f88a4107ff0 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.538+0000 7f88a8f20640 1 -- 172.21.15.42:0/1273673319 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a4102040 con 0x7f88a4107ff0 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.538+0000 7f889b7fe640 1 -- 172.21.15.42:0/1273673319 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 103249+0+0 (secure 0 0 0) 0x7f889c030d20 con 0x7f88a4107ff0 2024-09-21T17:45:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.539+0000 7f889b7fe640 1 --2- 172.21.15.42:0/1273673319 >> v2:172.21.15.42:6800/92962027 conn(0x7f889007b0b0 0x7f889007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:46.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.539+0000 7f88a259c640 1 --2- 172.21.15.42:0/1273673319 >> v2:172.21.15.42:6800/92962027 conn(0x7f889007b0b0 0x7f889007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:46.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.539+0000 7f889b7fe640 1 -- 172.21.15.42:0/1273673319 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5942+0+0 (secure 0 0 0) 0x7f889c0bf240 con 0x7f88a4107ff0 2024-09-21T17:45:46.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.539+0000 7f88a259c640 1 --2- 172.21.15.42:0/1273673319 >> v2:172.21.15.42:6800/92962027 conn(0x7f889007b0b0 0x7f889007d570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f889400bca0 tx=0x7f889400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:46.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.544+0000 7f889b7fe640 1 -- 172.21.15.42:0/1273673319 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f889c08a9a0 con 0x7f88a4107ff0 2024-09-21T17:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.732+0000 7f88a8f20640 1 -- 172.21.15.42:0/1273673319 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f88a4109840 con 0x7f88a4107ff0 2024-09-21T17:45:46.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.732+0000 7f889b7fe640 1 -- 172.21.15.42:0/1273673319 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v24) ==== 86+0+187 (secure 0 0 0) 0x7f889c08f850 con 0x7f88a4107ff0 2024-09-21T17:45:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:45:46.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.734+0000 7f88a8f20640 1 -- 172.21.15.42:0/1273673319 >> v2:172.21.15.42:6800/92962027 conn(0x7f889007b0b0 msgr2=0x7f889007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:46.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.734+0000 7f88a8f20640 1 --2- 172.21.15.42:0/1273673319 >> v2:172.21.15.42:6800/92962027 conn(0x7f889007b0b0 0x7f889007d570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f889400bca0 tx=0x7f889400b410 comp rx=0 tx=0).stop 2024-09-21T17:45:46.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.734+0000 7f88a8f20640 1 -- 172.21.15.42:0/1273673319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88a4107ff0 msgr2=0x7f88a4197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:46.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.734+0000 7f88a8f20640 1 --2- 172.21.15.42:0/1273673319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88a4107ff0 0x7f88a4197fc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f889c033040 tx=0x7f889c0093d0 comp rx=0 tx=0).stop 2024-09-21T17:45:46.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.734+0000 7f88a8f20640 1 -- 172.21.15.42:0/1273673319 shutdown_connections 2024-09-21T17:45:46.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.734+0000 7f88a8f20640 1 --2- 172.21.15.42:0/1273673319 >> v2:172.21.15.42:6800/92962027 conn(0x7f889007b0b0 0x7f889007d570 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:46.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.734+0000 7f88a8f20640 1 --2- 172.21.15.42:0/1273673319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88a4107ff0 0x7f88a4197fc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.734+0000 7f88a8f20640 1 --2- 172.21.15.42:0/1273673319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a4107670 0x7f88a4197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.734+0000 7f88a8f20640 1 --2- 172.21.15.42:0/1273673319 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88a4101c60 0x7f88a4197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.734+0000 7f88a8f20640 1 -- 172.21.15.42:0/1273673319 >> 172.21.15.42:0/1273673319 conn(0x7f88a40fd6d0 msgr2=0x7f88a40ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.735+0000 7f88a8f20640 1 -- 172.21.15.42:0/1273673319 shutdown_connections 2024-09-21T17:45:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:46.735+0000 7f88a8f20640 1 -- 172.21.15.42:0/1273673319 wait complete. 2024-09-21T17:45:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1273673319' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T17:45:47.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1273673319' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T17:45:47.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1273673319' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T17:45:47.396 INFO:teuthology.orchestra.run.smithi042.stdout:[{"version":24,"timestamp":"2024-09-21T17:45:35.534808+0000","name":"","changes":[{"name":"mgr/mgr/dashboard/RGW_API_SECRET_KEY","new_value":"DqnRjy8cOLQBMoDAvZ58a65IJZAkcQciiAJOFXMZ"}]}] 2024-09-21T17:45:47.397 INFO:tasks.ceph_manager:config epoch is 24 2024-09-21T17:45:47.397 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T17:45:47.397 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T17:45:47.397 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T17:45:47.656 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:47.911 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:47 smithi162 ceph-mon[32106]: pgmap v190: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 2.8 KiB/s wr, 91 op/s 2024-09-21T17:45:48.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:47 smithi042 ceph-mon[29361]: pgmap v190: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 2.8 KiB/s wr, 91 op/s 2024-09-21T17:45:48.039 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:47 smithi042 ceph-mon[38309]: pgmap v190: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 2.8 KiB/s wr, 91 op/s 2024-09-21T17:45:48.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.252+0000 7f7619239640 1 -- 172.21.15.42:0/4086794162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7614101ca0 msgr2=0x7f7614102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:48.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.252+0000 7f7619239640 1 --2- 172.21.15.42:0/4086794162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7614101ca0 0x7f7614102080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7604009900 tx=0x7f760402a410 comp rx=0 tx=0).stop 2024-09-21T17:45:48.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.252+0000 7f7619239640 1 -- 172.21.15.42:0/4086794162 shutdown_connections 2024-09-21T17:45:48.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.252+0000 7f7619239640 1 --2- 172.21.15.42:0/4086794162 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7614108030 0x7f761410e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:48.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.252+0000 7f7619239640 1 --2- 172.21.15.42:0/4086794162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76141076b0 0x7f7614107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:48.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.252+0000 7f7619239640 1 --2- 172.21.15.42:0/4086794162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7614101ca0 0x7f7614102080 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:48.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.252+0000 7f7619239640 1 -- 172.21.15.42:0/4086794162 >> 172.21.15.42:0/4086794162 conn(0x7f76140fd710 msgr2=0x7f76140ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:48.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.252+0000 7f7619239640 1 -- 172.21.15.42:0/4086794162 shutdown_connections 2024-09-21T17:45:48.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.252+0000 7f7619239640 1 -- 172.21.15.42:0/4086794162 wait complete. 2024-09-21T17:45:48.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f7619239640 1 Processor -- start 2024-09-21T17:45:48.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f7619239640 1 -- start start 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f7619239640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7614101ca0 0x7f7614197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f7619239640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f76141076b0 0x7f7614197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f7619239640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7614108030 0x7f761419d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f7619239640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7614111410 con 0x7f7614108030 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f7619239640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7614111290 con 0x7f7614101ca0 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f7619239640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f7614111590 con 0x7f76141076b0 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f761259c640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f76141076b0 0x7f7614197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f761359e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7614108030 0x7f761419d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f761259c640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f76141076b0 0x7f7614197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:53694/0 (socket says 172.21.15.42:53694) 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f761259c640 1 -- 172.21.15.42:0/978236687 learned_addr learned my addr 172.21.15.42:0/978236687 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.253+0000 7f7612d9d640 1 --2- 172.21.15.42:0/978236687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7614101ca0 0x7f7614197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f761259c640 1 -- 172.21.15.42:0/978236687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7614101ca0 msgr2=0x7f7614197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f761259c640 1 --2- 172.21.15.42:0/978236687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7614101ca0 0x7f7614197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:48.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f761259c640 1 -- 172.21.15.42:0/978236687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7614108030 msgr2=0x7f761419d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f761259c640 1 --2- 172.21.15.42:0/978236687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7614108030 0x7f761419d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f761259c640 1 -- 172.21.15.42:0/978236687 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761419d8f0 con 0x7f76141076b0 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f7612d9d640 1 --2- 172.21.15.42:0/978236687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7614101ca0 0x7f7614197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f761359e640 1 --2- 172.21.15.42:0/978236687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7614108030 0x7f761419d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f761259c640 1 --2- 172.21.15.42:0/978236687 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f76141076b0 0x7f7614197d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f760800c890 tx=0x7f760800cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f75fbfff640 1 -- 172.21.15.42:0/978236687 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608004220 con 0x7f76141076b0 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f75fbfff640 1 -- 172.21.15.42:0/978236687 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7608007e30 con 0x7f76141076b0 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f7619239640 1 -- 172.21.15.42:0/978236687 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761419dbe0 con 0x7f76141076b0 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f75fbfff640 1 -- 172.21.15.42:0/978236687 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76080047a0 con 0x7f76141076b0 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.254+0000 7f7619239640 1 -- 172.21.15.42:0/978236687 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f76141a42a0 con 0x7f76141076b0 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.255+0000 7f7619239640 1 -- 172.21.15.42:0/978236687 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7614102080 con 0x7f76141076b0 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.256+0000 7f75fbfff640 1 -- 172.21.15.42:0/978236687 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 17) ==== 103249+0+0 (secure 0 0 0) 0x7f7608004980 con 0x7f76141076b0 2024-09-21T17:45:48.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.256+0000 7f75fbfff640 1 --2- 172.21.15.42:0/978236687 >> v2:172.21.15.42:6800/92962027 conn(0x7f75fc07b0b0 0x7f75fc07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:48.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.256+0000 7f75fbfff640 1 -- 172.21.15.42:0/978236687 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(61..61 src has 1..61) ==== 5942+0+0 (secure 0 0 0) 0x7f760809df60 con 0x7f76141076b0 2024-09-21T17:45:48.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.256+0000 7f7612d9d640 1 --2- 172.21.15.42:0/978236687 >> v2:172.21.15.42:6800/92962027 conn(0x7f75fc07b0b0 0x7f75fc07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:48.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.257+0000 7f7612d9d640 1 --2- 172.21.15.42:0/978236687 >> v2:172.21.15.42:6800/92962027 conn(0x7f75fc07b0b0 0x7f75fc07d570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7604005ab0 tx=0x7f7604000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:48.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.261+0000 7f75fbfff640 1 -- 172.21.15.42:0/978236687 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f7608014030 con 0x7f76141076b0 2024-09-21T17:45:48.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.505+0000 7f7619239640 1 -- 172.21.15.42:0/978236687 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f7614109e10 con 0x7f76141076b0 2024-09-21T17:45:48.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.507+0000 7f75fbfff640 1 -- 172.21.15.42:0/978236687 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+198098 (secure 0 0 0) 0x7f7608069530 con 0x7f76141076b0 2024-09-21T17:45:48.513 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:45:48.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 -- 172.21.15.42:0/978236687 >> v2:172.21.15.42:6800/92962027 conn(0x7f75fc07b0b0 msgr2=0x7f75fc07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:48.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 --2- 172.21.15.42:0/978236687 >> v2:172.21.15.42:6800/92962027 conn(0x7f75fc07b0b0 0x7f75fc07d570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7604005ab0 tx=0x7f7604000bc0 comp rx=0 tx=0).stop 2024-09-21T17:45:48.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 -- 172.21.15.42:0/978236687 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f76141076b0 msgr2=0x7f7614197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:48.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 --2- 172.21.15.42:0/978236687 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f76141076b0 0x7f7614197d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f760800c890 tx=0x7f760800cd50 comp rx=0 tx=0).stop 2024-09-21T17:45:48.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 -- 172.21.15.42:0/978236687 shutdown_connections 2024-09-21T17:45:48.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 --2- 172.21.15.42:0/978236687 >> v2:172.21.15.42:6800/92962027 conn(0x7f75fc07b0b0 0x7f75fc07d570 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:48.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 --2- 172.21.15.42:0/978236687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7614108030 0x7f761419d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:48.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 --2- 172.21.15.42:0/978236687 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f76141076b0 0x7f7614197d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:48.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 --2- 172.21.15.42:0/978236687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7614101ca0 0x7f7614197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:48.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 -- 172.21.15.42:0/978236687 >> 172.21.15.42:0/978236687 conn(0x7f76140fd710 msgr2=0x7f76140ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:48.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 -- 172.21.15.42:0/978236687 shutdown_connections 2024-09-21T17:45:48.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:48.510+0000 7f7619239640 1 -- 172.21.15.42:0/978236687 wait complete. 2024-09-21T17:45:48.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:48 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:45:49.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/978236687' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T17:45:49.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:48 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:49.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/978236687' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T17:45:49.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:48 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:49.200 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/978236687' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T17:45:49.200 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:48 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:49.229 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":92962027}]},"active_addr":"172.21.15.42:6800/92962027","active_change":"2024-09-21T17:41:08.165344+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24109,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.42:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"cephadm","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":1184760070}]},{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":3292208443}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":3236133684}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":2175782461}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":4034990612}]}]} 2024-09-21T17:45:49.233 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T17:45:49.233 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T17:45:49.233 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T17:45:49.489 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:50.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.032+0000 7fc98787b640 1 -- 172.21.15.42:0/1935981753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc980101840 msgr2=0x7fc980101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:50.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.032+0000 7fc98787b640 1 --2- 172.21.15.42:0/1935981753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc980101840 0x7fc980101c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009900 tx=0x7fc97c02a410 comp rx=0 tx=0).stop 2024-09-21T17:45:50.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.032+0000 7fc98787b640 1 -- 172.21.15.42:0/1935981753 shutdown_connections 2024-09-21T17:45:50.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.032+0000 7fc98787b640 1 --2- 172.21.15.42:0/1935981753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc98010f3f0 0x7fc9801117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:50.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.032+0000 7fc98787b640 1 --2- 172.21.15.42:0/1935981753 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc980102160 0x7fc98010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.032+0000 7fc98787b640 1 --2- 172.21.15.42:0/1935981753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc980101840 0x7fc980101c20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.032+0000 7fc98787b640 1 -- 172.21.15.42:0/1935981753 >> 172.21.15.42:0/1935981753 conn(0x7fc9800fd710 msgr2=0x7fc9800ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.032+0000 7fc98787b640 1 -- 172.21.15.42:0/1935981753 shutdown_connections 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.032+0000 7fc98787b640 1 -- 172.21.15.42:0/1935981753 wait complete. 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.033+0000 7fc98787b640 1 Processor -- start 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.033+0000 7fc98787b640 1 -- start start 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.033+0000 7fc98787b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc980101840 0x7fc98019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.033+0000 7fc98787b640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc980102160 0x7fc98019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.033+0000 7fc98787b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc98010f3f0 0x7fc9801a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.033+0000 7fc98787b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc980114680 con 0x7fc98010f3f0 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.033+0000 7fc98787b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc980114500 con 0x7fc980101840 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.033+0000 7fc98787b640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fc980114800 con 0x7fc980102160 2024-09-21T17:45:50.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc984e16640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc980102160 0x7fc98019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc985617640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc980101840 0x7fc98019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc985617640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc980101840 0x7fc98019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.42:38546/0 (socket says 172.21.15.42:38546) 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc984e16640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc980102160 0x7fc98019b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:53710/0 (socket says 172.21.15.42:53710) 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc985617640 1 -- 172.21.15.42:0/1515346716 learned_addr learned my addr 172.21.15.42:0/1515346716 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc985e18640 1 --2- 172.21.15.42:0/1515346716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc98010f3f0 0x7fc9801a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc985e18640 1 -- 172.21.15.42:0/1515346716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc980102160 msgr2=0x7fc98019b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc985e18640 1 --2- 172.21.15.42:0/1515346716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc980102160 0x7fc98019b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc985e18640 1 -- 172.21.15.42:0/1515346716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc980101840 msgr2=0x7fc98019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc985e18640 1 --2- 172.21.15.42:0/1515346716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc980101840 0x7fc98019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc985e18640 1 -- 172.21.15.42:0/1515346716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9801a0ce0 con 0x7fc98010f3f0 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc984e16640 1 --2- 172.21.15.42:0/1515346716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc980102160 0x7fc98019b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:50.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc985e18640 1 --2- 172.21.15.42:0/1515346716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc98010f3f0 0x7fc9801a0510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc978005fd0 tx=0x7fc97800dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:50.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc9767fc640 1 -- 172.21.15.42:0/1515346716 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978017020 con 0x7fc98010f3f0 2024-09-21T17:45:50.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc9767fc640 1 -- 172.21.15.42:0/1515346716 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fc97800bd40 con 0x7fc98010f3f0 2024-09-21T17:45:50.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc98787b640 1 -- 172.21.15.42:0/1515346716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9801a0fd0 con 0x7fc98010f3f0 2024-09-21T17:45:50.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.034+0000 7fc9767fc640 1 -- 172.21.15.42:0/1515346716 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97800f760 con 0x7fc98010f3f0 2024-09-21T17:45:50.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.035+0000 7fc98787b640 1 -- 172.21.15.42:0/1515346716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9801a7690 con 0x7fc98010f3f0 2024-09-21T17:45:50.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.036+0000 7fc98787b640 1 -- 172.21.15.42:0/1515346716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc980101c20 con 0x7fc98010f3f0 2024-09-21T17:45:50.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.036+0000 7fc9767fc640 1 -- 172.21.15.42:0/1515346716 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 103249+0+0 (secure 0 0 0) 0x7fc97801a020 con 0x7fc98010f3f0 2024-09-21T17:45:50.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.037+0000 7fc9767fc640 1 --2- 172.21.15.42:0/1515346716 >> v2:172.21.15.42:6800/92962027 conn(0x7fc96c07b0b0 0x7fc96c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:50.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.037+0000 7fc985617640 1 --2- 172.21.15.42:0/1515346716 >> v2:172.21.15.42:6800/92962027 conn(0x7fc96c07b0b0 0x7fc96c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:50.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.037+0000 7fc9767fc640 1 -- 172.21.15.42:0/1515346716 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5942+0+0 (secure 0 0 0) 0x7fc97809e190 con 0x7fc98010f3f0 2024-09-21T17:45:50.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.037+0000 7fc985617640 1 --2- 172.21.15.42:0/1515346716 >> v2:172.21.15.42:6800/92962027 conn(0x7fc96c07b0b0 0x7fc96c07d570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc97c031440 tx=0x7fc97c0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:50.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.041+0000 7fc9767fc640 1 -- 172.21.15.42:0/1515346716 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fc978021020 con 0x7fc98010f3f0 2024-09-21T17:45:50.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:49 smithi042 ceph-mon[29361]: pgmap v191: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 1.4 KiB/s wr, 41 op/s 2024-09-21T17:45:50.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:49 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:45:50.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:49 smithi042 ceph-mon[38309]: pgmap v191: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 1.4 KiB/s wr, 41 op/s 2024-09-21T17:45:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:49 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:45:50.200 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:49 smithi162 ceph-mon[32106]: pgmap v191: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 1.4 KiB/s wr, 41 op/s 2024-09-21T17:45:50.200 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:49 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:45:50.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.231+0000 7fc98787b640 1 -- 172.21.15.42:0/1515346716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc98010a580 con 0x7fc98010f3f0 2024-09-21T17:45:50.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.233+0000 7fc9767fc640 1 -- 172.21.15.42:0/1515346716 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+20699 (secure 0 0 0) 0x7fc9780697e0 con 0x7fc98010f3f0 2024-09-21T17:45:50.236 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:45:50.236 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":61,"fsid":"6e3cf65a-7840-11ef-baf6-efdc52797490","created":"2024-09-21T17:40:19.412453+0000","modified":"2024-09-21T17:45:39.061353+0000","last_up_change":"2024-09-21T17:45:18.308925+0000","last_in_change":"2024-09-21T17:44:58.503216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T17:43:16.619277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2024-09-21T17:45:25.802663+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2024-09-21T17:45:26.675380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-09-21T17:45:28.341458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-09-21T17:45:30.289878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-21T17:45:32.357166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9400dd6c-acd8-4ab6-a2a0-7ae899d85554","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6801","nonce":443738680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":443738680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":443738680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6803","nonce":443738680}]},"public_addr":"172.21.15.42:6801/443738680","cluster_addr":"172.21.15.42:6802/443738680","heartbeat_back_addr":"172.21.15.42:6804/443738680","heartbeat_front_addr":"172.21.15.42:6803/443738680","state":["exists","up"]},{"osd":1,"uuid":"087fa35f-aafd-4879-8b78-d47dc2a7f5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6805","nonce":555179714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":555179714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":555179714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6807","nonce":555179714}]},"public_addr":"172.21.15.42:6805/555179714","cluster_addr":"172.21.15.42:6806/555179714","heartbeat_back_addr":"172.21.15.42:6808/555179714","heartbeat_front_addr":"172.21.15.42:6807/555179714","state":["exists","up"]},{"osd":2,"uuid":"c7346df3-244f-4c4e-a0c0-6058b91388a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":429996625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":429996625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":429996625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6811","nonce":429996625}]},"public_addr":"172.21.15.42:6809/429996625","cluster_addr":"172.21.15.42:6810/429996625","heartbeat_back_addr":"172.21.15.42:6812/429996625","heartbeat_front_addr":"172.21.15.42:6811/429996625","state":["exists","up"]},{"osd":3,"uuid":"2099cf75-c0ab-4de5-bc44-dace0d4ee6b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":2988176462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2988176462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2988176462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":2988176462}]},"public_addr":"172.21.15.42:6813/2988176462","cluster_addr":"172.21.15.42:6814/2988176462","heartbeat_back_addr":"172.21.15.42:6816/2988176462","heartbeat_front_addr":"172.21.15.42:6815/2988176462","state":["exists","up"]},{"osd":4,"uuid":"df62f00f-2873-4de2-9e6f-d558f53a0ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4286045529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6801","nonce":4286045529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":4286045529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4286045529}]},"public_addr":"172.21.15.162:6800/4286045529","cluster_addr":"172.21.15.162:6801/4286045529","heartbeat_back_addr":"172.21.15.162:6803/4286045529","heartbeat_front_addr":"172.21.15.162:6802/4286045529","state":["exists","up"]},{"osd":5,"uuid":"103163e6-b14d-4ee6-9d77-d4b4dff5307d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":338151964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6805","nonce":338151964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":338151964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":338151964}]},"public_addr":"172.21.15.162:6804/338151964","cluster_addr":"172.21.15.162:6805/338151964","heartbeat_back_addr":"172.21.15.162:6807/338151964","heartbeat_front_addr":"172.21.15.162:6806/338151964","state":["exists","up"]},{"osd":6,"uuid":"21e0bbf2-8a36-4546-865c-694ce6a59196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1056184078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":1056184078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6811","nonce":1056184078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1056184078}]},"public_addr":"172.21.15.162:6808/1056184078","cluster_addr":"172.21.15.162:6809/1056184078","heartbeat_back_addr":"172.21.15.162:6811/1056184078","heartbeat_front_addr":"172.21.15.162:6810/1056184078","state":["exists","up"]},{"osd":7,"uuid":"bd25c4ad-3134-4199-aa32-18895d561ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1372332480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":1372332480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6815","nonce":1372332480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1372332480}]},"public_addr":"172.21.15.162:6812/1372332480","cluster_addr":"172.21.15.162:6813/1372332480","heartbeat_back_addr":"172.21.15.162:6815/1372332480","heartbeat_front_addr":"172.21.15.162:6814/1372332480","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:42:24.270262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:42:48.477554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:43:14.571386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:43:38.936951+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:44:01.676387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:44:27.149819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:44:52.398018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:45:17.234160+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6800/475923179":"2024-09-22T17:41:08.165193+0000","172.21.15.42:0/1455617248":"2024-09-22T17:41:08.165193+0000","172.21.15.42:0/308194918":"2024-09-22T17:41:08.165193+0000","172.21.15.42:0/1268303256":"2024-09-22T17:41:08.165193+0000","172.21.15.42:6800/604611129":"2024-09-22T17:40:41.532199+0000","172.21.15.42:0/1858133559":"2024-09-22T17:40:41.532199+0000","172.21.15.42:0/3833944364":"2024-09-22T17:40:41.532199+0000","172.21.15.42:0/4184585510":"2024-09-22T17:40:41.532199+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T17:45:50.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.235+0000 7fc98787b640 1 -- 172.21.15.42:0/1515346716 >> v2:172.21.15.42:6800/92962027 conn(0x7fc96c07b0b0 msgr2=0x7fc96c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:50.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.235+0000 7fc98787b640 1 --2- 172.21.15.42:0/1515346716 >> v2:172.21.15.42:6800/92962027 conn(0x7fc96c07b0b0 0x7fc96c07d570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc97c031440 tx=0x7fc97c0058d0 comp rx=0 tx=0).stop 2024-09-21T17:45:50.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.235+0000 7fc98787b640 1 -- 172.21.15.42:0/1515346716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc98010f3f0 msgr2=0x7fc9801a0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:50.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.235+0000 7fc98787b640 1 --2- 172.21.15.42:0/1515346716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc98010f3f0 0x7fc9801a0510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc978005fd0 tx=0x7fc97800dea0 comp rx=0 tx=0).stop 2024-09-21T17:45:50.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.236+0000 7fc98787b640 1 -- 172.21.15.42:0/1515346716 shutdown_connections 2024-09-21T17:45:50.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.236+0000 7fc98787b640 1 --2- 172.21.15.42:0/1515346716 >> v2:172.21.15.42:6800/92962027 conn(0x7fc96c07b0b0 0x7fc96c07d570 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:50.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.236+0000 7fc98787b640 1 --2- 172.21.15.42:0/1515346716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc98010f3f0 0x7fc9801a0510 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:50.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.236+0000 7fc98787b640 1 --2- 172.21.15.42:0/1515346716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc980102160 0x7fc98019b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:50.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.236+0000 7fc98787b640 1 --2- 172.21.15.42:0/1515346716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc980101840 0x7fc98019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:50.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.236+0000 7fc98787b640 1 -- 172.21.15.42:0/1515346716 >> 172.21.15.42:0/1515346716 conn(0x7fc9800fd710 msgr2=0x7fc9800ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:50.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.236+0000 7fc98787b640 1 -- 172.21.15.42:0/1515346716 shutdown_connections 2024-09-21T17:45:50.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:50.236+0000 7fc98787b640 1 -- 172.21.15.42:0/1515346716 wait complete. 2024-09-21T17:45:50.575 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:45:50 smithi162 systemd[1]: Started Ceph prometheus.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:45:50.955 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T17:45:50.956 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T17:45:51.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1515346716' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T17:45:51.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:50 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:51.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:50 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:51.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:50 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:51.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:50 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-21T17:45:51.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1515346716' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T17:45:51.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:50 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:51.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:50 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:51.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:50 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:51.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:50 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-21T17:45:51.212 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1515346716' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T17:45:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:50 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:50 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:50 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' 2024-09-21T17:45:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:50 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-21T17:45:51.644 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:51 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ignoring --setuser ceph since I am not root 2024-09-21T17:45:51.645 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:51 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ignoring --setgroup ceph since I am not root 2024-09-21T17:45:51.715 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:45:51 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x[33602]: ignoring --setuser ceph since I am not root 2024-09-21T17:45:51.716 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:45:51 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x[33602]: ignoring --setgroup ceph since I am not root 2024-09-21T17:45:51.716 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:45:51 smithi162 ceph-mgr[33606]: -- 172.21.15.162:0/1153262708 <== mon.2 v2:172.21.15.42:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d4edd6d0e0 con 0x55d4edd4a800 2024-09-21T17:45:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.726+0000 7f1ab9db8640 1 -- 172.21.15.42:0/1457714509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ab4103c70 msgr2=0x7f1ab4104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.726+0000 7f1ab9db8640 1 --2- 172.21.15.42:0/1457714509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ab4103c70 0x7f1ab4104050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009860 tx=0x7f1aa402a340 comp rx=0 tx=0).stop 2024-09-21T17:45:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.726+0000 7f1ab9db8640 1 -- 172.21.15.42:0/1457714509 shutdown_connections 2024-09-21T17:45:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.726+0000 7f1ab9db8640 1 --2- 172.21.15.42:0/1457714509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ab410d0d0 0x7f1ab410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.726+0000 7f1ab9db8640 1 --2- 172.21.15.42:0/1457714509 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1ab4104590 0x7f1ab410ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.726+0000 7f1ab9db8640 1 --2- 172.21.15.42:0/1457714509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ab4103c70 0x7f1ab4104050 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.726+0000 7f1ab9db8640 1 -- 172.21.15.42:0/1457714509 >> 172.21.15.42:0/1457714509 conn(0x7f1ab40fd6d0 msgr2=0x7f1ab40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.726+0000 7f1ab9db8640 1 -- 172.21.15.42:0/1457714509 shutdown_connections 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.726+0000 7f1ab9db8640 1 -- 172.21.15.42:0/1457714509 wait complete. 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.727+0000 7f1ab9db8640 1 Processor -- start 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.727+0000 7f1ab9db8640 1 -- start start 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab9db8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ab4103c70 0x7f1ab41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab9db8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ab4104590 0x7f1ab4198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab9db8640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1ab410d0d0 0x7f1ab419e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab9db8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4112450 con 0x7f1ab4104590 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab9db8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab41122d0 con 0x7f1ab4103c70 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab9db8640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab41125d0 con 0x7f1ab410d0d0 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ab4104590 0x7f1ab4198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ab4103c70 0x7f1ab41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ab4104590 0x7f1ab4198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46746/0 (socket says 172.21.15.42:46746) 2024-09-21T17:45:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab2ffd640 1 -- 172.21.15.42:0/938075325 learned_addr learned my addr 172.21.15.42:0/938075325 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab3fff640 1 --2- 172.21.15.42:0/938075325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1ab410d0d0 0x7f1ab419e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab2ffd640 1 -- 172.21.15.42:0/938075325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1ab410d0d0 msgr2=0x7f1ab419e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab2ffd640 1 --2- 172.21.15.42:0/938075325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1ab410d0d0 0x7f1ab419e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab2ffd640 1 -- 172.21.15.42:0/938075325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ab4103c70 msgr2=0x7f1ab41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab2ffd640 1 --2- 172.21.15.42:0/938075325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ab4103c70 0x7f1ab41989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab2ffd640 1 -- 172.21.15.42:0/938075325 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab419ea60 con 0x7f1ab4104590 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab3fff640 1 --2- 172.21.15.42:0/938075325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1ab410d0d0 0x7f1ab419e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab2ffd640 1 --2- 172.21.15.42:0/938075325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ab4104590 0x7f1ab4198ef0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800e7c0 tx=0x7f1aa800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.728+0000 7f1ab0ff9640 1 -- 172.21.15.42:0/938075325 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa800ccc0 con 0x7f1ab4104590 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.729+0000 7f1ab0ff9640 1 -- 172.21.15.42:0/938075325 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f1aa80044b0 con 0x7f1ab4104590 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.729+0000 7f1ab0ff9640 1 -- 172.21.15.42:0/938075325 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8003e20 con 0x7f1ab4104590 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.729+0000 7f1ab9db8640 1 -- 172.21.15.42:0/938075325 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab419ed50 con 0x7f1ab4104590 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.729+0000 7f1ab9db8640 1 -- 172.21.15.42:0/938075325 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab4101800 con 0x7f1ab4104590 2024-09-21T17:45:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.730+0000 7f1ab9db8640 1 -- 172.21.15.42:0/938075325 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab4104050 con 0x7f1ab4104590 2024-09-21T17:45:51.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.731+0000 7f1ab0ff9640 1 -- 172.21.15.42:0/938075325 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 103263+0+0 (secure 0 0 0) 0x7f1aa80035f0 con 0x7f1ab4104590 2024-09-21T17:45:51.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.731+0000 7f1ab0ff9640 1 --2- 172.21.15.42:0/938075325 >> v2:172.21.15.42:6800/92962027 conn(0x7f1a9c07b100 0x7f1a9c07d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:51.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.731+0000 7f1ab37fe640 1 -- 172.21.15.42:0/938075325 >> v2:172.21.15.42:6800/92962027 conn(0x7f1a9c07b100 msgr2=0x7f1a9c07d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/92962027 2024-09-21T17:45:51.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.731+0000 7f1ab0ff9640 1 -- 172.21.15.42:0/938075325 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5942+0+0 (secure 0 0 0) 0x7f1aa809e410 con 0x7f1ab4104590 2024-09-21T17:45:51.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.731+0000 7f1ab37fe640 1 --2- 172.21.15.42:0/938075325 >> v2:172.21.15.42:6800/92962027 conn(0x7f1a9c07b100 0x7f1a9c07d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:45:51.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.736+0000 7f1ab0ff9640 1 -- 172.21.15.42:0/938075325 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f1aa8069b20 con 0x7f1ab4104590 2024-09-21T17:45:51.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.927+0000 7f1ab9db8640 1 -- 172.21.15.42:0/938075325 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ab4107850 con 0x7f1ab4104590 2024-09-21T17:45:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.929+0000 7f1ab0ff9640 1 -- 172.21.15.42:0/938075325 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+20699 (secure 0 0 0) 0x7f1aa806e9d0 con 0x7f1ab4104590 2024-09-21T17:45:51.931 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:45:51.932 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":61,"fsid":"6e3cf65a-7840-11ef-baf6-efdc52797490","created":"2024-09-21T17:40:19.412453+0000","modified":"2024-09-21T17:45:39.061353+0000","last_up_change":"2024-09-21T17:45:18.308925+0000","last_in_change":"2024-09-21T17:44:58.503216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T17:43:16.619277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2024-09-21T17:45:25.802663+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2024-09-21T17:45:26.675380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-09-21T17:45:28.341458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-09-21T17:45:30.289878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-21T17:45:32.357166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9400dd6c-acd8-4ab6-a2a0-7ae899d85554","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6801","nonce":443738680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":443738680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":443738680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6803","nonce":443738680}]},"public_addr":"172.21.15.42:6801/443738680","cluster_addr":"172.21.15.42:6802/443738680","heartbeat_back_addr":"172.21.15.42:6804/443738680","heartbeat_front_addr":"172.21.15.42:6803/443738680","state":["exists","up"]},{"osd":1,"uuid":"087fa35f-aafd-4879-8b78-d47dc2a7f5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6805","nonce":555179714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":555179714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":555179714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6807","nonce":555179714}]},"public_addr":"172.21.15.42:6805/555179714","cluster_addr":"172.21.15.42:6806/555179714","heartbeat_back_addr":"172.21.15.42:6808/555179714","heartbeat_front_addr":"172.21.15.42:6807/555179714","state":["exists","up"]},{"osd":2,"uuid":"c7346df3-244f-4c4e-a0c0-6058b91388a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":429996625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":429996625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":429996625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6811","nonce":429996625}]},"public_addr":"172.21.15.42:6809/429996625","cluster_addr":"172.21.15.42:6810/429996625","heartbeat_back_addr":"172.21.15.42:6812/429996625","heartbeat_front_addr":"172.21.15.42:6811/429996625","state":["exists","up"]},{"osd":3,"uuid":"2099cf75-c0ab-4de5-bc44-dace0d4ee6b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":2988176462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2988176462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2988176462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":2988176462}]},"public_addr":"172.21.15.42:6813/2988176462","cluster_addr":"172.21.15.42:6814/2988176462","heartbeat_back_addr":"172.21.15.42:6816/2988176462","heartbeat_front_addr":"172.21.15.42:6815/2988176462","state":["exists","up"]},{"osd":4,"uuid":"df62f00f-2873-4de2-9e6f-d558f53a0ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4286045529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6801","nonce":4286045529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":4286045529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4286045529}]},"public_addr":"172.21.15.162:6800/4286045529","cluster_addr":"172.21.15.162:6801/4286045529","heartbeat_back_addr":"172.21.15.162:6803/4286045529","heartbeat_front_addr":"172.21.15.162:6802/4286045529","state":["exists","up"]},{"osd":5,"uuid":"103163e6-b14d-4ee6-9d77-d4b4dff5307d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":338151964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6805","nonce":338151964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":338151964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":338151964}]},"public_addr":"172.21.15.162:6804/338151964","cluster_addr":"172.21.15.162:6805/338151964","heartbeat_back_addr":"172.21.15.162:6807/338151964","heartbeat_front_addr":"172.21.15.162:6806/338151964","state":["exists","up"]},{"osd":6,"uuid":"21e0bbf2-8a36-4546-865c-694ce6a59196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1056184078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":1056184078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6811","nonce":1056184078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1056184078}]},"public_addr":"172.21.15.162:6808/1056184078","cluster_addr":"172.21.15.162:6809/1056184078","heartbeat_back_addr":"172.21.15.162:6811/1056184078","heartbeat_front_addr":"172.21.15.162:6810/1056184078","state":["exists","up"]},{"osd":7,"uuid":"bd25c4ad-3134-4199-aa32-18895d561ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1372332480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":1372332480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6815","nonce":1372332480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1372332480}]},"public_addr":"172.21.15.162:6812/1372332480","cluster_addr":"172.21.15.162:6813/1372332480","heartbeat_back_addr":"172.21.15.162:6815/1372332480","heartbeat_front_addr":"172.21.15.162:6814/1372332480","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:42:24.270262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:42:48.477554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:43:14.571386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:43:38.936951+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:44:01.676387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:44:27.149819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:44:52.398018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T17:45:17.234160+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6800/475923179":"2024-09-22T17:41:08.165193+0000","172.21.15.42:0/1455617248":"2024-09-22T17:41:08.165193+0000","172.21.15.42:0/308194918":"2024-09-22T17:41:08.165193+0000","172.21.15.42:0/1268303256":"2024-09-22T17:41:08.165193+0000","172.21.15.42:6800/604611129":"2024-09-22T17:40:41.532199+0000","172.21.15.42:0/1858133559":"2024-09-22T17:40:41.532199+0000","172.21.15.42:0/3833944364":"2024-09-22T17:40:41.532199+0000","172.21.15.42:0/4184585510":"2024-09-22T17:40:41.532199+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T17:45:51.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 -- 172.21.15.42:0/938075325 >> v2:172.21.15.42:6800/92962027 conn(0x7f1a9c07b100 msgr2=0x7f1a9c07d5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T17:45:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 --2- 172.21.15.42:0/938075325 >> v2:172.21.15.42:6800/92962027 conn(0x7f1a9c07b100 0x7f1a9c07d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 -- 172.21.15.42:0/938075325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ab4104590 msgr2=0x7f1ab4198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 --2- 172.21.15.42:0/938075325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ab4104590 0x7f1ab4198ef0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800e7c0 tx=0x7f1aa800ec80 comp rx=0 tx=0).stop 2024-09-21T17:45:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 -- 172.21.15.42:0/938075325 shutdown_connections 2024-09-21T17:45:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 --2- 172.21.15.42:0/938075325 >> v2:172.21.15.42:6800/92962027 conn(0x7f1a9c07b100 0x7f1a9c07d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 --2- 172.21.15.42:0/938075325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1ab410d0d0 0x7f1ab419e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 --2- 172.21.15.42:0/938075325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ab4104590 0x7f1ab4198ef0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 --2- 172.21.15.42:0/938075325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ab4103c70 0x7f1ab41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 -- 172.21.15.42:0/938075325 >> 172.21.15.42:0/938075325 conn(0x7f1ab40fd6d0 msgr2=0x7f1ab4104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 -- 172.21.15.42:0/938075325 shutdown_connections 2024-09-21T17:45:51.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:51.931+0000 7f1ab9db8640 1 -- 172.21.15.42:0/938075325 wait complete. 2024-09-21T17:45:52.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:51 smithi162 ceph-mon[32106]: pgmap v192: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 9.4 KiB/s rd, 917 B/s wr, 21 op/s 2024-09-21T17:45:52.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:51 smithi162 ceph-mon[32106]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T17:45:52.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:51 smithi162 ceph-mon[32106]: mgrmap e18: y(active, since 4m), standbys: x 2024-09-21T17:45:52.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:51 smithi042 ceph-mon[29361]: pgmap v192: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 9.4 KiB/s rd, 917 B/s wr, 21 op/s 2024-09-21T17:45:52.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:51 smithi042 ceph-mon[29361]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T17:45:52.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:51 smithi042 ceph-mon[29361]: mgrmap e18: y(active, since 4m), standbys: x 2024-09-21T17:45:52.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:51 smithi042 ceph-mon[38309]: pgmap v192: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 9.4 KiB/s rd, 917 B/s wr, 21 op/s 2024-09-21T17:45:52.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:51 smithi042 ceph-mon[38309]: from='mgr.14152 172.21.15.42:0/4085363079' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T17:45:52.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:51 smithi042 ceph-mon[38309]: mgrmap e18: y(active, since 4m), standbys: x 2024-09-21T17:45:52.554 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T17:45:52.554 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T17:45:52.554 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T17:45:52.555 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T17:45:52.555 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T17:45:52.556 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T17:45:52.556 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T17:45:52.556 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T17:45:53.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/938075325' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T17:45:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:53.119 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:53.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/938075325' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T17:45:53.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/938075325' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T17:45:53.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.778+0000 7fd591368640 1 -- 172.21.15.42:0/3469447069 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd58c1045b0 msgr2=0x7fd58c10caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.778+0000 7fd591368640 1 --2- 172.21.15.42:0/3469447069 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd58c1045b0 0x7fd58c10caa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd574009860 tx=0x7fd57402a340 comp rx=0 tx=0).stop 2024-09-21T17:45:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.778+0000 7fd591368640 1 -- 172.21.15.42:0/3469447069 shutdown_connections 2024-09-21T17:45:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.778+0000 7fd591368640 1 --2- 172.21.15.42:0/3469447069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd58c10d0f0 0x7fd58c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.778+0000 7fd591368640 1 --2- 172.21.15.42:0/3469447069 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd58c1045b0 0x7fd58c10caa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.778+0000 7fd591368640 1 --2- 172.21.15.42:0/3469447069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c103c90 0x7fd58c104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.778+0000 7fd591368640 1 -- 172.21.15.42:0/3469447069 >> 172.21.15.42:0/3469447069 conn(0x7fd58c0fd6d0 msgr2=0x7fd58c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.778+0000 7fd591368640 1 -- 172.21.15.42:0/3469447069 shutdown_connections 2024-09-21T17:45:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.779+0000 7fd591368640 1 -- 172.21.15.42:0/3469447069 wait complete. 2024-09-21T17:45:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.779+0000 7fd591368640 1 Processor -- start 2024-09-21T17:45:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.779+0000 7fd591368640 1 -- start start 2024-09-21T17:45:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.779+0000 7fd591368640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd58c103c90 0x7fd58c198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.779+0000 7fd591368640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd58c1045b0 0x7fd58c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.779+0000 7fd591368640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c10d0f0 0x7fd58c19e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.779+0000 7fd591368640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c112470 con 0x7fd58c10d0f0 2024-09-21T17:45:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.779+0000 7fd591368640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c1122f0 con 0x7fd58c1045b0 2024-09-21T17:45:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.779+0000 7fd591368640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fd58c1125f0 con 0x7fd58c103c90 2024-09-21T17:45:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd58affd640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd58c103c90 0x7fd58c198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd58affd640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd58c103c90 0x7fd58c198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:59820/0 (socket says 172.21.15.42:59820) 2024-09-21T17:45:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd583fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd58c1045b0 0x7fd58c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd58b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c10d0f0 0x7fd58c19e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd583fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd58c1045b0 0x7fd58c199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.42:56044/0 (socket says 172.21.15.42:56044) 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd583fff640 1 -- 172.21.15.42:0/2884274152 learned_addr learned my addr 172.21.15.42:0/2884274152 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd583fff640 1 -- 172.21.15.42:0/2884274152 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd58c103c90 msgr2=0x7fd58c198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd583fff640 1 --2- 172.21.15.42:0/2884274152 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd58c103c90 0x7fd58c198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd583fff640 1 -- 172.21.15.42:0/2884274152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c10d0f0 msgr2=0x7fd58c19e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd583fff640 1 --2- 172.21.15.42:0/2884274152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c10d0f0 0x7fd58c19e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd583fff640 1 -- 172.21.15.42:0/2884274152 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58c19ede0 con 0x7fd58c1045b0 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd583fff640 1 --2- 172.21.15.42:0/2884274152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd58c1045b0 0x7fd58c199270 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd574000c00 tx=0x7fd574033a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.780+0000 7fd588ff9640 1 -- 172.21.15.42:0/2884274152 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57403f020 con 0x7fd58c1045b0 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.781+0000 7fd588ff9640 1 -- 172.21.15.42:0/2884274152 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fd574004040 con 0x7fd58c1045b0 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.781+0000 7fd588ff9640 1 -- 172.21.15.42:0/2884274152 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd574037040 con 0x7fd58c1045b0 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.781+0000 7fd591368640 1 -- 172.21.15.42:0/2884274152 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58c19f070 con 0x7fd58c1045b0 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.781+0000 7fd591368640 1 -- 172.21.15.42:0/2884274152 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd58c1a5790 con 0x7fd58c1045b0 2024-09-21T17:45:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.781+0000 7fd591368640 1 -- 172.21.15.42:0/2884274152 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd58c06bba0 con 0x7fd58c1045b0 2024-09-21T17:45:53.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.782+0000 7fd588ff9640 1 -- 172.21.15.42:0/2884274152 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 103263+0+0 (secure 0 0 0) 0x7fd574042020 con 0x7fd58c1045b0 2024-09-21T17:45:53.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.783+0000 7fd588ff9640 1 --2- 172.21.15.42:0/2884274152 >> v2:172.21.15.42:6800/92962027 conn(0x7fd57807b100 0x7fd57807d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:53.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.783+0000 7fd58affd640 1 -- 172.21.15.42:0/2884274152 >> v2:172.21.15.42:6800/92962027 conn(0x7fd57807b100 msgr2=0x7fd57807d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/92962027 2024-09-21T17:45:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.783+0000 7fd588ff9640 1 -- 172.21.15.42:0/2884274152 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5942+0+0 (secure 0 0 0) 0x7fd5740be200 con 0x7fd58c1045b0 2024-09-21T17:45:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.783+0000 7fd58affd640 1 --2- 172.21.15.42:0/2884274152 >> v2:172.21.15.42:6800/92962027 conn(0x7fd57807b100 0x7fd57807d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:45:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.783+0000 7fd588ff9640 1 --2- 172.21.15.42:0/2884274152 >> v2:172.21.15.162:6804/338151964 conn(0x7fd578084750 0x7fd578086bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.783+0000 7fd588ff9640 1 -- 172.21.15.42:0/2884274152 --> v2:172.21.15.162:6804/338151964 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd578087240 con 0x7fd578084750 2024-09-21T17:45:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.783+0000 7fd588ff9640 1 -- 172.21.15.42:0/2884274152 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fd5740be5b0 con 0x7fd58c1045b0 2024-09-21T17:45:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.784+0000 7fd58b7fe640 1 --2- 172.21.15.42:0/2884274152 >> v2:172.21.15.162:6804/338151964 conn(0x7fd578084750 0x7fd578086bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.784+0000 7fd58b7fe640 1 --2- 172.21.15.42:0/2884274152 >> v2:172.21.15.162:6804/338151964 conn(0x7fd578084750 0x7fd578086bb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.785+0000 7fd588ff9640 1 -- 172.21.15.42:0/2884274152 <== osd.5 v2:172.21.15.162:6804/338151964 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd578087240 con 0x7fd578084750 2024-09-21T17:45:53.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.799+0000 7fd591368640 1 -- 172.21.15.42:0/2884274152 --> v2:172.21.15.162:6804/338151964 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd58c0637e0 con 0x7fd578084750 2024-09-21T17:45:53.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.799+0000 7fd588ff9640 1 -- 172.21.15.42:0/2884274152 <== osd.5 v2:172.21.15.162:6804/338151964 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd58c0637e0 con 0x7fd578084750 2024-09-21T17:45:53.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.799+0000 7fd591368640 1 -- 172.21.15.42:0/2884274152 >> v2:172.21.15.162:6804/338151964 conn(0x7fd578084750 msgr2=0x7fd578086bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:53.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.799+0000 7fd591368640 1 --2- 172.21.15.42:0/2884274152 >> v2:172.21.15.162:6804/338151964 conn(0x7fd578084750 0x7fd578086bb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:53.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.799+0000 7fd591368640 1 -- 172.21.15.42:0/2884274152 >> v2:172.21.15.42:6800/92962027 conn(0x7fd57807b100 msgr2=0x7fd57807d5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T17:45:53.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.799+0000 7fd591368640 1 --2- 172.21.15.42:0/2884274152 >> v2:172.21.15.42:6800/92962027 conn(0x7fd57807b100 0x7fd57807d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:53.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.799+0000 7fd591368640 1 -- 172.21.15.42:0/2884274152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd58c1045b0 msgr2=0x7fd58c199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:53.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.799+0000 7fd591368640 1 --2- 172.21.15.42:0/2884274152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd58c1045b0 0x7fd58c199270 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd574000c00 tx=0x7fd574033a80 comp rx=0 tx=0).stop 2024-09-21T17:45:53.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.799+0000 7fd58b7fe640 1 -- 172.21.15.42:0/2884274152 reap_dead start 2024-09-21T17:45:53.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.800+0000 7fd591368640 1 -- 172.21.15.42:0/2884274152 shutdown_connections 2024-09-21T17:45:53.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.800+0000 7fd591368640 1 -- 172.21.15.42:0/2884274152 >> 172.21.15.42:0/2884274152 conn(0x7fd58c0fd6d0 msgr2=0x7fd58c1049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:53.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.800+0000 7fd591368640 1 -- 172.21.15.42:0/2884274152 shutdown_connections 2024-09-21T17:45:53.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.800+0000 7fd591368640 1 -- 172.21.15.42:0/2884274152 wait complete. 2024-09-21T17:45:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.994+0000 7f3b89fe6640 1 -- 172.21.15.42:0/1535643175 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b84103b00 msgr2=0x7f3b84103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.994+0000 7f3b89fe6640 1 --2- 172.21.15.42:0/1535643175 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b84103b00 0x7f3b84103ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009900 tx=0x7f3b7402a410 comp rx=0 tx=0).stop 2024-09-21T17:45:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.994+0000 7f3b89fe6640 1 -- 172.21.15.42:0/1535643175 shutdown_connections 2024-09-21T17:45:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.994+0000 7f3b89fe6640 1 --2- 172.21.15.42:0/1535643175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8410d0b0 0x7f3b8410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.994+0000 7f3b89fe6640 1 --2- 172.21.15.42:0/1535643175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84104500 0x7f3b8410cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.994+0000 7f3b89fe6640 1 --2- 172.21.15.42:0/1535643175 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b84103b00 0x7f3b84103ee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.994+0000 7f3b89fe6640 1 -- 172.21.15.42:0/1535643175 >> 172.21.15.42:0/1535643175 conn(0x7f3b840fd6d0 msgr2=0x7f3b840ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.994+0000 7f3b89fe6640 1 -- 172.21.15.42:0/1535643175 shutdown_connections 2024-09-21T17:45:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.994+0000 7f3b89fe6640 1 -- 172.21.15.42:0/1535643175 wait complete. 2024-09-21T17:45:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b89fe6640 1 Processor -- start 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b89fe6640 1 -- start start 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b89fe6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84103b00 0x7f3b84198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b89fe6640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b84104500 0x7f3b84198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b89fe6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8410d0b0 0x7f3b8419e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b89fe6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3b84112440 con 0x7f3b8410d0b0 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b89fe6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b841122c0 con 0x7f3b84103b00 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b89fe6640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f3b841125c0 con 0x7f3b84104500 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b83fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8410d0b0 0x7f3b8419e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b83fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8410d0b0 0x7f3b8419e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46792/0 (socket says 172.21.15.42:46792) 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b83fff640 1 -- 172.21.15.42:0/3149124944 learned_addr learned my addr 172.21.15.42:0/3149124944 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b7affd640 1 --2- 172.21.15.42:0/3149124944 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b84104500 0x7f3b84198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.995+0000 7f3b837fe640 1 --2- 172.21.15.42:0/3149124944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84103b00 0x7f3b84198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.996+0000 7f3b83fff640 1 -- 172.21.15.42:0/3149124944 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b84104500 msgr2=0x7f3b84198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.996+0000 7f3b83fff640 1 --2- 172.21.15.42:0/3149124944 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b84104500 0x7f3b84198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.996+0000 7f3b83fff640 1 -- 172.21.15.42:0/3149124944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84103b00 msgr2=0x7f3b84198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.996+0000 7f3b83fff640 1 --2- 172.21.15.42:0/3149124944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84103b00 0x7f3b84198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.996+0000 7f3b83fff640 1 -- 172.21.15.42:0/3149124944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8419ea30 con 0x7f3b8410d0b0 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.996+0000 7f3b83fff640 1 --2- 172.21.15.42:0/3149124944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8410d0b0 0x7f3b8419e260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00efd0 tx=0x7f3b7c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.996+0000 7f3b817fa640 1 -- 172.21.15.42:0/3149124944 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c003b70 con 0x7f3b8410d0b0 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.996+0000 7f3b817fa640 1 -- 172.21.15.42:0/3149124944 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f3b7c003d10 con 0x7f3b8410d0b0 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.996+0000 7f3b89fe6640 1 -- 172.21.15.42:0/3149124944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8419ed20 con 0x7f3b8410d0b0 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.996+0000 7f3b817fa640 1 -- 172.21.15.42:0/3149124944 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c010840 con 0x7f3b8410d0b0 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.996+0000 7f3b89fe6640 1 -- 172.21.15.42:0/3149124944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b841a53e0 con 0x7f3b8410d0b0 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.997+0000 7f3b89fe6640 1 -- 172.21.15.42:0/3149124944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b84063860 con 0x7f3b8410d0b0 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.998+0000 7f3b817fa640 1 -- 172.21.15.42:0/3149124944 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 103263+0+0 (secure 0 0 0) 0x7f3b7c0109e0 con 0x7f3b8410d0b0 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.998+0000 7f3b817fa640 1 --2- 172.21.15.42:0/3149124944 >> v2:172.21.15.42:6800/92962027 conn(0x7f3b7007b100 0x7f3b7007d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:54.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.998+0000 7f3b837fe640 1 -- 172.21.15.42:0/3149124944 >> v2:172.21.15.42:6800/92962027 conn(0x7f3b7007b100 msgr2=0x7f3b7007d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/92962027 2024-09-21T17:45:54.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.999+0000 7f3b817fa640 1 -- 172.21.15.42:0/3149124944 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5942+0+0 (secure 0 0 0) 0x7f3b7c09e690 con 0x7f3b8410d0b0 2024-09-21T17:45:54.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.999+0000 7f3b837fe640 1 --2- 172.21.15.42:0/3149124944 >> v2:172.21.15.42:6800/92962027 conn(0x7f3b7007b100 0x7f3b7007d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:45:54.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.999+0000 7f3b817fa640 1 --2- 172.21.15.42:0/3149124944 >> v2:172.21.15.42:6801/443738680 conn(0x7f3b700846d0 0x7f3b70086b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:54.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.999+0000 7f3b817fa640 1 -- 172.21.15.42:0/3149124944 --> v2:172.21.15.42:6801/443738680 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b700871c0 con 0x7f3b700846d0 2024-09-21T17:45:54.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.999+0000 7f3b817fa640 1 -- 172.21.15.42:0/3149124944 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f3b7c0a5050 con 0x7f3b8410d0b0 2024-09-21T17:45:54.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.999+0000 7f3b7affd640 1 --2- 172.21.15.42:0/3149124944 >> v2:172.21.15.42:6801/443738680 conn(0x7f3b700846d0 0x7f3b70086b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:54.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:53.999+0000 7f3b7affd640 1 --2- 172.21.15.42:0/3149124944 >> v2:172.21.15.42:6801/443738680 conn(0x7f3b700846d0 0x7f3b70086b30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:54.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.000+0000 7f3b817fa640 1 -- 172.21.15.42:0/3149124944 <== osd.0 v2:172.21.15.42:6801/443738680 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b700871c0 con 0x7f3b700846d0 2024-09-21T17:45:54.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.013+0000 7f3b89fe6640 1 -- 172.21.15.42:0/3149124944 --> v2:172.21.15.42:6801/443738680 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b84063c60 con 0x7f3b700846d0 2024-09-21T17:45:54.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b817fa640 1 -- 172.21.15.42:0/3149124944 <== osd.0 v2:172.21.15.42:6801/443738680 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b84063c60 con 0x7f3b700846d0 2024-09-21T17:45:54.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b89fe6640 1 -- 172.21.15.42:0/3149124944 >> v2:172.21.15.42:6801/443738680 conn(0x7f3b700846d0 msgr2=0x7f3b70086b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:54.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b89fe6640 1 --2- 172.21.15.42:0/3149124944 >> v2:172.21.15.42:6801/443738680 conn(0x7f3b700846d0 0x7f3b70086b30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:54.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b89fe6640 1 -- 172.21.15.42:0/3149124944 >> v2:172.21.15.42:6800/92962027 conn(0x7f3b7007b100 msgr2=0x7f3b7007d5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T17:45:54.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b89fe6640 1 --2- 172.21.15.42:0/3149124944 >> v2:172.21.15.42:6800/92962027 conn(0x7f3b7007b100 0x7f3b7007d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:54.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b89fe6640 1 -- 172.21.15.42:0/3149124944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8410d0b0 msgr2=0x7f3b8419e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:54.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b89fe6640 1 --2- 172.21.15.42:0/3149124944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8410d0b0 0x7f3b8419e260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00efd0 tx=0x7f3b7c00c6a0 comp rx=0 tx=0).stop 2024-09-21T17:45:54.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b83fff640 1 -- 172.21.15.42:0/3149124944 reap_dead start 2024-09-21T17:45:54.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b89fe6640 1 -- 172.21.15.42:0/3149124944 shutdown_connections 2024-09-21T17:45:54.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b89fe6640 1 -- 172.21.15.42:0/3149124944 >> 172.21.15.42:0/3149124944 conn(0x7f3b840fd6d0 msgr2=0x7f3b841049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:54.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b89fe6640 1 -- 172.21.15.42:0/3149124944 shutdown_connections 2024-09-21T17:45:54.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:54.014+0000 7f3b89fe6640 1 -- 172.21.15.42:0/3149124944 wait complete. 2024-09-21T17:45:55.116 INFO:teuthology.orchestra.run.smithi042.stdout:34359738410 2024-09-21T17:45:55.116 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T17:45:55.162 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:55.163 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:55.163 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:55.163 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:55.183 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:55.187 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:45:55.610 INFO:teuthology.orchestra.run.smithi042.stdout:154618822675 2024-09-21T17:45:55.610 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T17:45:56.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.204+0000 7f9074974640 1 -- 172.21.15.42:0/3123706682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f907010d0b0 msgr2=0x7f907010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:56.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.204+0000 7f9074974640 1 --2- 172.21.15.42:0/3123706682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f907010d0b0 0x7f907010f520 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9068009be0 tx=0x7f906802a6c0 comp rx=0 tx=0).stop 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.204+0000 7f9074974640 1 -- 172.21.15.42:0/3123706682 shutdown_connections 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.204+0000 7f9074974640 1 --2- 172.21.15.42:0/3123706682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f907010d0b0 0x7f907010f520 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.204+0000 7f9074974640 1 --2- 172.21.15.42:0/3123706682 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9070104500 0x7f907010cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.204+0000 7f9074974640 1 --2- 172.21.15.42:0/3123706682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9070103b00 0x7f9070103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.204+0000 7f9074974640 1 -- 172.21.15.42:0/3123706682 >> 172.21.15.42:0/3123706682 conn(0x7f90700fd710 msgr2=0x7f90700ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.204+0000 7f9074974640 1 -- 172.21.15.42:0/3123706682 shutdown_connections 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.204+0000 7f9074974640 1 -- 172.21.15.42:0/3123706682 wait complete. 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f9074974640 1 Processor -- start 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f9074974640 1 -- start start 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f9074974640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9070103b00 0x7f9070198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f9074974640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9070104500 0x7f9070198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:56.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f9074974640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f907010d0b0 0x7f907019e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:56.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f9074974640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9070112440 con 0x7f9070103b00 2024-09-21T17:45:56.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f9074974640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90701122c0 con 0x7f9070104500 2024-09-21T17:45:56.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f9074974640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f90701125c0 con 0x7f907010d0b0 2024-09-21T17:45:56.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f906ed9d640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f907010d0b0 0x7f907019e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:56.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f906e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9070103b00 0x7f9070198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:56.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f906ed9d640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f907010d0b0 0x7f907019e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:59856/0 (socket says 172.21.15.42:59856) 2024-09-21T17:45:56.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f906ed9d640 1 -- 172.21.15.42:0/776865676 learned_addr learned my addr 172.21.15.42:0/776865676 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:56.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.205+0000 7f9067fff640 1 --2- 172.21.15.42:0/776865676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9070104500 0x7f9070198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:56.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f906e59c640 1 -- 172.21.15.42:0/776865676 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f907010d0b0 msgr2=0x7f907019e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:56.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f906e59c640 1 --2- 172.21.15.42:0/776865676 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f907010d0b0 0x7f907019e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:56.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f906e59c640 1 -- 172.21.15.42:0/776865676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9070104500 msgr2=0x7f9070198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:56.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f906e59c640 1 --2- 172.21.15.42:0/776865676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9070104500 0x7f9070198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:56.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f906e59c640 1 -- 172.21.15.42:0/776865676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907019e9c0 con 0x7f9070103b00 2024-09-21T17:45:56.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f906ed9d640 1 --2- 172.21.15.42:0/776865676 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f907010d0b0 0x7f907019e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:56.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f9067fff640 1 --2- 172.21.15.42:0/776865676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9070104500 0x7f9070198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:56.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f906e59c640 1 --2- 172.21.15.42:0/776865676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9070103b00 0x7f9070198910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f906000e9f0 tx=0x7f906000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:56.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f90677fe640 1 -- 172.21.15.42:0/776865676 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906000ccc0 con 0x7f9070103b00 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f9074974640 1 -- 172.21.15.42:0/776865676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907019ecb0 con 0x7f9070103b00 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f90677fe640 1 -- 172.21.15.42:0/776865676 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f90600108b0 con 0x7f9070103b00 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f90677fe640 1 -- 172.21.15.42:0/776865676 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90600187a0 con 0x7f9070103b00 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.206+0000 7f9074974640 1 -- 172.21.15.42:0/776865676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90701a5370 con 0x7f9070103b00 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.207+0000 7f9074974640 1 -- 172.21.15.42:0/776865676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9070063820 con 0x7f9070103b00 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.208+0000 7f90677fe640 1 -- 172.21.15.42:0/776865676 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 103263+0+0 (secure 0 0 0) 0x7f9060010430 con 0x7f9070103b00 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.208+0000 7f90677fe640 1 --2- 172.21.15.42:0/776865676 >> v2:172.21.15.42:6800/92962027 conn(0x7f905c07b100 0x7f905c07d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.208+0000 7f9067fff640 1 -- 172.21.15.42:0/776865676 >> v2:172.21.15.42:6800/92962027 conn(0x7f905c07b100 msgr2=0x7f905c07d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/92962027 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.209+0000 7f90677fe640 1 -- 172.21.15.42:0/776865676 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5942+0+0 (secure 0 0 0) 0x7f906009e610 con 0x7f9070103b00 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.209+0000 7f9067fff640 1 --2- 172.21.15.42:0/776865676 >> v2:172.21.15.42:6800/92962027 conn(0x7f905c07b100 0x7f905c07d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.209+0000 7f90677fe640 1 --2- 172.21.15.42:0/776865676 >> v2:172.21.15.162:6800/4286045529 conn(0x7f905c084650 0x7f905c086ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.209+0000 7f90677fe640 1 -- 172.21.15.42:0/776865676 --> v2:172.21.15.162:6800/4286045529 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9060020e50 con 0x7f905c084650 2024-09-21T17:45:56.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.209+0000 7f90677fe640 1 -- 172.21.15.42:0/776865676 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f90600a5050 con 0x7f9070103b00 2024-09-21T17:45:56.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.209+0000 7f906ed9d640 1 --2- 172.21.15.42:0/776865676 >> v2:172.21.15.162:6800/4286045529 conn(0x7f905c084650 0x7f905c086ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:56.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.209+0000 7f906ed9d640 1 --2- 172.21.15.42:0/776865676 >> v2:172.21.15.162:6800/4286045529 conn(0x7f905c084650 0x7f905c086ab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:56.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.210+0000 7f90677fe640 1 -- 172.21.15.42:0/776865676 <== osd.4 v2:172.21.15.162:6800/4286045529 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9060020e50 con 0x7f905c084650 2024-09-21T17:45:56.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.224+0000 7f9074974640 1 -- 172.21.15.42:0/776865676 --> v2:172.21.15.162:6800/4286045529 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9070063c20 con 0x7f905c084650 2024-09-21T17:45:56.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.224+0000 7f90677fe640 1 -- 172.21.15.42:0/776865676 <== osd.4 v2:172.21.15.162:6800/4286045529 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9070063c20 con 0x7f905c084650 2024-09-21T17:45:56.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.224+0000 7f9074974640 1 -- 172.21.15.42:0/776865676 >> v2:172.21.15.162:6800/4286045529 conn(0x7f905c084650 msgr2=0x7f905c086ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:56.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.224+0000 7f9074974640 1 --2- 172.21.15.42:0/776865676 >> v2:172.21.15.162:6800/4286045529 conn(0x7f905c084650 0x7f905c086ab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:56.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.225+0000 7f9074974640 1 -- 172.21.15.42:0/776865676 >> v2:172.21.15.42:6800/92962027 conn(0x7f905c07b100 msgr2=0x7f905c07d5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T17:45:56.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.225+0000 7f9074974640 1 --2- 172.21.15.42:0/776865676 >> v2:172.21.15.42:6800/92962027 conn(0x7f905c07b100 0x7f905c07d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:56.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.225+0000 7f9074974640 1 -- 172.21.15.42:0/776865676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9070103b00 msgr2=0x7f9070198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:56.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.225+0000 7f9074974640 1 --2- 172.21.15.42:0/776865676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9070103b00 0x7f9070198910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f906000e9f0 tx=0x7f906000eeb0 comp rx=0 tx=0).stop 2024-09-21T17:45:56.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.225+0000 7f906ed9d640 1 -- 172.21.15.42:0/776865676 reap_dead start 2024-09-21T17:45:56.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.225+0000 7f9074974640 1 -- 172.21.15.42:0/776865676 shutdown_connections 2024-09-21T17:45:56.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.225+0000 7f9074974640 1 -- 172.21.15.42:0/776865676 >> 172.21.15.42:0/776865676 conn(0x7f90700fd710 msgr2=0x7f90700fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:56.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.225+0000 7f9074974640 1 -- 172.21.15.42:0/776865676 shutdown_connections 2024-09-21T17:45:56.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:56.225+0000 7f9074974640 1 -- 172.21.15.42:0/776865676 wait complete. 2024-09-21T17:45:56.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[29361]: Standby manager daemon x restarted 2024-09-21T17:45:56.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[29361]: Standby manager daemon x started 2024-09-21T17:45:56.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[29361]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T17:45:56.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[29361]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T17:45:56.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[29361]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T17:45:56.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[29361]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T17:45:56.818 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[38309]: Standby manager daemon x restarted 2024-09-21T17:45:56.819 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[38309]: Standby manager daemon x started 2024-09-21T17:45:56.819 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[38309]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T17:45:56.819 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[38309]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T17:45:56.819 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[38309]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T17:45:56.819 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:56 smithi042 ceph-mon[38309]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T17:45:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-mon[32106]: Standby manager daemon x restarted 2024-09-21T17:45:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-mon[32106]: Standby manager daemon x started 2024-09-21T17:45:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-mon[32106]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T17:45:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-mon[32106]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T17:45:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-mon[32106]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T17:45:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-mon[32106]: from='mgr.? 172.21.15.162:0/1545708687' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T17:45:56.825 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x[33602]: [21/Sep/2024:17:45:56] ENGINE Bus STARTING 2024-09-21T17:45:56.825 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x[33602]: CherryPy Checker: 2024-09-21T17:45:56.825 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x[33602]: The Application mounted at '' has an empty config. 2024-09-21T17:45:56.826 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x[33602]: 2024-09-21T17:45:56.826 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x[33602]: [21/Sep/2024:17:45:56] ENGINE Serving on http://:::9283 2024-09-21T17:45:56.826 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 17:45:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x[33602]: [21/Sep/2024:17:45:56] ENGINE Bus STARTED 2024-09-21T17:45:57.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.320+0000 7fce85c6d640 1 -- 172.21.15.42:0/3884998848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce801087b0 msgr2=0x7fce80108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.320+0000 7fce85c6d640 1 --2- 172.21.15.42:0/3884998848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce801087b0 0x7fce80108bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fce68009860 tx=0x7fce6802a340 comp rx=0 tx=0).stop 2024-09-21T17:45:57.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.320+0000 7fce85c6d640 1 -- 172.21.15.42:0/3884998848 shutdown_connections 2024-09-21T17:45:57.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.320+0000 7fce85c6d640 1 --2- 172.21.15.42:0/3884998848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce80109130 0x7fce8010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.320+0000 7fce85c6d640 1 --2- 172.21.15.42:0/3884998848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce801087b0 0x7fce80108bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.320+0000 7fce85c6d640 1 --2- 172.21.15.42:0/3884998848 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fce80102da0 0x7fce80103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.320+0000 7fce85c6d640 1 -- 172.21.15.42:0/3884998848 >> 172.21.15.42:0/3884998848 conn(0x7fce800fe810 msgr2=0x7fce80100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:57.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.320+0000 7fce85c6d640 1 -- 172.21.15.42:0/3884998848 shutdown_connections 2024-09-21T17:45:57.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.320+0000 7fce85c6d640 1 -- 172.21.15.42:0/3884998848 wait complete. 2024-09-21T17:45:57.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.320+0000 7fce85c6d640 1 Processor -- start 2024-09-21T17:45:57.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce85c6d640 1 -- start start 2024-09-21T17:45:57.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce85c6d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce80102da0 0x7fce80198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce85c6d640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fce801087b0 0x7fce80198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce85c6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce80109130 0x7fce8019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce85c6d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fce80112490 con 0x7fce80102da0 2024-09-21T17:45:57.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce85c6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fce80112310 con 0x7fce80109130 2024-09-21T17:45:57.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce85c6d640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fce80112610 con 0x7fce801087b0 2024-09-21T17:45:57.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce7f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce80102da0 0x7fce80198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce77fff640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fce801087b0 0x7fce80198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce77fff640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fce801087b0 0x7fce80198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:59914/0 (socket says 172.21.15.42:59914) 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce7f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce80102da0 0x7fce80198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46874/0 (socket says 172.21.15.42:46874) 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce77fff640 1 -- 172.21.15.42:0/2631806382 learned_addr learned my addr 172.21.15.42:0/2631806382 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce77fff640 1 -- 172.21.15.42:0/2631806382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce80109130 msgr2=0x7fce8019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce77fff640 1 --2- 172.21.15.42:0/2631806382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce80109130 0x7fce8019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce77fff640 1 -- 172.21.15.42:0/2631806382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce80102da0 msgr2=0x7fce80198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce77fff640 1 --2- 172.21.15.42:0/2631806382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce80102da0 0x7fce80198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce77fff640 1 -- 172.21.15.42:0/2631806382 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8019ea20 con 0x7fce801087b0 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.321+0000 7fce7f7fe640 1 --2- 172.21.15.42:0/2631806382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce80102da0 0x7fce80198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.322+0000 7fce77fff640 1 --2- 172.21.15.42:0/2631806382 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fce801087b0 0x7fce80198eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fce68009980 tx=0x7fce68033d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.322+0000 7fce7d7fa640 1 -- 172.21.15.42:0/2631806382 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68030830 con 0x7fce801087b0 2024-09-21T17:45:57.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.322+0000 7fce7d7fa640 1 -- 172.21.15.42:0/2631806382 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fce680044c0 con 0x7fce801087b0 2024-09-21T17:45:57.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.322+0000 7fce85c6d640 1 -- 172.21.15.42:0/2631806382 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8019ecb0 con 0x7fce801087b0 2024-09-21T17:45:57.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.322+0000 7fce7d7fa640 1 -- 172.21.15.42:0/2631806382 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6803a580 con 0x7fce801087b0 2024-09-21T17:45:57.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.322+0000 7fce85c6d640 1 -- 172.21.15.42:0/2631806382 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fce80075380 con 0x7fce801087b0 2024-09-21T17:45:57.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.323+0000 7fce85c6d640 1 -- 172.21.15.42:0/2631806382 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce80063860 con 0x7fce801087b0 2024-09-21T17:45:57.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.324+0000 7fce7d7fa640 1 -- 172.21.15.42:0/2631806382 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 20) ==== 102915+0+0 (secure 0 0 0) 0x7fce680035f0 con 0x7fce801087b0 2024-09-21T17:45:57.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.324+0000 7fce7d7fa640 1 -- 172.21.15.42:0/2631806382 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7fce680c2010 con 0x7fce801087b0 2024-09-21T17:45:57.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.324+0000 7fce7d7fa640 1 --2- 172.21.15.42:0/2631806382 >> v2:172.21.15.42:6805/555179714 conn(0x7fce6c081970 0x7fce6c083db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.324+0000 7fce7d7fa640 1 -- 172.21.15.42:0/2631806382 --> v2:172.21.15.42:6805/555179714 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce68040ec0 con 0x7fce6c081970 2024-09-21T17:45:57.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.324+0000 7fce7d7fa640 1 -- 172.21.15.42:0/2631806382 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fce680c9050 con 0x7fce801087b0 2024-09-21T17:45:57.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.324+0000 7fce7f7fe640 1 --2- 172.21.15.42:0/2631806382 >> v2:172.21.15.42:6805/555179714 conn(0x7fce6c081970 0x7fce6c083db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.325+0000 7fce7f7fe640 1 --2- 172.21.15.42:0/2631806382 >> v2:172.21.15.42:6805/555179714 conn(0x7fce6c081970 0x7fce6c083db0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.325+0000 7fce7d7fa640 1 -- 172.21.15.42:0/2631806382 <== osd.1 v2:172.21.15.42:6805/555179714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce68040ec0 con 0x7fce6c081970 2024-09-21T17:45:57.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.339+0000 7fce85c6d640 1 -- 172.21.15.42:0/2631806382 --> v2:172.21.15.42:6805/555179714 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce80063c60 con 0x7fce6c081970 2024-09-21T17:45:57.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.339+0000 7fce7d7fa640 1 -- 172.21.15.42:0/2631806382 <== osd.1 v2:172.21.15.42:6805/555179714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fce80063c60 con 0x7fce6c081970 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 -- 172.21.15.42:0/2631806382 >> v2:172.21.15.42:6805/555179714 conn(0x7fce6c081970 msgr2=0x7fce6c083db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 --2- 172.21.15.42:0/2631806382 >> v2:172.21.15.42:6805/555179714 conn(0x7fce6c081970 0x7fce6c083db0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 -- 172.21.15.42:0/2631806382 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fce801087b0 msgr2=0x7fce80198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 --2- 172.21.15.42:0/2631806382 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fce801087b0 0x7fce80198eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fce68009980 tx=0x7fce68033d30 comp rx=0 tx=0).stop 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 -- 172.21.15.42:0/2631806382 shutdown_connections 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 --2- 172.21.15.42:0/2631806382 >> v2:172.21.15.42:6805/555179714 conn(0x7fce6c081970 0x7fce6c083db0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 --2- 172.21.15.42:0/2631806382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce80109130 0x7fce8019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 --2- 172.21.15.42:0/2631806382 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fce801087b0 0x7fce80198eb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 --2- 172.21.15.42:0/2631806382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce80102da0 0x7fce80198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 -- 172.21.15.42:0/2631806382 >> 172.21.15.42:0/2631806382 conn(0x7fce800fe810 msgr2=0x7fce80100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 -- 172.21.15.42:0/2631806382 shutdown_connections 2024-09-21T17:45:57.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.340+0000 7fce85c6d640 1 -- 172.21.15.42:0/2631806382 wait complete. 2024-09-21T17:45:57.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.494+0000 7f8f48b23640 1 -- 172.21.15.42:0/983695352 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f44101c60 msgr2=0x7f8f44102040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.494+0000 7f8f48b23640 1 --2- 172.21.15.42:0/983695352 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f44101c60 0x7f8f44102040 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009900 tx=0x7f8f3402a410 comp rx=0 tx=0).stop 2024-09-21T17:45:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.494+0000 7f8f48b23640 1 -- 172.21.15.42:0/983695352 shutdown_connections 2024-09-21T17:45:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.494+0000 7f8f48b23640 1 --2- 172.21.15.42:0/983695352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f44107ff0 0x7f8f4410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.494+0000 7f8f48b23640 1 --2- 172.21.15.42:0/983695352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f44107670 0x7f8f44107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.494+0000 7f8f48b23640 1 --2- 172.21.15.42:0/983695352 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f44101c60 0x7f8f44102040 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.494+0000 7f8f48b23640 1 -- 172.21.15.42:0/983695352 >> 172.21.15.42:0/983695352 conn(0x7f8f440fd6d0 msgr2=0x7f8f440ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.495+0000 7f8f48b23640 1 -- 172.21.15.42:0/983695352 shutdown_connections 2024-09-21T17:45:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.495+0000 7f8f48b23640 1 -- 172.21.15.42:0/983695352 wait complete. 2024-09-21T17:45:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.495+0000 7f8f48b23640 1 Processor -- start 2024-09-21T17:45:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f48b23640 1 -- start start 2024-09-21T17:45:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f48b23640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f44101c60 0x7f8f44199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f48b23640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f44107670 0x7f8f44199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f48b23640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f44107ff0 0x7f8f441a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f48b23640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8f441113c0 con 0x7f8f44101c60 2024-09-21T17:45:57.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f48b23640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44111240 con 0x7f8f44107670 2024-09-21T17:45:57.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f48b23640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f8f44111540 con 0x7f8f44107ff0 2024-09-21T17:45:57.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f4259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f44101c60 0x7f8f44199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:57.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f4259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f44101c60 0x7f8f44199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46896/0 (socket says 172.21.15.42:46896) 2024-09-21T17:45:57.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f4259c640 1 -- 172.21.15.42:0/2266962746 learned_addr learned my addr 172.21.15.42:0/2266962746 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:57.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f42d9d640 1 --2- 172.21.15.42:0/2266962746 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f44107ff0 0x7f8f441a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:57.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f41d9b640 1 --2- 172.21.15.42:0/2266962746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f44107670 0x7f8f44199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:57.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f4259c640 1 -- 172.21.15.42:0/2266962746 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f44107ff0 msgr2=0x7f8f441a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f4259c640 1 --2- 172.21.15.42:0/2266962746 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f44107ff0 0x7f8f441a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f4259c640 1 -- 172.21.15.42:0/2266962746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f44107670 msgr2=0x7f8f44199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f4259c640 1 --2- 172.21.15.42:0/2266962746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f44107670 0x7f8f44199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f4259c640 1 -- 172.21.15.42:0/2266962746 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f441a4cf0 con 0x7f8f44101c60 2024-09-21T17:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f42d9d640 1 --2- 172.21.15.42:0/2266962746 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f44107ff0 0x7f8f441a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.496+0000 7f8f41d9b640 1 --2- 172.21.15.42:0/2266962746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f44107670 0x7f8f44199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T17:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.497+0000 7f8f4259c640 1 --2- 172.21.15.42:0/2266962746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f44101c60 0x7f8f44199730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f34005940 tx=0x7f8f34032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.497+0000 7f8f3b7fe640 1 -- 172.21.15.42:0/2266962746 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3403f030 con 0x7f8f44101c60 2024-09-21T17:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.497+0000 7f8f3b7fe640 1 -- 172.21.15.42:0/2266962746 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f8f34005480 con 0x7f8f44101c60 2024-09-21T17:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.497+0000 7f8f48b23640 1 -- 172.21.15.42:0/2266962746 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f441a4ec0 con 0x7f8f44101c60 2024-09-21T17:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.497+0000 7f8f3b7fe640 1 -- 172.21.15.42:0/2266962746 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34035070 con 0x7f8f44101c60 2024-09-21T17:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.497+0000 7f8f48b23640 1 -- 172.21.15.42:0/2266962746 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f441a5260 con 0x7f8f44101c60 2024-09-21T17:45:57.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.498+0000 7f8f48b23640 1 -- 172.21.15.42:0/2266962746 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f44063860 con 0x7f8f44101c60 2024-09-21T17:45:57.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.499+0000 7f8f3b7fe640 1 -- 172.21.15.42:0/2266962746 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 102915+0+0 (secure 0 0 0) 0x7f8f34042030 con 0x7f8f44101c60 2024-09-21T17:45:57.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.499+0000 7f8f3b7fe640 1 -- 172.21.15.42:0/2266962746 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7f8f340be0a0 con 0x7f8f44101c60 2024-09-21T17:45:57.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.499+0000 7f8f3b7fe640 1 --2- 172.21.15.42:0/2266962746 >> v2:172.21.15.162:6812/1372332480 conn(0x7f8f300819f0 0x7f8f30083e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.499+0000 7f8f3b7fe640 1 -- 172.21.15.42:0/2266962746 --> v2:172.21.15.162:6812/1372332480 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f3400b0b0 con 0x7f8f300819f0 2024-09-21T17:45:57.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.499+0000 7f8f3b7fe640 1 -- 172.21.15.42:0/2266962746 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f8f340c5050 con 0x7f8f44101c60 2024-09-21T17:45:57.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.500+0000 7f8f41d9b640 1 --2- 172.21.15.42:0/2266962746 >> v2:172.21.15.162:6812/1372332480 conn(0x7f8f300819f0 0x7f8f30083e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:57.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.500+0000 7f8f41d9b640 1 --2- 172.21.15.42:0/2266962746 >> v2:172.21.15.162:6812/1372332480 conn(0x7f8f300819f0 0x7f8f30083e30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.501+0000 7f8f3b7fe640 1 -- 172.21.15.42:0/2266962746 <== osd.7 v2:172.21.15.162:6812/1372332480 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f3400b0b0 con 0x7f8f300819f0 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 -- 172.21.15.42:0/2266962746 --> v2:172.21.15.162:6812/1372332480 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8f44063c60 con 0x7f8f300819f0 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f3b7fe640 1 -- 172.21.15.42:0/2266962746 <== osd.7 v2:172.21.15.162:6812/1372332480 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8f44063c60 con 0x7f8f300819f0 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 -- 172.21.15.42:0/2266962746 >> v2:172.21.15.162:6812/1372332480 conn(0x7f8f300819f0 msgr2=0x7f8f30083e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 --2- 172.21.15.42:0/2266962746 >> v2:172.21.15.162:6812/1372332480 conn(0x7f8f300819f0 0x7f8f30083e30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 -- 172.21.15.42:0/2266962746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f44101c60 msgr2=0x7f8f44199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 --2- 172.21.15.42:0/2266962746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f44101c60 0x7f8f44199730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f34005940 tx=0x7f8f34032c70 comp rx=0 tx=0).stop 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 -- 172.21.15.42:0/2266962746 shutdown_connections 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 --2- 172.21.15.42:0/2266962746 >> v2:172.21.15.162:6812/1372332480 conn(0x7f8f300819f0 0x7f8f30083e30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 --2- 172.21.15.42:0/2266962746 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f44107ff0 0x7f8f441a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 --2- 172.21.15.42:0/2266962746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f44107670 0x7f8f44199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 --2- 172.21.15.42:0/2266962746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f44101c60 0x7f8f44199730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 -- 172.21.15.42:0/2266962746 >> 172.21.15.42:0/2266962746 conn(0x7f8f440fd6d0 msgr2=0x7f8f440fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 -- 172.21.15.42:0/2266962746 shutdown_connections 2024-09-21T17:45:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.515+0000 7f8f48b23640 1 -- 172.21.15.42:0/2266962746 wait complete. 2024-09-21T17:45:57.710 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: mgrmap e19: y(active, since 4m), standbys: x 2024-09-21T17:45:57.710 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: Active manager daemon y restarted 2024-09-21T17:45:57.710 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: Activating manager daemon y 2024-09-21T17:45:57.710 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: osdmap e62: 8 total, 8 up, 8 in 2024-09-21T17:45:57.710 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: mgrmap e20: y(active, starting, since 0.0100526s), standbys: x 2024-09-21T17:45:57.710 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:45:57.710 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T17:45:57.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T17:45:57.712 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[29361]: Manager daemon y is now available 2024-09-21T17:45:57.712 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: mgrmap e19: y(active, since 4m), standbys: x 2024-09-21T17:45:57.712 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: Active manager daemon y restarted 2024-09-21T17:45:57.712 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: Activating manager daemon y 2024-09-21T17:45:57.712 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: osdmap e62: 8 total, 8 up, 8 in 2024-09-21T17:45:57.712 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: mgrmap e20: y(active, starting, since 0.0100526s), standbys: x 2024-09-21T17:45:57.712 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:45:57.712 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:45:57.712 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:45:57.712 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T17:45:57.713 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:57 smithi042 ceph-mon[38309]: Manager daemon y is now available 2024-09-21T17:45:57.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.738+0000 7f394bffe640 1 -- 172.21.15.42:0/2521497605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3944107ff0 msgr2=0x7f394410e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.738+0000 7f394bffe640 1 --2- 172.21.15.42:0/2521497605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3944107ff0 0x7f394410e7f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f393c009be0 tx=0x7f393c02a6c0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.738+0000 7f394bffe640 1 -- 172.21.15.42:0/2521497605 shutdown_connections 2024-09-21T17:45:57.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.738+0000 7f394bffe640 1 --2- 172.21.15.42:0/2521497605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3944107ff0 0x7f394410e7f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.738+0000 7f394bffe640 1 --2- 172.21.15.42:0/2521497605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3944107670 0x7f3944107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.738+0000 7f394bffe640 1 --2- 172.21.15.42:0/2521497605 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3944101c60 0x7f3944102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.738+0000 7f394bffe640 1 -- 172.21.15.42:0/2521497605 >> 172.21.15.42:0/2521497605 conn(0x7f39440fd6d0 msgr2=0x7f39440ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:57.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.738+0000 7f394bffe640 1 -- 172.21.15.42:0/2521497605 shutdown_connections 2024-09-21T17:45:57.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.738+0000 7f394bffe640 1 -- 172.21.15.42:0/2521497605 wait complete. 2024-09-21T17:45:57.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.739+0000 7f394bffe640 1 Processor -- start 2024-09-21T17:45:57.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.739+0000 7f394bffe640 1 -- start start 2024-09-21T17:45:57.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.739+0000 7f394bffe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3944101c60 0x7f39441135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.739+0000 7f394bffe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3944107670 0x7f3944111ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.739+0000 7f394bffe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3944107ff0 0x7f3944112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f394bffe640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3944111380 con 0x7f3944107670 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f3949d9a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3944101c60 0x7f39441135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f3949599640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3944107670 0x7f3944111ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f3949d9a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3944101c60 0x7f39441135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.42:56168/0 (socket says 172.21.15.42:56168) 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f394a59b640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3944107ff0 0x7f3944112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f3949d9a640 1 -- 172.21.15.42:0/4237444080 learned_addr learned my addr 172.21.15.42:0/4237444080 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f394bffe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3944111200 con 0x7f3944101c60 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f394bffe640 1 -- 172.21.15.42:0/4237444080 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f3944111500 con 0x7f3944107ff0 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f3949d9a640 1 -- 172.21.15.42:0/4237444080 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3944107ff0 msgr2=0x7f3944112080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f3949d9a640 1 --2- 172.21.15.42:0/4237444080 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3944107ff0 0x7f3944112080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f3949d9a640 1 -- 172.21.15.42:0/4237444080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3944107670 msgr2=0x7f3944111ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f3949d9a640 1 --2- 172.21.15.42:0/4237444080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3944107670 0x7f3944111ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f3949d9a640 1 -- 172.21.15.42:0/4237444080 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39441a6e80 con 0x7f3944101c60 2024-09-21T17:45:57.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f3949599640 1 --2- 172.21.15.42:0/4237444080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3944107670 0x7f3944111ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T17:45:57.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.740+0000 7f394a59b640 1 --2- 172.21.15.42:0/4237444080 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3944107ff0 0x7f3944112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:57.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.741+0000 7f3949d9a640 1 --2- 172.21.15.42:0/4237444080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3944101c60 0x7f39441135d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f394000e9c0 tx=0x7f394000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:57.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.741+0000 7f393affd640 1 -- 172.21.15.42:0/4237444080 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394000ccc0 con 0x7f3944101c60 2024-09-21T17:45:57.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.741+0000 7f393affd640 1 -- 172.21.15.42:0/4237444080 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f39400054a0 con 0x7f3944101c60 2024-09-21T17:45:57.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.741+0000 7f394bffe640 1 -- 172.21.15.42:0/4237444080 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39441a7050 con 0x7f3944101c60 2024-09-21T17:45:57.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.742+0000 7f394bffe640 1 -- 172.21.15.42:0/4237444080 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39441a74f0 con 0x7f3944101c60 2024-09-21T17:45:57.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.742+0000 7f393affd640 1 -- 172.21.15.42:0/4237444080 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940010430 con 0x7f3944101c60 2024-09-21T17:45:57.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.743+0000 7f394bffe640 1 -- 172.21.15.42:0/4237444080 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39440fe750 con 0x7f3944101c60 2024-09-21T17:45:57.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.744+0000 7f393affd640 1 -- 172.21.15.42:0/4237444080 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 20) ==== 102915+0+0 (secure 0 0 0) 0x7f39400046c0 con 0x7f3944101c60 2024-09-21T17:45:57.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.745+0000 7f393affd640 1 -- 172.21.15.42:0/4237444080 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7f394009e1b0 con 0x7f3944101c60 2024-09-21T17:45:57.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.745+0000 7f393affd640 1 --2- 172.21.15.42:0/4237444080 >> v2:172.21.15.162:6808/1056184078 conn(0x7f3930081a70 0x7f3930083eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:57.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.745+0000 7f393affd640 1 -- 172.21.15.42:0/4237444080 --> v2:172.21.15.162:6808/1056184078 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3940011e50 con 0x7f3930081a70 2024-09-21T17:45:57.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.745+0000 7f393affd640 1 -- 172.21.15.42:0/4237444080 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f39400a5050 con 0x7f3944101c60 2024-09-21T17:45:57.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.745+0000 7f3949599640 1 --2- 172.21.15.42:0/4237444080 >> v2:172.21.15.162:6808/1056184078 conn(0x7f3930081a70 0x7f3930083eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:57.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.746+0000 7f3949599640 1 --2- 172.21.15.42:0/4237444080 >> v2:172.21.15.162:6808/1056184078 conn(0x7f3930081a70 0x7f3930083eb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:57.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.747+0000 7f393affd640 1 -- 172.21.15.42:0/4237444080 <== osd.6 v2:172.21.15.162:6808/1056184078 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3940011e50 con 0x7f3930081a70 2024-09-21T17:45:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.772+0000 7f394bffe640 1 -- 172.21.15.42:0/4237444080 --> v2:172.21.15.162:6808/1056184078 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3944102f10 con 0x7f3930081a70 2024-09-21T17:45:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.773+0000 7f393affd640 1 -- 172.21.15.42:0/4237444080 <== osd.6 v2:172.21.15.162:6808/1056184078 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3944102f10 con 0x7f3930081a70 2024-09-21T17:45:57.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.773+0000 7f394bffe640 1 -- 172.21.15.42:0/4237444080 >> v2:172.21.15.162:6808/1056184078 conn(0x7f3930081a70 msgr2=0x7f3930083eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.773+0000 7f394bffe640 1 --2- 172.21.15.42:0/4237444080 >> v2:172.21.15.162:6808/1056184078 conn(0x7f3930081a70 0x7f3930083eb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.773+0000 7f394bffe640 1 -- 172.21.15.42:0/4237444080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3944101c60 msgr2=0x7f39441135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:57.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.773+0000 7f394bffe640 1 --2- 172.21.15.42:0/4237444080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3944101c60 0x7f39441135d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f394000e9c0 tx=0x7f394000ee80 comp rx=0 tx=0).stop 2024-09-21T17:45:57.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.774+0000 7f394bffe640 1 -- 172.21.15.42:0/4237444080 shutdown_connections 2024-09-21T17:45:57.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.774+0000 7f394bffe640 1 --2- 172.21.15.42:0/4237444080 >> v2:172.21.15.162:6808/1056184078 conn(0x7f3930081a70 0x7f3930083eb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.774+0000 7f394bffe640 1 --2- 172.21.15.42:0/4237444080 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3944107ff0 0x7f3944112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.774+0000 7f394bffe640 1 --2- 172.21.15.42:0/4237444080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3944107670 0x7f3944111ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.774+0000 7f394bffe640 1 --2- 172.21.15.42:0/4237444080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3944101c60 0x7f39441135d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:57.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.774+0000 7f394bffe640 1 -- 172.21.15.42:0/4237444080 >> 172.21.15.42:0/4237444080 conn(0x7f39440fd6d0 msgr2=0x7f39440fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:57.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.774+0000 7f394bffe640 1 -- 172.21.15.42:0/4237444080 shutdown_connections 2024-09-21T17:45:57.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:57.774+0000 7f394bffe640 1 -- 172.21.15.42:0/4237444080 wait complete. 2024-09-21T17:45:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: mgrmap e19: y(active, since 4m), standbys: x 2024-09-21T17:45:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: Active manager daemon y restarted 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: Activating manager daemon y 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: osdmap e62: 8 total, 8 up, 8 in 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: mgrmap e20: y(active, starting, since 0.0100526s), standbys: x 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T17:45:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T17:45:57.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T17:45:57.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T17:45:57.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T17:45:57.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T17:45:57.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T17:45:57.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T17:45:57.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:57 smithi162 ceph-mon[32106]: Manager daemon y is now available 2024-09-21T17:45:58.392 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:45:58] ENGINE Bus STARTING 2024-09-21T17:45:58.393 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: CherryPy Checker: 2024-09-21T17:45:58.393 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: The Application mounted at '' has an empty config. 2024-09-21T17:45:58.393 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: 2024-09-21T17:45:58.393 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:45:58] ENGINE Serving on http://:::9283 2024-09-21T17:45:58.600 INFO:teuthology.orchestra.run.smithi042.stdout:206158430215 2024-09-21T17:45:58.600 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T17:45:58.665 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:45:58] ENGINE Bus STARTED 2024-09-21T17:45:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:45:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:45:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:45:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T17:45:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T17:45:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[29361]: mgrmap e21: y(active, since 1.01413s), standbys: x 2024-09-21T17:45:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:45:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[29361]: pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:58.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:58.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:45:58.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:45:58.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:45:58.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T17:45:58.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T17:45:58.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[38309]: mgrmap e21: y(active, since 1.01413s), standbys: x 2024-09-21T17:45:58.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:45:58.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:45:58 smithi042 ceph-mon[38309]: pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:58.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:45:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:45:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:45:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:45:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:45:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:45:58.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T17:45:58.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T17:45:58.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:58 smithi162 ceph-mon[32106]: mgrmap e21: y(active, since 1.01413s), standbys: x 2024-09-21T17:45:58.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:58 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:45:58.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:45:58 smithi162 ceph-mon[32106]: pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:45:59.483 INFO:teuthology.orchestra.run.smithi042.stdout:128849018903 2024-09-21T17:45:59.484 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T17:45:59.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.667+0000 7fac99746640 1 -- 172.21.15.42:0/406969799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac94107ff0 msgr2=0x7fac9410e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:59.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.667+0000 7fac99746640 1 --2- 172.21.15.42:0/406969799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac94107ff0 0x7fac9410e7f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009be0 tx=0x7fac8c02a6c0 comp rx=0 tx=0).stop 2024-09-21T17:45:59.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.667+0000 7fac99746640 1 -- 172.21.15.42:0/406969799 shutdown_connections 2024-09-21T17:45:59.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.667+0000 7fac99746640 1 --2- 172.21.15.42:0/406969799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac94107ff0 0x7fac9410e7f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:59.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.667+0000 7fac99746640 1 --2- 172.21.15.42:0/406969799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac94107670 0x7fac94107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:59.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.667+0000 7fac99746640 1 --2- 172.21.15.42:0/406969799 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fac94101c60 0x7fac94102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:59.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.667+0000 7fac99746640 1 -- 172.21.15.42:0/406969799 >> 172.21.15.42:0/406969799 conn(0x7fac940fd6d0 msgr2=0x7fac940ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:59.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.667+0000 7fac99746640 1 -- 172.21.15.42:0/406969799 shutdown_connections 2024-09-21T17:45:59.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.667+0000 7fac99746640 1 -- 172.21.15.42:0/406969799 wait complete. 2024-09-21T17:45:59.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac99746640 1 Processor -- start 2024-09-21T17:45:59.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac99746640 1 -- start start 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac99746640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac94101c60 0x7fac94199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac99746640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac94107670 0x7fac94199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac99746640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fac94107ff0 0x7fac9419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac99746640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fac94111380 con 0x7fac94107670 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac99746640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac94111200 con 0x7fac94101c60 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac99746640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fac94111500 con 0x7fac94107ff0 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac937fe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fac94107ff0 0x7fac9419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac937fe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fac94107ff0 0x7fac9419a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:60010/0 (socket says 172.21.15.42:60010) 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac937fe640 1 -- 172.21.15.42:0/2880715296 learned_addr learned my addr 172.21.15.42:0/2880715296 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac92ffd640 1 --2- 172.21.15.42:0/2880715296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac94101c60 0x7fac94199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.668+0000 7fac8bfff640 1 --2- 172.21.15.42:0/2880715296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac94107670 0x7fac94199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac937fe640 1 -- 172.21.15.42:0/2880715296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac94101c60 msgr2=0x7fac94199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac937fe640 1 --2- 172.21.15.42:0/2880715296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac94101c60 0x7fac94199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac937fe640 1 -- 172.21.15.42:0/2880715296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac94107670 msgr2=0x7fac94199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac937fe640 1 --2- 172.21.15.42:0/2880715296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac94107670 0x7fac94199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac937fe640 1 -- 172.21.15.42:0/2880715296 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac941a4b20 con 0x7fac94107ff0 2024-09-21T17:45:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac92ffd640 1 --2- 172.21.15.42:0/2880715296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac94101c60 0x7fac94199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:45:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac937fe640 1 --2- 172.21.15.42:0/2880715296 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fac94107ff0 0x7fac9419a1e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac8c004af0 tx=0x7fac8c030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac90ff9640 1 -- 172.21.15.42:0/2880715296 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c041020 con 0x7fac94107ff0 2024-09-21T17:45:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac90ff9640 1 -- 172.21.15.42:0/2880715296 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fac8c003970 con 0x7fac94107ff0 2024-09-21T17:45:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac99746640 1 -- 172.21.15.42:0/2880715296 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac941a4db0 con 0x7fac94107ff0 2024-09-21T17:45:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac99746640 1 -- 172.21.15.42:0/2880715296 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac941a5250 con 0x7fac94107ff0 2024-09-21T17:45:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.669+0000 7fac90ff9640 1 -- 172.21.15.42:0/2880715296 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c036040 con 0x7fac94107ff0 2024-09-21T17:45:59.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.670+0000 7fac99746640 1 -- 172.21.15.42:0/2880715296 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac94063860 con 0x7fac94107ff0 2024-09-21T17:45:59.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.671+0000 7fac90ff9640 1 -- 172.21.15.42:0/2880715296 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 22) ==== 103199+0+0 (secure 0 0 0) 0x7fac8c044020 con 0x7fac94107ff0 2024-09-21T17:45:59.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.672+0000 7fac90ff9640 1 --2- 172.21.15.42:0/2880715296 >> v2:172.21.15.42:6800/36970769 conn(0x7fac8007b080 0x7fac8007d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:59.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.672+0000 7fac90ff9640 1 -- 172.21.15.42:0/2880715296 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7fac8c0bf140 con 0x7fac94107ff0 2024-09-21T17:45:59.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.672+0000 7fac92ffd640 1 --2- 172.21.15.42:0/2880715296 >> v2:172.21.15.42:6800/36970769 conn(0x7fac8007b080 0x7fac8007d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:59.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.672+0000 7fac90ff9640 1 --2- 172.21.15.42:0/2880715296 >> v2:172.21.15.42:6809/429996625 conn(0x7fac800849a0 0x7fac80086de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:45:59.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.672+0000 7fac90ff9640 1 -- 172.21.15.42:0/2880715296 --> v2:172.21.15.42:6809/429996625 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac8c03ee80 con 0x7fac800849a0 2024-09-21T17:45:59.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.672+0000 7fac90ff9640 1 -- 172.21.15.42:0/2880715296 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fac8c0bf570 con 0x7fac94107ff0 2024-09-21T17:45:59.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.672+0000 7fac8bfff640 1 --2- 172.21.15.42:0/2880715296 >> v2:172.21.15.42:6809/429996625 conn(0x7fac800849a0 0x7fac80086de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:45:59.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.672+0000 7fac92ffd640 1 --2- 172.21.15.42:0/2880715296 >> v2:172.21.15.42:6800/36970769 conn(0x7fac8007b080 0x7fac8007d540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fac840096c0 tx=0x7fac84009260 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:59.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.673+0000 7fac8bfff640 1 --2- 172.21.15.42:0/2880715296 >> v2:172.21.15.42:6809/429996625 conn(0x7fac800849a0 0x7fac80086de0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:45:59.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.673+0000 7fac90ff9640 1 -- 172.21.15.42:0/2880715296 <== osd.2 v2:172.21.15.42:6809/429996625 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac8c03ee80 con 0x7fac800849a0 2024-09-21T17:45:59.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.688+0000 7fac99746640 1 -- 172.21.15.42:0/2880715296 --> v2:172.21.15.42:6809/429996625 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac94063c60 con 0x7fac800849a0 2024-09-21T17:45:59.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.688+0000 7fac90ff9640 1 -- 172.21.15.42:0/2880715296 <== osd.2 v2:172.21.15.42:6809/429996625 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fac94063c60 con 0x7fac800849a0 2024-09-21T17:45:59.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.689+0000 7fac99746640 1 -- 172.21.15.42:0/2880715296 >> v2:172.21.15.42:6809/429996625 conn(0x7fac800849a0 msgr2=0x7fac80086de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:59.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.689+0000 7fac99746640 1 --2- 172.21.15.42:0/2880715296 >> v2:172.21.15.42:6809/429996625 conn(0x7fac800849a0 0x7fac80086de0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:45:59.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.689+0000 7fac99746640 1 -- 172.21.15.42:0/2880715296 >> v2:172.21.15.42:6800/36970769 conn(0x7fac8007b080 msgr2=0x7fac8007d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:59.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.689+0000 7fac99746640 1 --2- 172.21.15.42:0/2880715296 >> v2:172.21.15.42:6800/36970769 conn(0x7fac8007b080 0x7fac8007d540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fac840096c0 tx=0x7fac84009260 comp rx=0 tx=0).stop 2024-09-21T17:45:59.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.689+0000 7fac99746640 1 -- 172.21.15.42:0/2880715296 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fac94107ff0 msgr2=0x7fac9419a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:45:59.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.689+0000 7fac99746640 1 --2- 172.21.15.42:0/2880715296 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fac94107ff0 0x7fac9419a1e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac8c004af0 tx=0x7fac8c030650 comp rx=0 tx=0).stop 2024-09-21T17:45:59.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.689+0000 7fac937fe640 1 -- 172.21.15.42:0/2880715296 reap_dead start 2024-09-21T17:45:59.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.689+0000 7fac99746640 1 -- 172.21.15.42:0/2880715296 shutdown_connections 2024-09-21T17:45:59.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.689+0000 7fac99746640 1 -- 172.21.15.42:0/2880715296 >> 172.21.15.42:0/2880715296 conn(0x7fac940fd6d0 msgr2=0x7fac940ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:45:59.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.689+0000 7fac99746640 1 -- 172.21.15.42:0/2880715296 shutdown_connections 2024-09-21T17:45:59.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:45:59.689+0000 7fac99746640 1 -- 172.21.15.42:0/2880715296 wait complete. 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: 2024-09-21T17:45:59.463+0000 7f2dba4f5640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:17:45:59] ENGINE Error in HTTPServer.serve 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: Traceback (most recent call last): 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self._connections.run(self.expiration_interval) 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self._run(expiration_interval) 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T17:45:59.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: s = self.context.wrap_socket( 2024-09-21T17:45:59.916 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T17:45:59.916 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: return self.sslsocket_class._create( 2024-09-21T17:45:59.916 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T17:45:59.916 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self.do_handshake() 2024-09-21T17:45:59.916 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T17:45:59.916 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: self._sslobj.do_handshake() 2024-09-21T17:45:59.916 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T17:45:59.916 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:45:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: 2024-09-21T17:46:00.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:00 smithi162 ceph-mon[32106]: [21/Sep/2024:17:45:59] ENGINE Bus STARTING 2024-09-21T17:46:00.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:00 smithi162 ceph-mon[32106]: [21/Sep/2024:17:45:59] ENGINE Serving on http://172.21.15.42:8765 2024-09-21T17:46:00.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:00 smithi162 ceph-mon[32106]: [21/Sep/2024:17:45:59] ENGINE Serving on https://172.21.15.42:7150 2024-09-21T17:46:00.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:00 smithi162 ceph-mon[32106]: [21/Sep/2024:17:45:59] ENGINE Bus STARTED 2024-09-21T17:46:00.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:00 smithi162 ceph-mon[32106]: [21/Sep/2024:17:45:59] ENGINE Error in HTTPServer.serve 2024-09-21T17:46:00.325 INFO:journalctl@ceph.mon.b.smithi162.stdout: Traceback (most recent call last): 2024-09-21T17:46:00.325 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T17:46:00.325 INFO:journalctl@ceph.mon.b.smithi162.stdout: self._connections.run(self.expiration_interval) 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: self._run(expiration_interval) 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: s = self.context.wrap_socket( 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: return self.sslsocket_class._create( 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: self.do_handshake() 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T17:46:00.326 INFO:journalctl@ceph.mon.b.smithi162.stdout: self._sslobj.do_handshake() 2024-09-21T17:46:00.327 INFO:journalctl@ceph.mon.b.smithi162.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T17:46:00.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:00 smithi162 ceph-mon[32106]: mgrmap e22: y(active, since 2s), standbys: x 2024-09-21T17:46:00.336 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[29361]: [21/Sep/2024:17:45:59] ENGINE Bus STARTING 2024-09-21T17:46:00.336 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[29361]: [21/Sep/2024:17:45:59] ENGINE Serving on http://172.21.15.42:8765 2024-09-21T17:46:00.336 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[29361]: [21/Sep/2024:17:45:59] ENGINE Serving on https://172.21.15.42:7150 2024-09-21T17:46:00.336 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[29361]: [21/Sep/2024:17:45:59] ENGINE Bus STARTED 2024-09-21T17:46:00.336 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[29361]: [21/Sep/2024:17:45:59] ENGINE Error in HTTPServer.serve 2024-09-21T17:46:00.336 INFO:journalctl@ceph.mon.a.smithi042.stdout: Traceback (most recent call last): 2024-09-21T17:46:00.336 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T17:46:00.336 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._connections.run(self.expiration_interval) 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._run(expiration_interval) 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: s = self.context.wrap_socket( 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: return self.sslsocket_class._create( 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: self.do_handshake() 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T17:46:00.337 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._sslobj.do_handshake() 2024-09-21T17:46:00.338 INFO:journalctl@ceph.mon.a.smithi042.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T17:46:00.338 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[29361]: mgrmap e22: y(active, since 2s), standbys: x 2024-09-21T17:46:00.338 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[38309]: [21/Sep/2024:17:45:59] ENGINE Bus STARTING 2024-09-21T17:46:00.338 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[38309]: [21/Sep/2024:17:45:59] ENGINE Serving on http://172.21.15.42:8765 2024-09-21T17:46:00.338 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[38309]: [21/Sep/2024:17:45:59] ENGINE Serving on https://172.21.15.42:7150 2024-09-21T17:46:00.338 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[38309]: [21/Sep/2024:17:45:59] ENGINE Bus STARTED 2024-09-21T17:46:00.338 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[38309]: [21/Sep/2024:17:45:59] ENGINE Error in HTTPServer.serve 2024-09-21T17:46:00.338 INFO:journalctl@ceph.mon.c.smithi042.stdout: Traceback (most recent call last): 2024-09-21T17:46:00.338 INFO:journalctl@ceph.mon.c.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: self._connections.run(self.expiration_interval) 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: self._run(expiration_interval) 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: s = self.context.wrap_socket( 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: return self.sslsocket_class._create( 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: self.do_handshake() 2024-09-21T17:46:00.339 INFO:journalctl@ceph.mon.c.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T17:46:00.340 INFO:journalctl@ceph.mon.c.smithi042.stdout: self._sslobj.do_handshake() 2024-09-21T17:46:00.340 INFO:journalctl@ceph.mon.c.smithi042.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T17:46:00.340 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:00 smithi042 ceph-mon[38309]: mgrmap e22: y(active, since 2s), standbys: x 2024-09-21T17:46:00.368 INFO:teuthology.orchestra.run.smithi042.stdout:77309411363 2024-09-21T17:46:00.368 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T17:46:00.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.544+0000 7fedaa8db640 1 -- 172.21.15.42:0/122802887 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feda4102d60 msgr2=0x7feda4103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:00.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.544+0000 7fedaa8db640 1 --2- 172.21.15.42:0/122802887 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feda4102d60 0x7feda4103140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed94009900 tx=0x7fed9402a3f0 comp rx=0 tx=0).stop 2024-09-21T17:46:00.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.544+0000 7fedaa8db640 1 -- 172.21.15.42:0/122802887 shutdown_connections 2024-09-21T17:46:00.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.544+0000 7fedaa8db640 1 --2- 172.21.15.42:0/122802887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feda41090f0 0x7feda410f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:00.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.544+0000 7fedaa8db640 1 --2- 172.21.15.42:0/122802887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4108770 0x7feda4108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:00.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.544+0000 7fedaa8db640 1 --2- 172.21.15.42:0/122802887 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feda4102d60 0x7feda4103140 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:00.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.544+0000 7fedaa8db640 1 -- 172.21.15.42:0/122802887 >> 172.21.15.42:0/122802887 conn(0x7feda40fe810 msgr2=0x7feda4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:00.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.544+0000 7fedaa8db640 1 -- 172.21.15.42:0/122802887 shutdown_connections 2024-09-21T17:46:00.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.544+0000 7fedaa8db640 1 -- 172.21.15.42:0/122802887 wait complete. 2024-09-21T17:46:00.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7fedaa8db640 1 Processor -- start 2024-09-21T17:46:00.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7fedaa8db640 1 -- start start 2024-09-21T17:46:00.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7fedaa8db640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4102d60 0x7feda4198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:00.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7fedaa8db640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feda4108770 0x7feda4198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:00.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7fedaa8db640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feda41090f0 0x7feda419e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:00.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7fedaa8db640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feda41124c0 con 0x7feda4108770 2024-09-21T17:46:00.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7fedaa8db640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feda4112340 con 0x7feda4102d60 2024-09-21T17:46:00.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7fedaa8db640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7feda4112640 con 0x7feda41090f0 2024-09-21T17:46:00.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7feda37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feda4108770 0x7feda4198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:00.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7feda8e78640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feda41090f0 0x7feda419e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:00.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7feda37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feda4108770 0x7feda4198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47030/0 (socket says 172.21.15.42:47030) 2024-09-21T17:46:00.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7feda37fe640 1 -- 172.21.15.42:0/949320995 learned_addr learned my addr 172.21.15.42:0/949320995 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:00.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.545+0000 7feda3fff640 1 --2- 172.21.15.42:0/949320995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4102d60 0x7feda4198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:00.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7feda37fe640 1 -- 172.21.15.42:0/949320995 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feda41090f0 msgr2=0x7feda419e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:00.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7feda37fe640 1 --2- 172.21.15.42:0/949320995 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feda41090f0 0x7feda419e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:00.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7feda37fe640 1 -- 172.21.15.42:0/949320995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4102d60 msgr2=0x7feda4198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:00.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7feda37fe640 1 --2- 172.21.15.42:0/949320995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4102d60 0x7feda4198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:00.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7feda37fe640 1 -- 172.21.15.42:0/949320995 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda419e9f0 con 0x7feda4108770 2024-09-21T17:46:00.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7feda8e78640 1 --2- 172.21.15.42:0/949320995 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feda41090f0 0x7feda419e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7feda37fe640 1 --2- 172.21.15.42:0/949320995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feda4108770 0x7feda4198e80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fed9800d950 tx=0x7fed9800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7feda17fa640 1 -- 172.21.15.42:0/949320995 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98017030 con 0x7feda4108770 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7fedaa8db640 1 -- 172.21.15.42:0/949320995 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda419ece0 con 0x7feda4108770 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7feda17fa640 1 -- 172.21.15.42:0/949320995 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fed98004020 con 0x7feda4108770 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7feda17fa640 1 -- 172.21.15.42:0/949320995 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98005470 con 0x7feda4108770 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.546+0000 7fedaa8db640 1 -- 172.21.15.42:0/949320995 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda41a5570 con 0x7feda4108770 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.547+0000 7fedaa8db640 1 -- 172.21.15.42:0/949320995 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feda4063820 con 0x7feda4108770 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.548+0000 7feda17fa640 1 -- 172.21.15.42:0/949320995 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 22) ==== 103199+0+0 (secure 0 0 0) 0x7fed98009a30 con 0x7feda4108770 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.549+0000 7feda17fa640 1 --2- 172.21.15.42:0/949320995 >> v2:172.21.15.42:6800/36970769 conn(0x7fed8c07b080 0x7fed8c07d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.549+0000 7feda17fa640 1 -- 172.21.15.42:0/949320995 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7fed9809e0c0 con 0x7feda4108770 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.549+0000 7feda3fff640 1 --2- 172.21.15.42:0/949320995 >> v2:172.21.15.42:6800/36970769 conn(0x7fed8c07b080 0x7fed8c07d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.549+0000 7feda17fa640 1 --2- 172.21.15.42:0/949320995 >> v2:172.21.15.42:6813/2988176462 conn(0x7fed8c0849a0 0x7fed8c086de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:00.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.549+0000 7feda17fa640 1 -- 172.21.15.42:0/949320995 --> v2:172.21.15.42:6813/2988176462 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed98022e50 con 0x7fed8c0849a0 2024-09-21T17:46:00.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.549+0000 7feda17fa640 1 -- 172.21.15.42:0/949320995 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fed9809e550 con 0x7feda4108770 2024-09-21T17:46:00.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.549+0000 7feda8e78640 1 --2- 172.21.15.42:0/949320995 >> v2:172.21.15.42:6813/2988176462 conn(0x7fed8c0849a0 0x7fed8c086de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:00.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.549+0000 7feda3fff640 1 --2- 172.21.15.42:0/949320995 >> v2:172.21.15.42:6800/36970769 conn(0x7fed8c07b080 0x7fed8c07d540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fed94031440 tx=0x7fed94005b50 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:00.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.549+0000 7feda8e78640 1 --2- 172.21.15.42:0/949320995 >> v2:172.21.15.42:6813/2988176462 conn(0x7fed8c0849a0 0x7fed8c086de0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:00.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.550+0000 7feda17fa640 1 -- 172.21.15.42:0/949320995 <== osd.3 v2:172.21.15.42:6813/2988176462 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed98022e50 con 0x7fed8c0849a0 2024-09-21T17:46:00.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.565+0000 7fedaa8db640 1 -- 172.21.15.42:0/949320995 --> v2:172.21.15.42:6813/2988176462 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feda4063c20 con 0x7fed8c0849a0 2024-09-21T17:46:00.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.565+0000 7feda17fa640 1 -- 172.21.15.42:0/949320995 <== osd.3 v2:172.21.15.42:6813/2988176462 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feda4063c20 con 0x7fed8c0849a0 2024-09-21T17:46:00.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.566+0000 7fedaa8db640 1 -- 172.21.15.42:0/949320995 >> v2:172.21.15.42:6813/2988176462 conn(0x7fed8c0849a0 msgr2=0x7fed8c086de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:00.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.566+0000 7fedaa8db640 1 --2- 172.21.15.42:0/949320995 >> v2:172.21.15.42:6813/2988176462 conn(0x7fed8c0849a0 0x7fed8c086de0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:00.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.566+0000 7fedaa8db640 1 -- 172.21.15.42:0/949320995 >> v2:172.21.15.42:6800/36970769 conn(0x7fed8c07b080 msgr2=0x7fed8c07d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:00.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.566+0000 7fedaa8db640 1 --2- 172.21.15.42:0/949320995 >> v2:172.21.15.42:6800/36970769 conn(0x7fed8c07b080 0x7fed8c07d540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fed94031440 tx=0x7fed94005b50 comp rx=0 tx=0).stop 2024-09-21T17:46:00.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.566+0000 7fedaa8db640 1 -- 172.21.15.42:0/949320995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feda4108770 msgr2=0x7feda4198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:00.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.566+0000 7fedaa8db640 1 --2- 172.21.15.42:0/949320995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feda4108770 0x7feda4198e80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fed9800d950 tx=0x7fed9800dd50 comp rx=0 tx=0).stop 2024-09-21T17:46:00.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.566+0000 7feda8e78640 1 -- 172.21.15.42:0/949320995 reap_dead start 2024-09-21T17:46:00.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.566+0000 7fedaa8db640 1 -- 172.21.15.42:0/949320995 shutdown_connections 2024-09-21T17:46:00.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.566+0000 7fedaa8db640 1 -- 172.21.15.42:0/949320995 >> 172.21.15.42:0/949320995 conn(0x7feda40fe810 msgr2=0x7feda41001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:00.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.566+0000 7fedaa8db640 1 -- 172.21.15.42:0/949320995 shutdown_connections 2024-09-21T17:46:00.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:00.566+0000 7fedaa8db640 1 -- 172.21.15.42:0/949320995 wait complete. 2024-09-21T17:46:00.963 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:46:01.449 INFO:teuthology.orchestra.run.smithi042.stdout:180388626445 2024-09-21T17:46:01.450 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T17:46:01.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:01 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:01 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:01 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:01 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:01 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:01 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:01 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:01 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:01 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:01 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:01.995 INFO:teuthology.orchestra.run.smithi042.stdout:107374182430 2024-09-21T17:46:01.995 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T17:46:02.466 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:02 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi162 to 3760M 2024-09-21T17:46:02.467 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:02 smithi042 ceph-mon[29361]: pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:46:02.467 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:02 smithi042 ceph-mon[29361]: mgrmap e23: y(active, since 4s), standbys: x 2024-09-21T17:46:02.467 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:02 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi162 to 3760M 2024-09-21T17:46:02.467 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:02 smithi042 ceph-mon[38309]: pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:46:02.467 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:02 smithi042 ceph-mon[38309]: mgrmap e23: y(active, since 4s), standbys: x 2024-09-21T17:46:02.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.466+0000 7f042cc79640 1 -- 172.21.15.42:0/3049647898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428104580 msgr2=0x7f042810cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:02.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.466+0000 7f042cc79640 1 --2- 172.21.15.42:0/3049647898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428104580 0x7f042810cb60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f041c009900 tx=0x7f041c02a410 comp rx=0 tx=0).stop 2024-09-21T17:46:02.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.466+0000 7f042cc79640 1 -- 172.21.15.42:0/3049647898 shutdown_connections 2024-09-21T17:46:02.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.466+0000 7f042cc79640 1 --2- 172.21.15.42:0/3049647898 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f042810d130 0x7f042810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:02.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.466+0000 7f042cc79640 1 --2- 172.21.15.42:0/3049647898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428104580 0x7f042810cb60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:02.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.466+0000 7f042cc79640 1 --2- 172.21.15.42:0/3049647898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0428103b80 0x7f0428103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:02.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.466+0000 7f042cc79640 1 -- 172.21.15.42:0/3049647898 >> 172.21.15.42:0/3049647898 conn(0x7f04280fd710 msgr2=0x7f04280ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:02.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.466+0000 7f042cc79640 1 -- 172.21.15.42:0/3049647898 shutdown_connections 2024-09-21T17:46:02.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.466+0000 7f042cc79640 1 -- 172.21.15.42:0/3049647898 wait complete. 2024-09-21T17:46:02.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.467+0000 7f042cc79640 1 Processor -- start 2024-09-21T17:46:02.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.467+0000 7f042cc79640 1 -- start start 2024-09-21T17:46:02.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042cc79640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428103b80 0x7f042819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:02.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042cc79640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0428104580 0x7f042819b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:02.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042cc79640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f042810d130 0x7f04281a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:02.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042cc79640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0428112480 con 0x7f0428103b80 2024-09-21T17:46:02.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042cc79640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0428112300 con 0x7f0428104580 2024-09-21T17:46:02.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042cc79640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f0428112600 con 0x7f042810d130 2024-09-21T17:46:02.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428103b80 0x7f042819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:02.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428103b80 0x7f042819ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55704/0 (socket says 172.21.15.42:55704) 2024-09-21T17:46:02.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042659c640 1 -- 172.21.15.42:0/4281314901 learned_addr learned my addr 172.21.15.42:0/4281314901 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:02.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f0426d9d640 1 --2- 172.21.15.42:0/4281314901 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f042810d130 0x7f04281a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:02.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f0425d9b640 1 --2- 172.21.15.42:0/4281314901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0428104580 0x7f042819b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:02.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042659c640 1 -- 172.21.15.42:0/4281314901 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f042810d130 msgr2=0x7f04281a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:02.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042659c640 1 --2- 172.21.15.42:0/4281314901 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f042810d130 0x7f04281a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:02.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042659c640 1 -- 172.21.15.42:0/4281314901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0428104580 msgr2=0x7f042819b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042659c640 1 --2- 172.21.15.42:0/4281314901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0428104580 0x7f042819b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f042659c640 1 -- 172.21.15.42:0/4281314901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04281a0c20 con 0x7f0428103b80 2024-09-21T17:46:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.468+0000 7f0426d9d640 1 --2- 172.21.15.42:0/4281314901 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f042810d130 0x7f04281a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:46:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.469+0000 7f042659c640 1 --2- 172.21.15.42:0/4281314901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428103b80 0x7f042819ab70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f041800d950 tx=0x7f041800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.469+0000 7f04177fe640 1 -- 172.21.15.42:0/4281314901 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418017070 con 0x7f0428103b80 2024-09-21T17:46:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.469+0000 7f042cc79640 1 -- 172.21.15.42:0/4281314901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04281a0f10 con 0x7f0428103b80 2024-09-21T17:46:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.469+0000 7f04177fe640 1 -- 172.21.15.42:0/4281314901 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f0418009c30 con 0x7f0428103b80 2024-09-21T17:46:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.469+0000 7f042cc79640 1 -- 172.21.15.42:0/4281314901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04281a77a0 con 0x7f0428103b80 2024-09-21T17:46:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.469+0000 7f04177fe640 1 -- 172.21.15.42:0/4281314901 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041800f620 con 0x7f0428103b80 2024-09-21T17:46:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.470+0000 7f042cc79640 1 -- 172.21.15.42:0/4281314901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04080050b0 con 0x7f0428103b80 2024-09-21T17:46:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.471+0000 7f04177fe640 1 -- 172.21.15.42:0/4281314901 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f041800f7c0 con 0x7f0428103b80 2024-09-21T17:46:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.471+0000 7f04177fe640 1 --2- 172.21.15.42:0/4281314901 >> v2:172.21.15.42:6800/36970769 conn(0x7f041007b110 0x7f041007d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.471+0000 7f04177fe640 1 -- 172.21.15.42:0/4281314901 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7f041809dc90 con 0x7f0428103b80 2024-09-21T17:46:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.471+0000 7f0425d9b640 1 --2- 172.21.15.42:0/4281314901 >> v2:172.21.15.42:6800/36970769 conn(0x7f041007b110 0x7f041007d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.472+0000 7f0425d9b640 1 --2- 172.21.15.42:0/4281314901 >> v2:172.21.15.42:6800/36970769 conn(0x7f041007b110 0x7f041007d5d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f041c031440 tx=0x7f041c005b50 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:02.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.476+0000 7f04177fe640 1 -- 172.21.15.42:0/4281314901 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f041806a380 con 0x7f0428103b80 2024-09-21T17:46:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:02 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi162 to 3760M 2024-09-21T17:46:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:02 smithi162 ceph-mon[32106]: pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:46:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:02 smithi162 ceph-mon[32106]: mgrmap e23: y(active, since 4s), standbys: x 2024-09-21T17:46:02.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.668+0000 7f042cc79640 1 -- 172.21.15.42:0/4281314901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0408005670 con 0x7f0428103b80 2024-09-21T17:46:02.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.668+0000 7f04177fe640 1 -- 172.21.15.42:0/4281314901 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f041806f230 con 0x7f0428103b80 2024-09-21T17:46:02.671 INFO:teuthology.orchestra.run.smithi042.stdout:34359738411 2024-09-21T17:46:02.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 -- 172.21.15.42:0/4281314901 >> v2:172.21.15.42:6800/36970769 conn(0x7f041007b110 msgr2=0x7f041007d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:02.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 --2- 172.21.15.42:0/4281314901 >> v2:172.21.15.42:6800/36970769 conn(0x7f041007b110 0x7f041007d5d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f041c031440 tx=0x7f041c005b50 comp rx=0 tx=0).stop 2024-09-21T17:46:02.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 -- 172.21.15.42:0/4281314901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428103b80 msgr2=0x7f042819ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:02.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 --2- 172.21.15.42:0/4281314901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428103b80 0x7f042819ab70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f041800d950 tx=0x7f041800de10 comp rx=0 tx=0).stop 2024-09-21T17:46:02.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 -- 172.21.15.42:0/4281314901 shutdown_connections 2024-09-21T17:46:02.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 --2- 172.21.15.42:0/4281314901 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f042810d130 0x7f04281a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:02.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 --2- 172.21.15.42:0/4281314901 >> v2:172.21.15.42:6800/36970769 conn(0x7f041007b110 0x7f041007d5d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:02.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 --2- 172.21.15.42:0/4281314901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0428104580 0x7f042819b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:02.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 --2- 172.21.15.42:0/4281314901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428103b80 0x7f042819ab70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:02.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 -- 172.21.15.42:0/4281314901 >> 172.21.15.42:0/4281314901 conn(0x7f04280fd710 msgr2=0x7f04280fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:02.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 -- 172.21.15.42:0/4281314901 shutdown_connections 2024-09-21T17:46:02.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:02.671+0000 7f042cc79640 1 -- 172.21.15.42:0/4281314901 wait complete. 2024-09-21T17:46:02.965 INFO:teuthology.orchestra.run.smithi042.stdout:55834574886 2024-09-21T17:46:02.965 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T17:46:03.344 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:46:03.348 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:46:03.350 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:46:03.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4281314901' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T17:46:03.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4281314901' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T17:46:03.816 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:46:03.816 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:46:03.816 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:46:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4281314901' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T17:46:03.864 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738410 got 34359738411 for osd.0 2024-09-21T17:46:03.864 DEBUG:teuthology.parallel:result is None 2024-09-21T17:46:03.865 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:46:04.125 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:46:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:46:04.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:04 smithi042 ceph-mon[29361]: pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:46:04.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:04 smithi042 ceph-mon[38309]: pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:46:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:04 smithi162 ceph-mon[32106]: pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:46:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.956+0000 7f3645d58640 1 -- 172.21.15.42:0/3362385921 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f364010d110 msgr2=0x7f364010f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.956+0000 7f3645d58640 1 --2- 172.21.15.42:0/3362385921 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f364010d110 0x7f364010f570 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3638009ca0 tx=0x7f363802a8c0 comp rx=0 tx=0).stop 2024-09-21T17:46:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.956+0000 7f3645d58640 1 -- 172.21.15.42:0/3362385921 shutdown_connections 2024-09-21T17:46:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.956+0000 7f3645d58640 1 --2- 172.21.15.42:0/3362385921 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f364010d110 0x7f364010f570 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.956+0000 7f3645d58640 1 --2- 172.21.15.42:0/3362385921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36401045d0 0x7f364010cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.956+0000 7f3645d58640 1 --2- 172.21.15.42:0/3362385921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3640103cb0 0x7f3640104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.956+0000 7f3645d58640 1 -- 172.21.15.42:0/3362385921 >> 172.21.15.42:0/3362385921 conn(0x7f36400fd710 msgr2=0x7f36400ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:04.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.956+0000 7f3645d58640 1 -- 172.21.15.42:0/3362385921 shutdown_connections 2024-09-21T17:46:04.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.956+0000 7f3645d58640 1 -- 172.21.15.42:0/3362385921 wait complete. 2024-09-21T17:46:04.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.956+0000 7f3645d58640 1 Processor -- start 2024-09-21T17:46:04.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.956+0000 7f3645d58640 1 -- start start 2024-09-21T17:46:04.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f3645d58640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3640103cb0 0x7f3640198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:04.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f3645d58640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36401045d0 0x7f3640198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:04.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f3645d58640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f364010d110 0x7f364019e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:04.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f3645d58640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f36401124e0 con 0x7f3640103cb0 2024-09-21T17:46:04.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f3645d58640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3640112360 con 0x7f36401045d0 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f3645d58640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f3640112660 con 0x7f364010d110 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3640103cb0 0x7f3640198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363ffff640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f364010d110 0x7f364019e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3640103cb0 0x7f3640198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55724/0 (socket says 172.21.15.42:55724) 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363f7fe640 1 -- 172.21.15.42:0/825283663 learned_addr learned my addr 172.21.15.42:0/825283663 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363effd640 1 --2- 172.21.15.42:0/825283663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36401045d0 0x7f3640198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363f7fe640 1 -- 172.21.15.42:0/825283663 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f364010d110 msgr2=0x7f364019e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363f7fe640 1 --2- 172.21.15.42:0/825283663 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f364010d110 0x7f364019e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363f7fe640 1 -- 172.21.15.42:0/825283663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36401045d0 msgr2=0x7f3640198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363f7fe640 1 --2- 172.21.15.42:0/825283663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36401045d0 0x7f3640198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363f7fe640 1 -- 172.21.15.42:0/825283663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364019e9e0 con 0x7f3640103cb0 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363f7fe640 1 --2- 172.21.15.42:0/825283663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3640103cb0 0x7f3640198930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f363000ea60 tx=0x7f363000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.957+0000 7f363cff9640 1 -- 172.21.15.42:0/825283663 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363000cde0 con 0x7f3640103cb0 2024-09-21T17:46:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.958+0000 7f363cff9640 1 -- 172.21.15.42:0/825283663 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f36300035f0 con 0x7f3640103cb0 2024-09-21T17:46:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.958+0000 7f3645d58640 1 -- 172.21.15.42:0/825283663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364019ecd0 con 0x7f3640103cb0 2024-09-21T17:46:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.958+0000 7f363cff9640 1 -- 172.21.15.42:0/825283663 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36300044a0 con 0x7f3640103cb0 2024-09-21T17:46:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.958+0000 7f3645d58640 1 -- 172.21.15.42:0/825283663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36401a5390 con 0x7f3640103cb0 2024-09-21T17:46:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.959+0000 7f3645d58640 1 -- 172.21.15.42:0/825283663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3640104090 con 0x7f3640103cb0 2024-09-21T17:46:04.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.959+0000 7f363cff9640 1 -- 172.21.15.42:0/825283663 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f3630004000 con 0x7f3640103cb0 2024-09-21T17:46:04.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.960+0000 7f363cff9640 1 --2- 172.21.15.42:0/825283663 >> v2:172.21.15.42:6800/36970769 conn(0x7f362c07b110 0x7f362c07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:04.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.960+0000 7f363effd640 1 --2- 172.21.15.42:0/825283663 >> v2:172.21.15.42:6800/36970769 conn(0x7f362c07b110 0x7f362c07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:04.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.960+0000 7f363cff9640 1 -- 172.21.15.42:0/825283663 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7f363009e610 con 0x7f3640103cb0 2024-09-21T17:46:04.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.960+0000 7f363effd640 1 --2- 172.21.15.42:0/825283663 >> v2:172.21.15.42:6800/36970769 conn(0x7f362c07b110 0x7f362c07d5d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f36400fff90 tx=0x7f362800b2e0 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:04.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:04.965+0000 7f363cff9640 1 -- 172.21.15.42:0/825283663 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f3630069c00 con 0x7f3640103cb0 2024-09-21T17:46:05.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.157+0000 7f3645d58640 1 -- 172.21.15.42:0/825283663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3640108130 con 0x7f3640103cb0 2024-09-21T17:46:05.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.158+0000 7f363cff9640 1 -- 172.21.15.42:0/825283663 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f363006eab0 con 0x7f3640103cb0 2024-09-21T17:46:05.161 INFO:teuthology.orchestra.run.smithi042.stdout:128849018904 2024-09-21T17:46:05.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 -- 172.21.15.42:0/825283663 >> v2:172.21.15.42:6800/36970769 conn(0x7f362c07b110 msgr2=0x7f362c07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:05.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 --2- 172.21.15.42:0/825283663 >> v2:172.21.15.42:6800/36970769 conn(0x7f362c07b110 0x7f362c07d5d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f36400fff90 tx=0x7f362800b2e0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 -- 172.21.15.42:0/825283663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3640103cb0 msgr2=0x7f3640198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:05.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 --2- 172.21.15.42:0/825283663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3640103cb0 0x7f3640198930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f363000ea60 tx=0x7f363000ef20 comp rx=0 tx=0).stop 2024-09-21T17:46:05.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 -- 172.21.15.42:0/825283663 shutdown_connections 2024-09-21T17:46:05.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 --2- 172.21.15.42:0/825283663 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f364010d110 0x7f364019e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 --2- 172.21.15.42:0/825283663 >> v2:172.21.15.42:6800/36970769 conn(0x7f362c07b110 0x7f362c07d5d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 --2- 172.21.15.42:0/825283663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36401045d0 0x7f3640198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 --2- 172.21.15.42:0/825283663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3640103cb0 0x7f3640198930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 -- 172.21.15.42:0/825283663 >> 172.21.15.42:0/825283663 conn(0x7f36400fd710 msgr2=0x7f36400fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:05.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 -- 172.21.15.42:0/825283663 shutdown_connections 2024-09-21T17:46:05.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.160+0000 7f3645d58640 1 -- 172.21.15.42:0/825283663 wait complete. 2024-09-21T17:46:05.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.558+0000 7f852fda1640 1 -- 172.21.15.42:0/677701523 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8528106ee0 msgr2=0x7f8528107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:05.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.558+0000 7f852fda1640 1 --2- 172.21.15.42:0/677701523 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8528106ee0 0x7f8528107390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8520009c10 tx=0x7f852002a6e0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.558+0000 7f852fda1640 1 -- 172.21.15.42:0/677701523 shutdown_connections 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.558+0000 7f852fda1640 1 --2- 172.21.15.42:0/677701523 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8528106ee0 0x7f8528107390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.558+0000 7f852fda1640 1 --2- 172.21.15.42:0/677701523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85281018b0 0x7f85281069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.558+0000 7f852fda1640 1 --2- 172.21.15.42:0/677701523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8528100f90 0x7f8528101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.558+0000 7f852fda1640 1 -- 172.21.15.42:0/677701523 >> 172.21.15.42:0/677701523 conn(0x7f85280fca00 msgr2=0x7f85280fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852fda1640 1 -- 172.21.15.42:0/677701523 shutdown_connections 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852fda1640 1 -- 172.21.15.42:0/677701523 wait complete. 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852fda1640 1 Processor -- start 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852fda1640 1 -- start start 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852fda1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8528100f90 0x7f85280fcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852fda1640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f85281018b0 0x7f85280fd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852fda1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8528106ee0 0x7f85280fd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852fda1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8528111390 con 0x7f8528106ee0 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852fda1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8528111210 con 0x7f8528100f90 2024-09-21T17:46:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852fda1640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f8528111510 con 0x7f85281018b0 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852d33c640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f85281018b0 0x7f85280fd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852e33e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8528106ee0 0x7f85280fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.559+0000 7f852d33c640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f85281018b0 0x7f85280fd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:40070/0 (socket says 172.21.15.42:40070) 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f852d33c640 1 -- 172.21.15.42:0/3898993943 learned_addr learned my addr 172.21.15.42:0/3898993943 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f852db3d640 1 --2- 172.21.15.42:0/3898993943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8528100f90 0x7f85280fcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f852e33e640 1 -- 172.21.15.42:0/3898993943 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f85281018b0 msgr2=0x7f85280fd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f852e33e640 1 --2- 172.21.15.42:0/3898993943 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f85281018b0 0x7f85280fd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f852e33e640 1 -- 172.21.15.42:0/3898993943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8528100f90 msgr2=0x7f85280fcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f852e33e640 1 --2- 172.21.15.42:0/3898993943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8528100f90 0x7f85280fcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f852e33e640 1 -- 172.21.15.42:0/3898993943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85281a6db0 con 0x7f8528106ee0 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f852d33c640 1 --2- 172.21.15.42:0/3898993943 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f85281018b0 0x7f85280fd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f852e33e640 1 --2- 172.21.15.42:0/3898993943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8528106ee0 0x7f85280fd980 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8520034040 tx=0x7f8520030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f851effd640 1 -- 172.21.15.42:0/3898993943 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8520041020 con 0x7f8528106ee0 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f851effd640 1 -- 172.21.15.42:0/3898993943 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f8520003970 con 0x7f8528106ee0 2024-09-21T17:46:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f852fda1640 1 -- 172.21.15.42:0/3898993943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85281a7040 con 0x7f8528106ee0 2024-09-21T17:46:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f851effd640 1 -- 172.21.15.42:0/3898993943 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8520036040 con 0x7f8528106ee0 2024-09-21T17:46:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.560+0000 7f852fda1640 1 -- 172.21.15.42:0/3898993943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85281a7540 con 0x7f8528106ee0 2024-09-21T17:46:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.561+0000 7f852fda1640 1 -- 172.21.15.42:0/3898993943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85281069a0 con 0x7f8528106ee0 2024-09-21T17:46:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.562+0000 7f851effd640 1 -- 172.21.15.42:0/3898993943 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f8520044020 con 0x7f8528106ee0 2024-09-21T17:46:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.562+0000 7f851effd640 1 --2- 172.21.15.42:0/3898993943 >> v2:172.21.15.42:6800/36970769 conn(0x7f851407b110 0x7f851407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.563+0000 7f851effd640 1 -- 172.21.15.42:0/3898993943 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7f85200bef60 con 0x7f8528106ee0 2024-09-21T17:46:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.563+0000 7f852db3d640 1 --2- 172.21.15.42:0/3898993943 >> v2:172.21.15.42:6800/36970769 conn(0x7f851407b110 0x7f851407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.563+0000 7f852db3d640 1 --2- 172.21.15.42:0/3898993943 >> v2:172.21.15.42:6800/36970769 conn(0x7f851407b110 0x7f851407d5d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f852400bbe0 tx=0x7f852400b390 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.567+0000 7f851effd640 1 -- 172.21.15.42:0/3898993943 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f852004b020 con 0x7f8528106ee0 2024-09-21T17:46:05.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:05 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/825283663' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T17:46:05.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:05 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/825283663' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T17:46:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.757+0000 7f852fda1640 1 -- 172.21.15.42:0/3898993943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f85281a77a0 con 0x7f8528106ee0 2024-09-21T17:46:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.758+0000 7f851effd640 1 -- 172.21.15.42:0/3898993943 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f852008a5f0 con 0x7f8528106ee0 2024-09-21T17:46:05.760 INFO:teuthology.orchestra.run.smithi042.stdout:107374182431 2024-09-21T17:46:05.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 -- 172.21.15.42:0/3898993943 >> v2:172.21.15.42:6800/36970769 conn(0x7f851407b110 msgr2=0x7f851407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:05.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 --2- 172.21.15.42:0/3898993943 >> v2:172.21.15.42:6800/36970769 conn(0x7f851407b110 0x7f851407d5d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f852400bbe0 tx=0x7f852400b390 comp rx=0 tx=0).stop 2024-09-21T17:46:05.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 -- 172.21.15.42:0/3898993943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8528106ee0 msgr2=0x7f85280fd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 --2- 172.21.15.42:0/3898993943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8528106ee0 0x7f85280fd980 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8520034040 tx=0x7f8520030650 comp rx=0 tx=0).stop 2024-09-21T17:46:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 -- 172.21.15.42:0/3898993943 shutdown_connections 2024-09-21T17:46:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 --2- 172.21.15.42:0/3898993943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8528106ee0 0x7f85280fd980 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 --2- 172.21.15.42:0/3898993943 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f85281018b0 0x7f85280fd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 --2- 172.21.15.42:0/3898993943 >> v2:172.21.15.42:6800/36970769 conn(0x7f851407b110 0x7f851407d5d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 --2- 172.21.15.42:0/3898993943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8528100f90 0x7f85280fcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 -- 172.21.15.42:0/3898993943 >> 172.21.15.42:0/3898993943 conn(0x7f85280fca00 msgr2=0x7f8528107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 -- 172.21.15.42:0/3898993943 shutdown_connections 2024-09-21T17:46:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.760+0000 7f852fda1640 1 -- 172.21.15.42:0/3898993943 wait complete. 2024-09-21T17:46:05.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.801+0000 7fb5eef48640 1 -- 172.21.15.42:0/1312290645 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5e8107ff0 msgr2=0x7fb5e810e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:05.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.801+0000 7fb5eef48640 1 --2- 172.21.15.42:0/1312290645 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5e8107ff0 0x7fb5e810e7f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009be0 tx=0x7fb5e002a6c0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.801+0000 7fb5eef48640 1 -- 172.21.15.42:0/1312290645 shutdown_connections 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.801+0000 7fb5eef48640 1 --2- 172.21.15.42:0/1312290645 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5e8107ff0 0x7fb5e810e7f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.801+0000 7fb5eef48640 1 --2- 172.21.15.42:0/1312290645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5e8107670 0x7fb5e8107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.801+0000 7fb5eef48640 1 --2- 172.21.15.42:0/1312290645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e8101c60 0x7fb5e8102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.801+0000 7fb5eef48640 1 -- 172.21.15.42:0/1312290645 >> 172.21.15.42:0/1312290645 conn(0x7fb5e80fd6d0 msgr2=0x7fb5e80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.801+0000 7fb5eef48640 1 -- 172.21.15.42:0/1312290645 shutdown_connections 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.801+0000 7fb5eef48640 1 -- 172.21.15.42:0/1312290645 wait complete. 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5eef48640 1 Processor -- start 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5eef48640 1 -- start start 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5eef48640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e8101c60 0x7fb5e81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5eef48640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5e8107670 0x7fb5e8198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5eef48640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5e8107ff0 0x7fb5e819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5eef48640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e8111380 con 0x7fb5e8101c60 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5eef48640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e8111200 con 0x7fb5e8107ff0 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5eef48640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e8111500 con 0x7fb5e8107670 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5ecce4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e8101c60 0x7fb5e81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5e7fff640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5e8107670 0x7fb5e8198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5ecce4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e8101c60 0x7fb5e81988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55760/0 (socket says 172.21.15.42:55760) 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5e7fff640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5e8107670 0x7fb5e8198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:40094/0 (socket says 172.21.15.42:40094) 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5ecce4640 1 -- 172.21.15.42:0/2303605177 learned_addr learned my addr 172.21.15.42:0/2303605177 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5ecce4640 1 -- 172.21.15.42:0/2303605177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5e8107670 msgr2=0x7fb5e8198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5ecce4640 1 --2- 172.21.15.42:0/2303605177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5e8107670 0x7fb5e8198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5ed4e5640 1 --2- 172.21.15.42:0/2303605177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5e8107ff0 0x7fb5e819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5ecce4640 1 -- 172.21.15.42:0/2303605177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5e8107ff0 msgr2=0x7fb5e819e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5ecce4640 1 --2- 172.21.15.42:0/2303605177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5e8107ff0 0x7fb5e819e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5ecce4640 1 -- 172.21.15.42:0/2303605177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e819e990 con 0x7fb5e8101c60 2024-09-21T17:46:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5e7fff640 1 --2- 172.21.15.42:0/2303605177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5e8107670 0x7fb5e8198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.802+0000 7fb5ed4e5640 1 --2- 172.21.15.42:0/2303605177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5e8107ff0 0x7fb5e819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.803+0000 7fb5ecce4640 1 --2- 172.21.15.42:0/2303605177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e8101c60 0x7fb5e81988e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00e9c0 tx=0x7fb5dc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.803+0000 7fb5e5ffb640 1 -- 172.21.15.42:0/2303605177 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc00cde0 con 0x7fb5e8101c60 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.803+0000 7fb5eef48640 1 -- 172.21.15.42:0/2303605177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e819ec80 con 0x7fb5e8101c60 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.803+0000 7fb5e5ffb640 1 -- 172.21.15.42:0/2303605177 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fb5dc0035f0 con 0x7fb5e8101c60 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.803+0000 7fb5e5ffb640 1 -- 172.21.15.42:0/2303605177 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0044a0 con 0x7fb5e8101c60 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.803+0000 7fb5eef48640 1 -- 172.21.15.42:0/2303605177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e8103400 con 0x7fb5e8101c60 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.804+0000 7fb5eef48640 1 -- 172.21.15.42:0/2303605177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e8102040 con 0x7fb5e8101c60 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.804+0000 7fb5e5ffb640 1 -- 172.21.15.42:0/2303605177 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7fb5dc004000 con 0x7fb5e8101c60 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.805+0000 7fb5e5ffb640 1 --2- 172.21.15.42:0/2303605177 >> v2:172.21.15.42:6800/36970769 conn(0x7fb5d807b110 0x7fb5d807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.805+0000 7fb5e5ffb640 1 -- 172.21.15.42:0/2303605177 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7fb5dc09e780 con 0x7fb5e8101c60 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.805+0000 7fb5e7fff640 1 --2- 172.21.15.42:0/2303605177 >> v2:172.21.15.42:6800/36970769 conn(0x7fb5d807b110 0x7fb5d807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.805+0000 7fb5e7fff640 1 --2- 172.21.15.42:0/2303605177 >> v2:172.21.15.42:6800/36970769 conn(0x7fb5d807b110 0x7fb5d807d5d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8107180 tx=0x7fb5d400f7a0 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:05.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.809+0000 7fb5e5ffb640 1 -- 172.21.15.42:0/2303605177 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fb5dc069cd0 con 0x7fb5e8101c60 2024-09-21T17:46:05.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:05 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/825283663' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T17:46:06.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.998+0000 7fb5eef48640 1 -- 172.21.15.42:0/2303605177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb5e8063d50 con 0x7fb5e8101c60 2024-09-21T17:46:06.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:05.998+0000 7fb5e5ffb640 1 -- 172.21.15.42:0/2303605177 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb5dc06eb80 con 0x7fb5e8101c60 2024-09-21T17:46:06.001 INFO:teuthology.orchestra.run.smithi042.stdout:180388626447 2024-09-21T17:46:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.000+0000 7fb5eef48640 1 -- 172.21.15.42:0/2303605177 >> v2:172.21.15.42:6800/36970769 conn(0x7fb5d807b110 msgr2=0x7fb5d807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.000+0000 7fb5eef48640 1 --2- 172.21.15.42:0/2303605177 >> v2:172.21.15.42:6800/36970769 conn(0x7fb5d807b110 0x7fb5d807d5d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8107180 tx=0x7fb5d400f7a0 comp rx=0 tx=0).stop 2024-09-21T17:46:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.001+0000 7fb5eef48640 1 -- 172.21.15.42:0/2303605177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e8101c60 msgr2=0x7fb5e81988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.001+0000 7fb5eef48640 1 --2- 172.21.15.42:0/2303605177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e8101c60 0x7fb5e81988e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00e9c0 tx=0x7fb5dc00ee80 comp rx=0 tx=0).stop 2024-09-21T17:46:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.001+0000 7fb5eef48640 1 -- 172.21.15.42:0/2303605177 shutdown_connections 2024-09-21T17:46:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.001+0000 7fb5eef48640 1 --2- 172.21.15.42:0/2303605177 >> v2:172.21.15.42:6800/36970769 conn(0x7fb5d807b110 0x7fb5d807d5d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.001+0000 7fb5eef48640 1 --2- 172.21.15.42:0/2303605177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5e8107ff0 0x7fb5e819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.001+0000 7fb5eef48640 1 --2- 172.21.15.42:0/2303605177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5e8107670 0x7fb5e8198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.001+0000 7fb5eef48640 1 --2- 172.21.15.42:0/2303605177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e8101c60 0x7fb5e81988e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.001+0000 7fb5eef48640 1 -- 172.21.15.42:0/2303605177 >> 172.21.15.42:0/2303605177 conn(0x7fb5e80fd6d0 msgr2=0x7fb5e80ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.001+0000 7fb5eef48640 1 -- 172.21.15.42:0/2303605177 shutdown_connections 2024-09-21T17:46:06.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:06.001+0000 7fb5eef48640 1 -- 172.21.15.42:0/2303605177 wait complete. 2024-09-21T17:46:06.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:06 smithi042 ceph-mon[29361]: pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T17:46:06.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3898993943' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T17:46:06.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2303605177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T17:46:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:06 smithi042 ceph-mon[38309]: pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T17:46:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3898993943' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T17:46:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2303605177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T17:46:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:06 smithi162 ceph-mon[32106]: pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T17:46:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3898993943' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T17:46:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2303605177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T17:46:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.220+0000 7fc8e19d8640 1 -- 172.21.15.42:0/3616513509 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc8dc109130 msgr2=0x7fc8dc10f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.220+0000 7fc8e19d8640 1 --2- 172.21.15.42:0/3616513509 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc8dc109130 0x7fc8dc10f930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009ca0 tx=0x7fc8d402a8c0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.220+0000 7fc8e19d8640 1 -- 172.21.15.42:0/3616513509 shutdown_connections 2024-09-21T17:46:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.220+0000 7fc8e19d8640 1 --2- 172.21.15.42:0/3616513509 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc8dc109130 0x7fc8dc10f930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.220+0000 7fc8e19d8640 1 --2- 172.21.15.42:0/3616513509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8dc1087b0 0x7fc8dc108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.220+0000 7fc8e19d8640 1 --2- 172.21.15.42:0/3616513509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8dc102da0 0x7fc8dc103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.220+0000 7fc8e19d8640 1 -- 172.21.15.42:0/3616513509 >> 172.21.15.42:0/3616513509 conn(0x7fc8dc0fe810 msgr2=0x7fc8dc100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.220+0000 7fc8e19d8640 1 -- 172.21.15.42:0/3616513509 shutdown_connections 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.220+0000 7fc8e19d8640 1 -- 172.21.15.42:0/3616513509 wait complete. 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8e19d8640 1 Processor -- start 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8e19d8640 1 -- start start 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8e19d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8dc102da0 0x7fc8dc198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8e19d8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8dc1087b0 0x7fc8dc198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8e19d8640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc8dc109130 0x7fc8dc19e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8e19d8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc112500 con 0x7fc8dc102da0 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8e19d8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc112380 con 0x7fc8dc1087b0 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8e19d8640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fc8dc112680 con 0x7fc8dc109130 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8daffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8dc102da0 0x7fc8dc198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8daffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8dc102da0 0x7fc8dc198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55778/0 (socket says 172.21.15.42:55778) 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8daffd640 1 -- 172.21.15.42:0/844563606 learned_addr learned my addr 172.21.15.42:0/844563606 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8db7fe640 1 --2- 172.21.15.42:0/844563606 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc8dc109130 0x7fc8dc19e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.221+0000 7fc8d27fc640 1 --2- 172.21.15.42:0/844563606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8dc1087b0 0x7fc8dc198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.222+0000 7fc8daffd640 1 -- 172.21.15.42:0/844563606 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc8dc109130 msgr2=0x7fc8dc19e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.222+0000 7fc8daffd640 1 --2- 172.21.15.42:0/844563606 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc8dc109130 0x7fc8dc19e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.222+0000 7fc8daffd640 1 -- 172.21.15.42:0/844563606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8dc1087b0 msgr2=0x7fc8dc198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.222+0000 7fc8daffd640 1 --2- 172.21.15.42:0/844563606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8dc1087b0 0x7fc8dc198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.222+0000 7fc8daffd640 1 -- 172.21.15.42:0/844563606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc19ea20 con 0x7fc8dc102da0 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.222+0000 7fc8daffd640 1 --2- 172.21.15.42:0/844563606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8dc102da0 0x7fc8dc198970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00d770 tx=0x7fc8cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.222+0000 7fc8e09d6640 1 -- 172.21.15.42:0/844563606 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc017070 con 0x7fc8dc102da0 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.222+0000 7fc8e19d8640 1 -- 172.21.15.42:0/844563606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8dc19ed10 con 0x7fc8dc102da0 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.222+0000 7fc8e09d6640 1 -- 172.21.15.42:0/844563606 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fc8cc0054a0 con 0x7fc8dc102da0 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.222+0000 7fc8e09d6640 1 -- 172.21.15.42:0/844563606 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc004c40 con 0x7fc8dc102da0 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.222+0000 7fc8e19d8640 1 -- 172.21.15.42:0/844563606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8dc1a53d0 con 0x7fc8dc102da0 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.223+0000 7fc8e19d8640 1 -- 172.21.15.42:0/844563606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8dc103180 con 0x7fc8dc102da0 2024-09-21T17:46:07.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.224+0000 7fc8e09d6640 1 -- 172.21.15.42:0/844563606 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7fc8cc004de0 con 0x7fc8dc102da0 2024-09-21T17:46:07.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.224+0000 7fc8e09d6640 1 --2- 172.21.15.42:0/844563606 >> v2:172.21.15.42:6800/36970769 conn(0x7fc8c807b110 0x7fc8c807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:07.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.224+0000 7fc8e09d6640 1 -- 172.21.15.42:0/844563606 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7fc8cc09dd80 con 0x7fc8dc102da0 2024-09-21T17:46:07.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.224+0000 7fc8d27fc640 1 --2- 172.21.15.42:0/844563606 >> v2:172.21.15.42:6800/36970769 conn(0x7fc8c807b110 0x7fc8c807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:07.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.225+0000 7fc8d27fc640 1 --2- 172.21.15.42:0/844563606 >> v2:172.21.15.42:6800/36970769 conn(0x7fc8c807b110 0x7fc8c807d5d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40095f0 tx=0x7fc8c4005f90 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:07.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.229+0000 7fc8e09d6640 1 -- 172.21.15.42:0/844563606 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fc8cc069370 con 0x7fc8dc102da0 2024-09-21T17:46:07.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.426+0000 7fc8e19d8640 1 -- 172.21.15.42:0/844563606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc8dc10af10 con 0x7fc8dc102da0 2024-09-21T17:46:07.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.427+0000 7fc8e09d6640 1 -- 172.21.15.42:0/844563606 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8cc06e220 con 0x7fc8dc102da0 2024-09-21T17:46:07.429 INFO:teuthology.orchestra.run.smithi042.stdout:77309411364 2024-09-21T17:46:07.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 -- 172.21.15.42:0/844563606 >> v2:172.21.15.42:6800/36970769 conn(0x7fc8c807b110 msgr2=0x7fc8c807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:07.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 --2- 172.21.15.42:0/844563606 >> v2:172.21.15.42:6800/36970769 conn(0x7fc8c807b110 0x7fc8c807d5d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40095f0 tx=0x7fc8c4005f90 comp rx=0 tx=0).stop 2024-09-21T17:46:07.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 -- 172.21.15.42:0/844563606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8dc102da0 msgr2=0x7fc8dc198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:07.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 --2- 172.21.15.42:0/844563606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8dc102da0 0x7fc8dc198970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00d770 tx=0x7fc8cc00dc30 comp rx=0 tx=0).stop 2024-09-21T17:46:07.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 -- 172.21.15.42:0/844563606 shutdown_connections 2024-09-21T17:46:07.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 --2- 172.21.15.42:0/844563606 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc8dc109130 0x7fc8dc19e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 --2- 172.21.15.42:0/844563606 >> v2:172.21.15.42:6800/36970769 conn(0x7fc8c807b110 0x7fc8c807d5d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 --2- 172.21.15.42:0/844563606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8dc1087b0 0x7fc8dc198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 --2- 172.21.15.42:0/844563606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8dc102da0 0x7fc8dc198970 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 -- 172.21.15.42:0/844563606 >> 172.21.15.42:0/844563606 conn(0x7fc8dc0fe810 msgr2=0x7fc8dc100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:07.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 -- 172.21.15.42:0/844563606 shutdown_connections 2024-09-21T17:46:07.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.429+0000 7fc8e19d8640 1 -- 172.21.15.42:0/844563606 wait complete. 2024-09-21T17:46:07.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.443+0000 7fa06403d640 1 -- 172.21.15.42:0/1720375125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c107670 msgr2=0x7fa05c107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:07.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.443+0000 7fa06403d640 1 --2- 172.21.15.42:0/1720375125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c107670 0x7fa05c107ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009860 tx=0x7fa04c02a340 comp rx=0 tx=0).stop 2024-09-21T17:46:07.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.443+0000 7fa06403d640 1 -- 172.21.15.42:0/1720375125 shutdown_connections 2024-09-21T17:46:07.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.443+0000 7fa06403d640 1 --2- 172.21.15.42:0/1720375125 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa05c107ff0 0x7fa05c10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.443+0000 7fa06403d640 1 --2- 172.21.15.42:0/1720375125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c107670 0x7fa05c107ab0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.443+0000 7fa06403d640 1 --2- 172.21.15.42:0/1720375125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c101c60 0x7fa05c102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.443+0000 7fa06403d640 1 -- 172.21.15.42:0/1720375125 >> 172.21.15.42:0/1720375125 conn(0x7fa05c0fd6d0 msgr2=0x7fa05c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:07.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.443+0000 7fa06403d640 1 -- 172.21.15.42:0/1720375125 shutdown_connections 2024-09-21T17:46:07.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.443+0000 7fa06403d640 1 -- 172.21.15.42:0/1720375125 wait complete. 2024-09-21T17:46:07.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.444+0000 7fa06403d640 1 Processor -- start 2024-09-21T17:46:07.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.444+0000 7fa06403d640 1 -- start start 2024-09-21T17:46:07.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.444+0000 7fa06403d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c101c60 0x7fa05c1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.444+0000 7fa06403d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c107670 0x7fa05c197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.444+0000 7fa06403d640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa05c107ff0 0x7fa05c19d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.444+0000 7fa06403d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c111350 con 0x7fa05c107670 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa06403d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1111d0 con 0x7fa05c101c60 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa06403d640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fa05c1114d0 con 0x7fa05c107ff0 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa0625da640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa05c107ff0 0x7fa05c19d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa0625da640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa05c107ff0 0x7fa05c19d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:40134/0 (socket says 172.21.15.42:40134) 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa0625da640 1 -- 172.21.15.42:0/237801440 learned_addr learned my addr 172.21.15.42:0/237801440 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa0615d8640 1 --2- 172.21.15.42:0/237801440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c107670 0x7fa05c197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa061dd9640 1 --2- 172.21.15.42:0/237801440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c101c60 0x7fa05c1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa0625da640 1 -- 172.21.15.42:0/237801440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c101c60 msgr2=0x7fa05c1978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa0625da640 1 --2- 172.21.15.42:0/237801440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c101c60 0x7fa05c1978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa0625da640 1 -- 172.21.15.42:0/237801440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c107670 msgr2=0x7fa05c197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:07.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa0625da640 1 --2- 172.21.15.42:0/237801440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c107670 0x7fa05c197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa0625da640 1 -- 172.21.15.42:0/237801440 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05c19d990 con 0x7fa05c107ff0 2024-09-21T17:46:07.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa0625da640 1 --2- 172.21.15.42:0/237801440 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa05c107ff0 0x7fa05c19d1c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa054009fd0 tx=0x7fa05400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:07.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.445+0000 7fa052ffd640 1 -- 172.21.15.42:0/237801440 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054004b20 con 0x7fa05c107ff0 2024-09-21T17:46:07.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.446+0000 7fa052ffd640 1 -- 172.21.15.42:0/237801440 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fa054003df0 con 0x7fa05c107ff0 2024-09-21T17:46:07.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.446+0000 7fa052ffd640 1 -- 172.21.15.42:0/237801440 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054004730 con 0x7fa05c107ff0 2024-09-21T17:46:07.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.446+0000 7fa06403d640 1 -- 172.21.15.42:0/237801440 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05c19dc80 con 0x7fa05c107ff0 2024-09-21T17:46:07.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.446+0000 7fa06403d640 1 -- 172.21.15.42:0/237801440 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05c06aa80 con 0x7fa05c107ff0 2024-09-21T17:46:07.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.447+0000 7fa06403d640 1 -- 172.21.15.42:0/237801440 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa05c102040 con 0x7fa05c107ff0 2024-09-21T17:46:07.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.448+0000 7fa052ffd640 1 -- 172.21.15.42:0/237801440 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7fa05401d020 con 0x7fa05c107ff0 2024-09-21T17:46:07.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.448+0000 7fa052ffd640 1 --2- 172.21.15.42:0/237801440 >> v2:172.21.15.42:6800/36970769 conn(0x7fa04807b110 0x7fa04807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:07.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.449+0000 7fa052ffd640 1 -- 172.21.15.42:0/237801440 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7fa05409e180 con 0x7fa05c107ff0 2024-09-21T17:46:07.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.449+0000 7fa061dd9640 1 --2- 172.21.15.42:0/237801440 >> v2:172.21.15.42:6800/36970769 conn(0x7fa04807b110 0x7fa04807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:07.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.449+0000 7fa061dd9640 1 --2- 172.21.15.42:0/237801440 >> v2:172.21.15.42:6800/36970769 conn(0x7fa04807b110 0x7fa04807d5d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa058009bd0 tx=0x7fa058005f90 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:07.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.453+0000 7fa052ffd640 1 -- 172.21.15.42:0/237801440 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fa0540697f0 con 0x7fa05c107ff0 2024-09-21T17:46:07.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.645+0000 7fa06403d640 1 -- 172.21.15.42:0/237801440 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa05c06b4a0 con 0x7fa05c107ff0 2024-09-21T17:46:07.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.645+0000 7fa052ffd640 1 -- 172.21.15.42:0/237801440 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa05406e6a0 con 0x7fa05c107ff0 2024-09-21T17:46:07.648 INFO:teuthology.orchestra.run.smithi042.stdout:154618822677 2024-09-21T17:46:07.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.647+0000 7fa06403d640 1 -- 172.21.15.42:0/237801440 >> v2:172.21.15.42:6800/36970769 conn(0x7fa04807b110 msgr2=0x7fa04807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:07.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.647+0000 7fa06403d640 1 --2- 172.21.15.42:0/237801440 >> v2:172.21.15.42:6800/36970769 conn(0x7fa04807b110 0x7fa04807d5d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa058009bd0 tx=0x7fa058005f90 comp rx=0 tx=0).stop 2024-09-21T17:46:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.647+0000 7fa06403d640 1 -- 172.21.15.42:0/237801440 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa05c107ff0 msgr2=0x7fa05c19d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.647+0000 7fa06403d640 1 --2- 172.21.15.42:0/237801440 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa05c107ff0 0x7fa05c19d1c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa054009fd0 tx=0x7fa05400c800 comp rx=0 tx=0).stop 2024-09-21T17:46:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.648+0000 7fa06403d640 1 -- 172.21.15.42:0/237801440 shutdown_connections 2024-09-21T17:46:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.648+0000 7fa06403d640 1 --2- 172.21.15.42:0/237801440 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa05c107ff0 0x7fa05c19d1c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.648+0000 7fa06403d640 1 --2- 172.21.15.42:0/237801440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c107670 0x7fa05c197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.648+0000 7fa06403d640 1 --2- 172.21.15.42:0/237801440 >> v2:172.21.15.42:6800/36970769 conn(0x7fa04807b110 0x7fa04807d5d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.648+0000 7fa06403d640 1 --2- 172.21.15.42:0/237801440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c101c60 0x7fa05c1978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.648+0000 7fa06403d640 1 -- 172.21.15.42:0/237801440 >> 172.21.15.42:0/237801440 conn(0x7fa05c0fd6d0 msgr2=0x7fa05c0ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.648+0000 7fa06403d640 1 -- 172.21.15.42:0/237801440 shutdown_connections 2024-09-21T17:46:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:07.648+0000 7fa06403d640 1 -- 172.21.15.42:0/237801440 wait complete. 2024-09-21T17:46:07.830 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626445 got 180388626447 for osd.6 2024-09-21T17:46:07.830 DEBUG:teuthology.parallel:result is None 2024-09-21T17:46:08.515 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:08 smithi042 ceph-mon[29361]: pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T17:46:08.515 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/844563606' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T17:46:08.515 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/237801440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T17:46:08.515 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:08 smithi042 ceph-mon[38309]: pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T17:46:08.515 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/844563606' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T17:46:08.516 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/237801440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T17:46:08.551 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018903 got 128849018904 for osd.4 2024-09-21T17:46:08.551 DEBUG:teuthology.parallel:result is None 2024-09-21T17:46:08.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:46:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:46:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:08 smithi162 ceph-mon[32106]: pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T17:46:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/844563606' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T17:46:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/237801440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T17:46:08.910 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182430 got 107374182431 for osd.3 2024-09-21T17:46:08.910 DEBUG:teuthology.parallel:result is None 2024-09-21T17:46:09.612 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822675 got 154618822677 for osd.5 2024-09-21T17:46:09.612 DEBUG:teuthology.parallel:result is None 2024-09-21T17:46:10.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.311+0000 7ff44da08640 1 -- 172.21.15.42:0/1615670524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff448109130 msgr2=0x7ff44810f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:10.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.311+0000 7ff44da08640 1 --2- 172.21.15.42:0/1615670524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff448109130 0x7ff44810f930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff440009be0 tx=0x7ff44002a6c0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.311+0000 7ff44da08640 1 -- 172.21.15.42:0/1615670524 shutdown_connections 2024-09-21T17:46:10.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.311+0000 7ff44da08640 1 --2- 172.21.15.42:0/1615670524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff448109130 0x7ff44810f930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.311+0000 7ff44da08640 1 --2- 172.21.15.42:0/1615670524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4481087b0 0x7ff448108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.311+0000 7ff44da08640 1 --2- 172.21.15.42:0/1615670524 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff448102da0 0x7ff448103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.311+0000 7ff44da08640 1 -- 172.21.15.42:0/1615670524 >> 172.21.15.42:0/1615670524 conn(0x7ff4480fe810 msgr2=0x7ff448100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:10.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.311+0000 7ff44da08640 1 -- 172.21.15.42:0/1615670524 shutdown_connections 2024-09-21T17:46:10.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.311+0000 7ff44da08640 1 -- 172.21.15.42:0/1615670524 wait complete. 2024-09-21T17:46:10.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff44da08640 1 Processor -- start 2024-09-21T17:46:10.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff44da08640 1 -- start start 2024-09-21T17:46:10.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff44da08640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff448102da0 0x7ff448198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:10.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff44da08640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4481087b0 0x7ff448198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:10.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff44da08640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff448109130 0x7ff44819e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:10.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff44da08640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4481124c0 con 0x7ff448109130 2024-09-21T17:46:10.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff44da08640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff448112340 con 0x7ff4481087b0 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff44da08640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7ff448112640 con 0x7ff448102da0 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff446ffd640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff448102da0 0x7ff448198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff446ffd640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff448102da0 0x7ff448198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:40158/0 (socket says 172.21.15.42:40158) 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff446ffd640 1 -- 172.21.15.42:0/675182249 learned_addr learned my addr 172.21.15.42:0/675182249 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.312+0000 7ff4477fe640 1 --2- 172.21.15.42:0/675182249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff448109130 0x7ff44819e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff4467fc640 1 --2- 172.21.15.42:0/675182249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4481087b0 0x7ff448198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff446ffd640 1 -- 172.21.15.42:0/675182249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4481087b0 msgr2=0x7ff448198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff446ffd640 1 --2- 172.21.15.42:0/675182249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4481087b0 0x7ff448198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff446ffd640 1 -- 172.21.15.42:0/675182249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff448109130 msgr2=0x7ff44819e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff446ffd640 1 --2- 172.21.15.42:0/675182249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff448109130 0x7ff44819e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff446ffd640 1 -- 172.21.15.42:0/675182249 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44819ea40 con 0x7ff448102da0 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff4477fe640 1 --2- 172.21.15.42:0/675182249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff448109130 0x7ff44819e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff446ffd640 1 --2- 172.21.15.42:0/675182249 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff448102da0 0x7ff448198990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff43800e9c0 tx=0x7ff43800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff44ca06640 1 -- 172.21.15.42:0/675182249 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43800cde0 con 0x7ff448102da0 2024-09-21T17:46:10.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff44ca06640 1 -- 172.21.15.42:0/675182249 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff4380035f0 con 0x7ff448102da0 2024-09-21T17:46:10.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff44da08640 1 -- 172.21.15.42:0/675182249 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff44819ed30 con 0x7ff448102da0 2024-09-21T17:46:10.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff44ca06640 1 -- 172.21.15.42:0/675182249 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4380044a0 con 0x7ff448102da0 2024-09-21T17:46:10.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.313+0000 7ff44da08640 1 -- 172.21.15.42:0/675182249 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4481a53f0 con 0x7ff448102da0 2024-09-21T17:46:10.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.314+0000 7ff44da08640 1 -- 172.21.15.42:0/675182249 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff448103180 con 0x7ff448102da0 2024-09-21T17:46:10.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.315+0000 7ff44ca06640 1 -- 172.21.15.42:0/675182249 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7ff438004000 con 0x7ff448102da0 2024-09-21T17:46:10.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.316+0000 7ff44ca06640 1 --2- 172.21.15.42:0/675182249 >> v2:172.21.15.42:6800/36970769 conn(0x7ff43007b110 0x7ff43007d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:10.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.316+0000 7ff4467fc640 1 --2- 172.21.15.42:0/675182249 >> v2:172.21.15.42:6800/36970769 conn(0x7ff43007b110 0x7ff43007d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:10.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.316+0000 7ff44ca06640 1 -- 172.21.15.42:0/675182249 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7ff43809e720 con 0x7ff448102da0 2024-09-21T17:46:10.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.316+0000 7ff4467fc640 1 --2- 172.21.15.42:0/675182249 >> v2:172.21.15.42:6800/36970769 conn(0x7ff43007b110 0x7ff43007d5d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff43c005fd0 tx=0x7ff43c005850 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:10.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.320+0000 7ff44ca06640 1 -- 172.21.15.42:0/675182249 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7ff438069c70 con 0x7ff448102da0 2024-09-21T17:46:10.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.510+0000 7ff44da08640 1 -- 172.21.15.42:0/675182249 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff44810af10 con 0x7ff448102da0 2024-09-21T17:46:10.513 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:10.513 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:10 smithi042 ceph-mon[29361]: pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T17:46:10.514 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:10.514 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:10 smithi042 ceph-mon[38309]: pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T17:46:10.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.511+0000 7ff44ca06640 1 -- 172.21.15.42:0/675182249 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff43806eb20 con 0x7ff448102da0 2024-09-21T17:46:10.514 INFO:teuthology.orchestra.run.smithi042.stdout:55834574889 2024-09-21T17:46:10.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.513+0000 7ff44da08640 1 -- 172.21.15.42:0/675182249 >> v2:172.21.15.42:6800/36970769 conn(0x7ff43007b110 msgr2=0x7ff43007d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:10.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.513+0000 7ff44da08640 1 --2- 172.21.15.42:0/675182249 >> v2:172.21.15.42:6800/36970769 conn(0x7ff43007b110 0x7ff43007d5d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff43c005fd0 tx=0x7ff43c005850 comp rx=0 tx=0).stop 2024-09-21T17:46:10.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.513+0000 7ff44da08640 1 -- 172.21.15.42:0/675182249 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff448102da0 msgr2=0x7ff448198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:10.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.513+0000 7ff44da08640 1 --2- 172.21.15.42:0/675182249 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff448102da0 0x7ff448198990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff43800e9c0 tx=0x7ff43800ee80 comp rx=0 tx=0).stop 2024-09-21T17:46:10.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.513+0000 7ff44da08640 1 -- 172.21.15.42:0/675182249 shutdown_connections 2024-09-21T17:46:10.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.513+0000 7ff44da08640 1 --2- 172.21.15.42:0/675182249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff448109130 0x7ff44819e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.513+0000 7ff44da08640 1 --2- 172.21.15.42:0/675182249 >> v2:172.21.15.42:6800/36970769 conn(0x7ff43007b110 0x7ff43007d5d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.513+0000 7ff44da08640 1 --2- 172.21.15.42:0/675182249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4481087b0 0x7ff448198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.513+0000 7ff44da08640 1 --2- 172.21.15.42:0/675182249 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff448102da0 0x7ff448198990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.513+0000 7ff44da08640 1 -- 172.21.15.42:0/675182249 >> 172.21.15.42:0/675182249 conn(0x7ff4480fe810 msgr2=0x7ff4481000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:10.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.513+0000 7ff44da08640 1 -- 172.21.15.42:0/675182249 shutdown_connections 2024-09-21T17:46:10.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.514+0000 7ff44da08640 1 -- 172.21.15.42:0/675182249 wait complete. 2024-09-21T17:46:10.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.530+0000 7f8e7f934640 1 -- 172.21.15.42:0/3212558369 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8e78108010 msgr2=0x7f8e7810e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:10.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.530+0000 7f8e7f934640 1 --2- 172.21.15.42:0/3212558369 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8e78108010 0x7f8e7810e810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009900 tx=0x7f8e7002a410 comp rx=0 tx=0).stop 2024-09-21T17:46:10.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.530+0000 7f8e7f934640 1 -- 172.21.15.42:0/3212558369 shutdown_connections 2024-09-21T17:46:10.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.530+0000 7f8e7f934640 1 --2- 172.21.15.42:0/3212558369 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8e78108010 0x7f8e7810e810 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.530+0000 7f8e7f934640 1 --2- 172.21.15.42:0/3212558369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e78107690 0x7f8e78107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.530+0000 7f8e7f934640 1 --2- 172.21.15.42:0/3212558369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e78101c80 0x7f8e78102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.530+0000 7f8e7f934640 1 -- 172.21.15.42:0/3212558369 >> 172.21.15.42:0/3212558369 conn(0x7f8e780fd6f0 msgr2=0x7f8e780ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:10.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.530+0000 7f8e7f934640 1 -- 172.21.15.42:0/3212558369 shutdown_connections 2024-09-21T17:46:10.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.530+0000 7f8e7f934640 1 -- 172.21.15.42:0/3212558369 wait complete. 2024-09-21T17:46:10.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.531+0000 7f8e7f934640 1 Processor -- start 2024-09-21T17:46:10.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.531+0000 7f8e7f934640 1 -- start start 2024-09-21T17:46:10.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.531+0000 7f8e7f934640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e78101c80 0x7f8e78197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.531+0000 7f8e7f934640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e78107690 0x7f8e78197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7f934640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8e78108010 0x7f8e7819d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7f934640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8e781113e0 con 0x7f8e78107690 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7f934640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e78111260 con 0x7f8e78101c80 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7f934640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f8e78111560 con 0x7f8e78108010 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7cecf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e78107690 0x7f8e78197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7cecf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e78107690 0x7f8e78197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55848/0 (socket says 172.21.15.42:55848) 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7cecf640 1 -- 172.21.15.42:0/2602276618 learned_addr learned my addr 172.21.15.42:0/2602276618 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7ded1640 1 --2- 172.21.15.42:0/2602276618 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8e78108010 0x7f8e7819d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7d6d0640 1 --2- 172.21.15.42:0/2602276618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e78101c80 0x7f8e78197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7cecf640 1 -- 172.21.15.42:0/2602276618 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8e78108010 msgr2=0x7f8e7819d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7cecf640 1 --2- 172.21.15.42:0/2602276618 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8e78108010 0x7f8e7819d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7cecf640 1 -- 172.21.15.42:0/2602276618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e78101c80 msgr2=0x7f8e78197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:10.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7cecf640 1 --2- 172.21.15.42:0/2602276618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e78101c80 0x7f8e78197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7cecf640 1 -- 172.21.15.42:0/2602276618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7819d8e0 con 0x7f8e78107690 2024-09-21T17:46:10.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.532+0000 7f8e7cecf640 1 --2- 172.21.15.42:0/2602276618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e78107690 0x7f8e78197d70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800eb70 tx=0x7f8e6800b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:10.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.533+0000 7f8e6e7fc640 1 -- 172.21.15.42:0/2602276618 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800be60 con 0x7f8e78107690 2024-09-21T17:46:10.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.533+0000 7f8e6e7fc640 1 -- 172.21.15.42:0/2602276618 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f8e680035f0 con 0x7f8e78107690 2024-09-21T17:46:10.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.533+0000 7f8e6e7fc640 1 -- 172.21.15.42:0/2602276618 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e680044a0 con 0x7f8e78107690 2024-09-21T17:46:10.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.533+0000 7f8e7f934640 1 -- 172.21.15.42:0/2602276618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7819dbd0 con 0x7f8e78107690 2024-09-21T17:46:10.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.533+0000 7f8e7f934640 1 -- 172.21.15.42:0/2602276618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7806b2a0 con 0x7f8e78107690 2024-09-21T17:46:10.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.534+0000 7f8e7f934640 1 -- 172.21.15.42:0/2602276618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e78102060 con 0x7f8e78107690 2024-09-21T17:46:10.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.535+0000 7f8e6e7fc640 1 -- 172.21.15.42:0/2602276618 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f8e68004000 con 0x7f8e78107690 2024-09-21T17:46:10.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.535+0000 7f8e6e7fc640 1 --2- 172.21.15.42:0/2602276618 >> v2:172.21.15.42:6800/36970769 conn(0x7f8e6407b110 0x7f8e6407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:10.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.536+0000 7f8e6e7fc640 1 -- 172.21.15.42:0/2602276618 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7f8e6809fe00 con 0x7f8e78107690 2024-09-21T17:46:10.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.536+0000 7f8e7d6d0640 1 --2- 172.21.15.42:0/2602276618 >> v2:172.21.15.42:6800/36970769 conn(0x7f8e6407b110 0x7f8e6407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:10.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.536+0000 7f8e7d6d0640 1 --2- 172.21.15.42:0/2602276618 >> v2:172.21.15.42:6800/36970769 conn(0x7f8e6407b110 0x7f8e6407d5d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8e74005c40 tx=0x7f8e7400a570 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:10.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.540+0000 7f8e6e7fc640 1 -- 172.21.15.42:0/2602276618 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f8e6806b3d0 con 0x7f8e78107690 2024-09-21T17:46:10.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.733+0000 7f8e7f934640 1 -- 172.21.15.42:0/2602276618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8e7806bd20 con 0x7f8e78107690 2024-09-21T17:46:10.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.733+0000 7f8e6e7fc640 1 -- 172.21.15.42:0/2602276618 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8e68070280 con 0x7f8e78107690 2024-09-21T17:46:10.736 INFO:teuthology.orchestra.run.smithi042.stdout:206158430218 2024-09-21T17:46:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.735+0000 7f8e7f934640 1 -- 172.21.15.42:0/2602276618 >> v2:172.21.15.42:6800/36970769 conn(0x7f8e6407b110 msgr2=0x7f8e6407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.735+0000 7f8e7f934640 1 --2- 172.21.15.42:0/2602276618 >> v2:172.21.15.42:6800/36970769 conn(0x7f8e6407b110 0x7f8e6407d5d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8e74005c40 tx=0x7f8e7400a570 comp rx=0 tx=0).stop 2024-09-21T17:46:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.735+0000 7f8e7f934640 1 -- 172.21.15.42:0/2602276618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e78107690 msgr2=0x7f8e78197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.735+0000 7f8e7f934640 1 --2- 172.21.15.42:0/2602276618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e78107690 0x7f8e78197d70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800eb70 tx=0x7f8e6800b690 comp rx=0 tx=0).stop 2024-09-21T17:46:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.735+0000 7f8e7f934640 1 -- 172.21.15.42:0/2602276618 shutdown_connections 2024-09-21T17:46:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.735+0000 7f8e7f934640 1 --2- 172.21.15.42:0/2602276618 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8e78108010 0x7f8e7819d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.735+0000 7f8e7f934640 1 --2- 172.21.15.42:0/2602276618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e78107690 0x7f8e78197d70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.735+0000 7f8e7f934640 1 --2- 172.21.15.42:0/2602276618 >> v2:172.21.15.42:6800/36970769 conn(0x7f8e6407b110 0x7f8e6407d5d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.735+0000 7f8e7f934640 1 --2- 172.21.15.42:0/2602276618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e78101c80 0x7f8e78197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.735+0000 7f8e7f934640 1 -- 172.21.15.42:0/2602276618 >> 172.21.15.42:0/2602276618 conn(0x7f8e780fd6f0 msgr2=0x7f8e780ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.736+0000 7f8e7f934640 1 -- 172.21.15.42:0/2602276618 shutdown_connections 2024-09-21T17:46:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:10.736+0000 7f8e7f934640 1 -- 172.21.15.42:0/2602276618 wait complete. 2024-09-21T17:46:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:10 smithi162 ceph-mon[32106]: pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T17:46:11.420 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430215 got 206158430218 for osd.7 2024-09-21T17:46:11.421 DEBUG:teuthology.parallel:result is None 2024-09-21T17:46:11.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/675182249' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T17:46:11.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2602276618' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T17:46:11.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/675182249' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T17:46:11.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2602276618' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T17:46:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/675182249' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T17:46:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2602276618' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T17:46:12.043 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411363 got 77309411364 for osd.2 2024-09-21T17:46:12.044 DEBUG:teuthology.parallel:result is None 2024-09-21T17:46:12.557 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574886 got 55834574889 for osd.1 2024-09-21T17:46:12.558 DEBUG:teuthology.parallel:result is None 2024-09-21T17:46:12.558 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T17:46:12.558 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T17:46:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:12 smithi162 ceph-mon[32106]: pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T17:46:12.831 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:46:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:12 smithi042 ceph-mon[29361]: pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T17:46:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:12 smithi042 ceph-mon[38309]: pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T17:46:13.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.271+0000 7fef013c9640 1 -- 172.21.15.42:0/4222312409 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feefc10d110 msgr2=0x7feefc10f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:13.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.271+0000 7fef013c9640 1 --2- 172.21.15.42:0/4222312409 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feefc10d110 0x7feefc10f570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feef4009be0 tx=0x7feef402a6c0 comp rx=0 tx=0).stop 2024-09-21T17:46:13.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.271+0000 7fef013c9640 1 -- 172.21.15.42:0/4222312409 shutdown_connections 2024-09-21T17:46:13.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.271+0000 7fef013c9640 1 --2- 172.21.15.42:0/4222312409 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feefc10d110 0x7feefc10f570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:13.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.271+0000 7fef013c9640 1 --2- 172.21.15.42:0/4222312409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc1045d0 0x7feefc10cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:13.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.271+0000 7fef013c9640 1 --2- 172.21.15.42:0/4222312409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc103cb0 0x7feefc104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:13.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.271+0000 7fef013c9640 1 -- 172.21.15.42:0/4222312409 >> 172.21.15.42:0/4222312409 conn(0x7feefc0fd6f0 msgr2=0x7feefc0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:13.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.271+0000 7fef013c9640 1 -- 172.21.15.42:0/4222312409 shutdown_connections 2024-09-21T17:46:13.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.271+0000 7fef013c9640 1 -- 172.21.15.42:0/4222312409 wait complete. 2024-09-21T17:46:13.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.272+0000 7fef013c9640 1 Processor -- start 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.272+0000 7fef013c9640 1 -- start start 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.272+0000 7fef013c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc103cb0 0x7feefc101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.272+0000 7fef013c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc1045d0 0x7feefc101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.272+0000 7fef013c9640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feefc10d110 0x7feefc1023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.272+0000 7fef013c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feefc112490 con 0x7feefc1045d0 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.272+0000 7fef013c9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feefc112310 con 0x7feefc103cb0 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.272+0000 7fef013c9640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7feefc112610 con 0x7feefc10d110 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefb7fe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feefc10d110 0x7feefc1023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefa7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc1045d0 0x7feefc101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefb7fe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feefc10d110 0x7feefc1023e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:33178/0 (socket says 172.21.15.42:33178) 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefb7fe640 1 -- 172.21.15.42:0/4125948867 learned_addr learned my addr 172.21.15.42:0/4125948867 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefaffd640 1 --2- 172.21.15.42:0/4125948867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc103cb0 0x7feefc101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:13.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefb7fe640 1 -- 172.21.15.42:0/4125948867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc103cb0 msgr2=0x7feefc101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:13.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefb7fe640 1 --2- 172.21.15.42:0/4125948867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc103cb0 0x7feefc101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:13.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefb7fe640 1 -- 172.21.15.42:0/4125948867 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc1045d0 msgr2=0x7feefc101ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:13.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefb7fe640 1 --2- 172.21.15.42:0/4125948867 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc1045d0 0x7feefc101ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:13.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefb7fe640 1 -- 172.21.15.42:0/4125948867 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc1a6dc0 con 0x7feefc10d110 2024-09-21T17:46:13.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefaffd640 1 --2- 172.21.15.42:0/4125948867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc103cb0 0x7feefc101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T17:46:13.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feefb7fe640 1 --2- 172.21.15.42:0/4125948867 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feefc10d110 0x7feefc1023e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feef4004af0 tx=0x7feef4030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:13.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.273+0000 7feee3fff640 1 -- 172.21.15.42:0/4125948867 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4041020 con 0x7feefc10d110 2024-09-21T17:46:13.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.274+0000 7fef013c9640 1 -- 172.21.15.42:0/4125948867 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc1a7050 con 0x7feefc10d110 2024-09-21T17:46:13.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.274+0000 7feee3fff640 1 -- 172.21.15.42:0/4125948867 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7feef4003970 con 0x7feefc10d110 2024-09-21T17:46:13.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.274+0000 7feee3fff640 1 -- 172.21.15.42:0/4125948867 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4036040 con 0x7feefc10d110 2024-09-21T17:46:13.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.274+0000 7fef013c9640 1 -- 172.21.15.42:0/4125948867 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc1a7580 con 0x7feefc10d110 2024-09-21T17:46:13.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.275+0000 7fef013c9640 1 -- 172.21.15.42:0/4125948867 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feefc104090 con 0x7feefc10d110 2024-09-21T17:46:13.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.275+0000 7feee3fff640 1 -- 172.21.15.42:0/4125948867 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7feef4044020 con 0x7feefc10d110 2024-09-21T17:46:13.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.276+0000 7feee3fff640 1 --2- 172.21.15.42:0/4125948867 >> v2:172.21.15.42:6800/36970769 conn(0x7feee407b110 0x7feee407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:13.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.276+0000 7feee3fff640 1 -- 172.21.15.42:0/4125948867 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7feef40bec20 con 0x7feefc10d110 2024-09-21T17:46:13.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.276+0000 7feefaffd640 1 --2- 172.21.15.42:0/4125948867 >> v2:172.21.15.42:6800/36970769 conn(0x7feee407b110 0x7feee407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:13.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.277+0000 7feefaffd640 1 --2- 172.21.15.42:0/4125948867 >> v2:172.21.15.42:6800/36970769 conn(0x7feee407b110 0x7feee407d5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feeec0058c0 tx=0x7feeec005850 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:13.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.281+0000 7feee3fff640 1 -- 172.21.15.42:0/4125948867 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7feef404b030 con 0x7feefc10d110 2024-09-21T17:46:13.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.469+0000 7fef013c9640 1 -- 172.21.15.42:0/4125948867 --> v2:172.21.15.42:6800/36970769 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feefc063590 con 0x7feee407b110 2024-09-21T17:46:13.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.476+0000 7feee3fff640 1 -- 172.21.15.42:0/4125948867 <== mgr.14598 v2:172.21.15.42:6800/36970769 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346434 (secure 0 0 0) 0x7feefc063590 con 0x7feee407b110 2024-09-21T17:46:13.482 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:46:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-21T17:46:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 -- 172.21.15.42:0/4125948867 >> v2:172.21.15.42:6800/36970769 conn(0x7feee407b110 msgr2=0x7feee407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 --2- 172.21.15.42:0/4125948867 >> v2:172.21.15.42:6800/36970769 conn(0x7feee407b110 0x7feee407d5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feeec0058c0 tx=0x7feeec005850 comp rx=0 tx=0).stop 2024-09-21T17:46:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 -- 172.21.15.42:0/4125948867 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feefc10d110 msgr2=0x7feefc1023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 --2- 172.21.15.42:0/4125948867 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feefc10d110 0x7feefc1023e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feef4004af0 tx=0x7feef4030650 comp rx=0 tx=0).stop 2024-09-21T17:46:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 -- 172.21.15.42:0/4125948867 shutdown_connections 2024-09-21T17:46:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 --2- 172.21.15.42:0/4125948867 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feefc10d110 0x7feefc1023e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 --2- 172.21.15.42:0/4125948867 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc1045d0 0x7feefc101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:13.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 --2- 172.21.15.42:0/4125948867 >> v2:172.21.15.42:6800/36970769 conn(0x7feee407b110 0x7feee407d5d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:13.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 --2- 172.21.15.42:0/4125948867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc103cb0 0x7feefc101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:13.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 -- 172.21.15.42:0/4125948867 >> 172.21.15.42:0/4125948867 conn(0x7feefc0fd6f0 msgr2=0x7feefc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:13.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 -- 172.21.15.42:0/4125948867 shutdown_connections 2024-09-21T17:46:13.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:13.481+0000 7fef013c9640 1 -- 172.21.15.42:0/4125948867 wait complete. 2024-09-21T17:46:13.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:13.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:13.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:13.965 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:46:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:46:14.322 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-21T17:46:13.170603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":883,"num_read_kb":740,"num_write":549,"num_write_kb":1673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":552,"ondisk_log_size":552,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":235380,"kb_used_data":6684,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":749725836,"statfs":{"total":767960285184,"available":767719256064,"internally_reserved":0,"allocated":6844416,"data_stored":3676129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":186,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002855"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155555+0000","last_change":"2024-09-21T17:45:28.273698+0000","last_active":"2024-09-21T17:45:57.155555+0000","last_peered":"2024-09-21T17:45:57.155555+0000","last_clean":"2024-09-21T17:45:57.155555+0000","last_became_active":"2024-09-21T17:45:28.273409+0000","last_became_peered":"2024-09-21T17:45:28.273409+0000","last_unstale":"2024-09-21T17:45:57.155555+0000","last_undegraded":"2024-09-21T17:45:57.155555+0000","last_fullsized":"2024-09-21T17:45:57.155555+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:23:22.913929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.794780+0000","last_change":"2024-09-21T17:45:30.278895+0000","last_active":"2024-09-21T17:45:57.794780+0000","last_peered":"2024-09-21T17:45:57.794780+0000","last_clean":"2024-09-21T17:45:57.794780+0000","last_became_active":"2024-09-21T17:45:30.278555+0000","last_became_peered":"2024-09-21T17:45:30.278555+0000","last_unstale":"2024-09-21T17:45:57.794780+0000","last_undegraded":"2024-09-21T17:45:57.794780+0000","last_fullsized":"2024-09-21T17:45:57.794780+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:42:50.272397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156523+0000","last_change":"2024-09-21T17:45:32.285397+0000","last_active":"2024-09-21T17:45:57.156523+0000","last_peered":"2024-09-21T17:45:57.156523+0000","last_clean":"2024-09-21T17:45:57.156523+0000","last_became_active":"2024-09-21T17:45:32.285089+0000","last_became_peered":"2024-09-21T17:45:32.285089+0000","last_unstale":"2024-09-21T17:45:57.156523+0000","last_undegraded":"2024-09-21T17:45:57.156523+0000","last_fullsized":"2024-09-21T17:45:57.156523+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:43:49.823726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.794935+0000","last_change":"2024-09-21T17:45:34.305939+0000","last_active":"2024-09-21T17:45:57.794935+0000","last_peered":"2024-09-21T17:45:57.794935+0000","last_clean":"2024-09-21T17:45:57.794935+0000","last_became_active":"2024-09-21T17:45:34.305662+0000","last_became_peered":"2024-09-21T17:45:34.305662+0000","last_unstale":"2024-09-21T17:45:57.794935+0000","last_undegraded":"2024-09-21T17:45:57.794935+0000","last_fullsized":"2024-09-21T17:45:57.794935+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:21.023722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"60'1","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325092+0000","last_change":"2024-09-21T17:45:34.313830+0000","last_active":"2024-09-21T17:45:58.325092+0000","last_peered":"2024-09-21T17:45:58.325092+0000","last_clean":"2024-09-21T17:45:58.325092+0000","last_became_active":"2024-09-21T17:45:34.313161+0000","last_became_peered":"2024-09-21T17:45:34.313161+0000","last_unstale":"2024-09-21T17:45:58.325092+0000","last_undegraded":"2024-09-21T17:45:58.325092+0000","last_fullsized":"2024-09-21T17:45:58.325092+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:11:01.947571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326609+0000","last_change":"2024-09-21T17:45:28.263666+0000","last_active":"2024-09-21T17:45:58.326609+0000","last_peered":"2024-09-21T17:45:58.326609+0000","last_clean":"2024-09-21T17:45:58.326609+0000","last_became_active":"2024-09-21T17:45:28.263176+0000","last_became_peered":"2024-09-21T17:45:28.263176+0000","last_unstale":"2024-09-21T17:45:58.326609+0000","last_undegraded":"2024-09-21T17:45:58.326609+0000","last_fullsized":"2024-09-21T17:45:58.326609+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:19:41.892268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"60'15","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325709+0000","last_change":"2024-09-21T17:45:30.284142+0000","last_active":"2024-09-21T17:45:58.325709+0000","last_peered":"2024-09-21T17:45:58.325709+0000","last_clean":"2024-09-21T17:45:58.325709+0000","last_became_active":"2024-09-21T17:45:30.283075+0000","last_became_peered":"2024-09-21T17:45:30.283075+0000","last_unstale":"2024-09-21T17:45:58.325709+0000","last_undegraded":"2024-09-21T17:45:58.325709+0000","last_fullsized":"2024-09-21T17:45:58.325709+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:53.714375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.794747+0000","last_change":"2024-09-21T17:45:32.285388+0000","last_active":"2024-09-21T17:45:57.794747+0000","last_peered":"2024-09-21T17:45:57.794747+0000","last_clean":"2024-09-21T17:45:57.794747+0000","last_became_active":"2024-09-21T17:45:32.285101+0000","last_became_peered":"2024-09-21T17:45:32.285101+0000","last_unstale":"2024-09-21T17:45:57.794747+0000","last_undegraded":"2024-09-21T17:45:57.794747+0000","last_fullsized":"2024-09-21T17:45:57.794747+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:02:41.191258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575814+0000","last_change":"2024-09-21T17:45:28.266945+0000","last_active":"2024-09-21T17:45:57.575814+0000","last_peered":"2024-09-21T17:45:57.575814+0000","last_clean":"2024-09-21T17:45:57.575814+0000","last_became_active":"2024-09-21T17:45:28.266655+0000","last_became_peered":"2024-09-21T17:45:28.266655+0000","last_unstale":"2024-09-21T17:45:57.575814+0000","last_undegraded":"2024-09-21T17:45:57.575814+0000","last_fullsized":"2024-09-21T17:45:57.575814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:16:28.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795072+0000","last_change":"2024-09-21T17:45:30.283915+0000","last_active":"2024-09-21T17:45:57.795072+0000","last_peered":"2024-09-21T17:45:57.795072+0000","last_clean":"2024-09-21T17:45:57.795072+0000","last_became_active":"2024-09-21T17:45:30.283546+0000","last_became_peered":"2024-09-21T17:45:30.283546+0000","last_unstale":"2024-09-21T17:45:57.795072+0000","last_undegraded":"2024-09-21T17:45:57.795072+0000","last_fullsized":"2024-09-21T17:45:57.795072+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:59.618804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575339+0000","last_change":"2024-09-21T17:45:32.293716+0000","last_active":"2024-09-21T17:45:57.575339+0000","last_peered":"2024-09-21T17:45:57.575339+0000","last_clean":"2024-09-21T17:45:57.575339+0000","last_became_active":"2024-09-21T17:45:32.293419+0000","last_became_peered":"2024-09-21T17:45:32.293419+0000","last_unstale":"2024-09-21T17:45:57.575339+0000","last_undegraded":"2024-09-21T17:45:57.575339+0000","last_fullsized":"2024-09-21T17:45:57.575339+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:22:46.993494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.154962+0000","last_change":"2024-09-21T17:45:34.306844+0000","last_active":"2024-09-21T17:45:57.154962+0000","last_peered":"2024-09-21T17:45:57.154962+0000","last_clean":"2024-09-21T17:45:57.154962+0000","last_became_active":"2024-09-21T17:45:34.306418+0000","last_became_peered":"2024-09-21T17:45:34.306418+0000","last_unstale":"2024-09-21T17:45:57.154962+0000","last_undegraded":"2024-09-21T17:45:57.154962+0000","last_fullsized":"2024-09-21T17:45:57.154962+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:33:01.917182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575476+0000","last_change":"2024-09-21T17:45:28.266419+0000","last_active":"2024-09-21T17:45:57.575476+0000","last_peered":"2024-09-21T17:45:57.575476+0000","last_clean":"2024-09-21T17:45:57.575476+0000","last_became_active":"2024-09-21T17:45:28.266121+0000","last_became_peered":"2024-09-21T17:45:28.266121+0000","last_unstale":"2024-09-21T17:45:57.575476+0000","last_undegraded":"2024-09-21T17:45:57.575476+0000","last_fullsized":"2024-09-21T17:45:57.575476+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:24:25.294064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"60'5","reported_seq":36,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795026+0000","last_change":"2024-09-21T17:45:30.283965+0000","last_active":"2024-09-21T17:45:57.795026+0000","last_peered":"2024-09-21T17:45:57.795026+0000","last_clean":"2024-09-21T17:45:57.795026+0000","last_became_active":"2024-09-21T17:45:30.283630+0000","last_became_peered":"2024-09-21T17:45:30.283630+0000","last_unstale":"2024-09-21T17:45:57.795026+0000","last_undegraded":"2024-09-21T17:45:57.795026+0000","last_fullsized":"2024-09-21T17:45:57.795026+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:39.567305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156182+0000","last_change":"2024-09-21T17:45:32.288554+0000","last_active":"2024-09-21T17:45:57.156182+0000","last_peered":"2024-09-21T17:45:57.156182+0000","last_clean":"2024-09-21T17:45:57.156182+0000","last_became_active":"2024-09-21T17:45:32.288292+0000","last_became_peered":"2024-09-21T17:45:32.288292+0000","last_unstale":"2024-09-21T17:45:57.156182+0000","last_undegraded":"2024-09-21T17:45:57.156182+0000","last_fullsized":"2024-09-21T17:45:57.156182+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:30:16.222190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575169+0000","last_change":"2024-09-21T17:45:34.306842+0000","last_active":"2024-09-21T17:45:57.575169+0000","last_peered":"2024-09-21T17:45:57.575169+0000","last_clean":"2024-09-21T17:45:57.575169+0000","last_became_active":"2024-09-21T17:45:34.306564+0000","last_became_peered":"2024-09-21T17:45:34.306564+0000","last_unstale":"2024-09-21T17:45:57.575169+0000","last_undegraded":"2024-09-21T17:45:57.575169+0000","last_fullsized":"2024-09-21T17:45:57.575169+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:27:12.195459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795607+0000","last_change":"2024-09-21T17:45:34.305108+0000","last_active":"2024-09-21T17:45:57.795607+0000","last_peered":"2024-09-21T17:45:57.795607+0000","last_clean":"2024-09-21T17:45:57.795607+0000","last_became_active":"2024-09-21T17:45:34.304832+0000","last_became_peered":"2024-09-21T17:45:34.304832+0000","last_unstale":"2024-09-21T17:45:57.795607+0000","last_undegraded":"2024-09-21T17:45:57.795607+0000","last_fullsized":"2024-09-21T17:45:57.795607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:51:46.342768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155902+0000","last_change":"2024-09-21T17:45:28.272859+0000","last_active":"2024-09-21T17:45:57.155902+0000","last_peered":"2024-09-21T17:45:57.155902+0000","last_clean":"2024-09-21T17:45:57.155902+0000","last_became_active":"2024-09-21T17:45:28.272528+0000","last_became_peered":"2024-09-21T17:45:28.272528+0000","last_unstale":"2024-09-21T17:45:57.155902+0000","last_undegraded":"2024-09-21T17:45:57.155902+0000","last_fullsized":"2024-09-21T17:45:57.155902+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:48.598749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'15","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.651806+0000","last_change":"2024-09-21T17:45:30.286432+0000","last_active":"2024-09-21T17:45:57.651806+0000","last_peered":"2024-09-21T17:45:57.651806+0000","last_clean":"2024-09-21T17:45:57.651806+0000","last_became_active":"2024-09-21T17:45:30.286087+0000","last_became_peered":"2024-09-21T17:45:30.286087+0000","last_unstale":"2024-09-21T17:45:57.651806+0000","last_undegraded":"2024-09-21T17:45:57.651806+0000","last_fullsized":"2024-09-21T17:45:57.651806+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:41:16.754229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.157304+0000","last_change":"2024-09-21T17:45:32.295239+0000","last_active":"2024-09-21T17:45:57.157304+0000","last_peered":"2024-09-21T17:45:57.157304+0000","last_clean":"2024-09-21T17:45:57.157304+0000","last_became_active":"2024-09-21T17:45:32.294940+0000","last_became_peered":"2024-09-21T17:45:32.294940+0000","last_unstale":"2024-09-21T17:45:57.157304+0000","last_undegraded":"2024-09-21T17:45:57.157304+0000","last_fullsized":"2024-09-21T17:45:57.157304+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:57:06.034475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.324974+0000","last_change":"2024-09-21T17:45:34.306515+0000","last_active":"2024-09-21T17:45:58.324974+0000","last_peered":"2024-09-21T17:45:58.324974+0000","last_clean":"2024-09-21T17:45:58.324974+0000","last_became_active":"2024-09-21T17:45:34.306126+0000","last_became_peered":"2024-09-21T17:45:34.306126+0000","last_unstale":"2024-09-21T17:45:58.324974+0000","last_undegraded":"2024-09-21T17:45:58.324974+0000","last_fullsized":"2024-09-21T17:45:58.324974+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:22:57.960192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795312+0000","last_change":"2024-09-21T17:45:28.266988+0000","last_active":"2024-09-21T17:45:57.795312+0000","last_peered":"2024-09-21T17:45:57.795312+0000","last_clean":"2024-09-21T17:45:57.795312+0000","last_became_active":"2024-09-21T17:45:28.266718+0000","last_became_peered":"2024-09-21T17:45:28.266718+0000","last_unstale":"2024-09-21T17:45:57.795312+0000","last_undegraded":"2024-09-21T17:45:57.795312+0000","last_fullsized":"2024-09-21T17:45:57.795312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:08.885759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"60'12","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326240+0000","last_change":"2024-09-21T17:45:30.283618+0000","last_active":"2024-09-21T17:45:58.326240+0000","last_peered":"2024-09-21T17:45:58.326240+0000","last_clean":"2024-09-21T17:45:58.326240+0000","last_became_active":"2024-09-21T17:45:30.283322+0000","last_became_peered":"2024-09-21T17:45:30.283322+0000","last_unstale":"2024-09-21T17:45:58.326240+0000","last_undegraded":"2024-09-21T17:45:58.326240+0000","last_fullsized":"2024-09-21T17:45:58.326240+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:36:13.057699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795163+0000","last_change":"2024-09-21T17:45:32.288493+0000","last_active":"2024-09-21T17:45:57.795163+0000","last_peered":"2024-09-21T17:45:57.795163+0000","last_clean":"2024-09-21T17:45:57.795163+0000","last_became_active":"2024-09-21T17:45:32.288166+0000","last_became_peered":"2024-09-21T17:45:32.288166+0000","last_unstale":"2024-09-21T17:45:57.795163+0000","last_undegraded":"2024-09-21T17:45:57.795163+0000","last_fullsized":"2024-09-21T17:45:57.795163+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:14:30.613124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"60'1","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156836+0000","last_change":"2024-09-21T17:45:34.312028+0000","last_active":"2024-09-21T17:45:57.156836+0000","last_peered":"2024-09-21T17:45:57.156836+0000","last_clean":"2024-09-21T17:45:57.156836+0000","last_became_active":"2024-09-21T17:45:34.311614+0000","last_became_peered":"2024-09-21T17:45:34.311614+0000","last_unstale":"2024-09-21T17:45:57.156836+0000","last_undegraded":"2024-09-21T17:45:57.156836+0000","last_fullsized":"2024-09-21T17:45:57.156836+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:53:26.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"53'1","reported_seq":31,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156661+0000","last_change":"2024-09-21T17:45:28.264451+0000","last_active":"2024-09-21T17:45:57.156661+0000","last_peered":"2024-09-21T17:45:57.156661+0000","last_clean":"2024-09-21T17:45:57.156661+0000","last_became_active":"2024-09-21T17:45:28.264154+0000","last_became_peered":"2024-09-21T17:45:28.264154+0000","last_unstale":"2024-09-21T17:45:57.156661+0000","last_undegraded":"2024-09-21T17:45:57.156661+0000","last_fullsized":"2024-09-21T17:45:57.156661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:08:40.484028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'10","reported_seq":41,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155567+0000","last_change":"2024-09-21T17:45:30.493568+0000","last_active":"2024-09-21T17:45:57.155567+0000","last_peered":"2024-09-21T17:45:57.155567+0000","last_clean":"2024-09-21T17:45:57.155567+0000","last_became_active":"2024-09-21T17:45:30.493045+0000","last_became_peered":"2024-09-21T17:45:30.493045+0000","last_unstale":"2024-09-21T17:45:57.155567+0000","last_undegraded":"2024-09-21T17:45:57.155567+0000","last_fullsized":"2024-09-21T17:45:57.155567+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:25:30.745855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"60'8","reported_seq":41,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.323766+0000","last_change":"2024-09-21T17:45:32.286302+0000","last_active":"2024-09-21T17:45:58.323766+0000","last_peered":"2024-09-21T17:45:58.323766+0000","last_clean":"2024-09-21T17:45:58.323766+0000","last_became_active":"2024-09-21T17:45:32.286015+0000","last_became_peered":"2024-09-21T17:45:32.286015+0000","last_unstale":"2024-09-21T17:45:58.323766+0000","last_undegraded":"2024-09-21T17:45:58.323766+0000","last_fullsized":"2024-09-21T17:45:58.323766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:05.883828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"60'15","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.157274+0000","last_change":"2024-09-21T17:45:30.284549+0000","last_active":"2024-09-21T17:45:57.157274+0000","last_peered":"2024-09-21T17:45:57.157274+0000","last_clean":"2024-09-21T17:45:57.157274+0000","last_became_active":"2024-09-21T17:45:30.284250+0000","last_became_peered":"2024-09-21T17:45:30.284250+0000","last_unstale":"2024-09-21T17:45:57.157274+0000","last_undegraded":"2024-09-21T17:45:57.157274+0000","last_fullsized":"2024-09-21T17:45:57.157274+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:42.936878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325874+0000","last_change":"2024-09-21T17:45:28.264023+0000","last_active":"2024-09-21T17:45:58.325874+0000","last_peered":"2024-09-21T17:45:58.325874+0000","last_clean":"2024-09-21T17:45:58.325874+0000","last_became_active":"2024-09-21T17:45:28.263594+0000","last_became_peered":"2024-09-21T17:45:28.263594+0000","last_unstale":"2024-09-21T17:45:58.325874+0000","last_undegraded":"2024-09-21T17:45:58.325874+0000","last_fullsized":"2024-09-21T17:45:58.325874+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:47:05.029137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324868+0000","last_change":"2024-09-21T17:45:32.293259+0000","last_active":"2024-09-21T17:46:03.324868+0000","last_peered":"2024-09-21T17:46:03.324868+0000","last_clean":"2024-09-21T17:46:03.324868+0000","last_became_active":"2024-09-21T17:45:32.292968+0000","last_became_peered":"2024-09-21T17:45:32.292968+0000","last_unstale":"2024-09-21T17:46:03.324868+0000","last_undegraded":"2024-09-21T17:46:03.324868+0000","last_fullsized":"2024-09-21T17:46:03.324868+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:33:45.265118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575491+0000","last_change":"2024-09-21T17:45:34.307543+0000","last_active":"2024-09-21T17:45:57.575491+0000","last_peered":"2024-09-21T17:45:57.575491+0000","last_clean":"2024-09-21T17:45:57.575491+0000","last_became_active":"2024-09-21T17:45:34.307254+0000","last_became_peered":"2024-09-21T17:45:34.307254+0000","last_unstale":"2024-09-21T17:45:57.575491+0000","last_undegraded":"2024-09-21T17:45:57.575491+0000","last_fullsized":"2024-09-21T17:45:57.575491+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:58:26.751665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"60'18","reported_seq":58,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325606+0000","last_change":"2024-09-21T17:45:30.496591+0000","last_active":"2024-09-21T17:45:58.325606+0000","last_peered":"2024-09-21T17:45:58.325606+0000","last_clean":"2024-09-21T17:45:58.325606+0000","last_became_active":"2024-09-21T17:45:30.496278+0000","last_became_peered":"2024-09-21T17:45:30.496278+0000","last_unstale":"2024-09-21T17:45:58.325606+0000","last_undegraded":"2024-09-21T17:45:58.325606+0000","last_fullsized":"2024-09-21T17:45:58.325606+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:06:48.586416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326743+0000","last_change":"2024-09-21T17:45:28.271170+0000","last_active":"2024-09-21T17:45:58.326743+0000","last_peered":"2024-09-21T17:45:58.326743+0000","last_clean":"2024-09-21T17:45:58.326743+0000","last_became_active":"2024-09-21T17:45:28.270860+0000","last_became_peered":"2024-09-21T17:45:28.270860+0000","last_unstale":"2024-09-21T17:45:58.326743+0000","last_undegraded":"2024-09-21T17:45:58.326743+0000","last_fullsized":"2024-09-21T17:45:58.326743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:02.512909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.794847+0000","last_change":"2024-09-21T17:45:32.289203+0000","last_active":"2024-09-21T17:45:57.794847+0000","last_peered":"2024-09-21T17:45:57.794847+0000","last_clean":"2024-09-21T17:45:57.794847+0000","last_became_active":"2024-09-21T17:45:32.288345+0000","last_became_peered":"2024-09-21T17:45:32.288345+0000","last_unstale":"2024-09-21T17:45:57.794847+0000","last_undegraded":"2024-09-21T17:45:57.794847+0000","last_fullsized":"2024-09-21T17:45:57.794847+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:59.461168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795067+0000","last_change":"2024-09-21T17:45:34.306107+0000","last_active":"2024-09-21T17:45:57.795067+0000","last_peered":"2024-09-21T17:45:57.795067+0000","last_clean":"2024-09-21T17:45:57.795067+0000","last_became_active":"2024-09-21T17:45:34.305841+0000","last_became_peered":"2024-09-21T17:45:34.305841+0000","last_unstale":"2024-09-21T17:45:57.795067+0000","last_undegraded":"2024-09-21T17:45:57.795067+0000","last_fullsized":"2024-09-21T17:45:57.795067+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:30.344076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"60'14","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.794991+0000","last_change":"2024-09-21T17:45:30.277288+0000","last_active":"2024-09-21T17:45:57.794991+0000","last_peered":"2024-09-21T17:45:57.794991+0000","last_clean":"2024-09-21T17:45:57.794991+0000","last_became_active":"2024-09-21T17:45:30.276910+0000","last_became_peered":"2024-09-21T17:45:30.276910+0000","last_unstale":"2024-09-21T17:45:57.794991+0000","last_undegraded":"2024-09-21T17:45:57.794991+0000","last_fullsized":"2024-09-21T17:45:57.794991+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:27:53.558361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"53'1","reported_seq":31,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155797+0000","last_change":"2024-09-21T17:45:28.268522+0000","last_active":"2024-09-21T17:45:57.155797+0000","last_peered":"2024-09-21T17:45:57.155797+0000","last_clean":"2024-09-21T17:45:57.155797+0000","last_became_active":"2024-09-21T17:45:28.268223+0000","last_became_peered":"2024-09-21T17:45:28.268223+0000","last_unstale":"2024-09-21T17:45:57.155797+0000","last_undegraded":"2024-09-21T17:45:57.155797+0000","last_fullsized":"2024-09-21T17:45:57.155797+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:18.754359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324613+0000","last_change":"2024-09-21T17:45:32.289975+0000","last_active":"2024-09-21T17:46:03.324613+0000","last_peered":"2024-09-21T17:46:03.324613+0000","last_clean":"2024-09-21T17:46:03.324613+0000","last_became_active":"2024-09-21T17:45:32.289665+0000","last_became_peered":"2024-09-21T17:45:32.289665+0000","last_unstale":"2024-09-21T17:46:03.324613+0000","last_undegraded":"2024-09-21T17:46:03.324613+0000","last_fullsized":"2024-09-21T17:46:03.324613+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:57.619981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156222+0000","last_change":"2024-09-21T17:45:34.311732+0000","last_active":"2024-09-21T17:45:57.156222+0000","last_peered":"2024-09-21T17:45:57.156222+0000","last_clean":"2024-09-21T17:45:57.156222+0000","last_became_active":"2024-09-21T17:45:34.311404+0000","last_became_peered":"2024-09-21T17:45:34.311404+0000","last_unstale":"2024-09-21T17:45:57.156222+0000","last_undegraded":"2024-09-21T17:45:57.156222+0000","last_fullsized":"2024-09-21T17:45:57.156222+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:52:23.044718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"60'10","reported_seq":41,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156729+0000","last_change":"2024-09-21T17:45:30.278241+0000","last_active":"2024-09-21T17:45:57.156729+0000","last_peered":"2024-09-21T17:45:57.156729+0000","last_clean":"2024-09-21T17:45:57.156729+0000","last_became_active":"2024-09-21T17:45:30.276669+0000","last_became_peered":"2024-09-21T17:45:30.276669+0000","last_unstale":"2024-09-21T17:45:57.156729+0000","last_undegraded":"2024-09-21T17:45:57.156729+0000","last_fullsized":"2024-09-21T17:45:57.156729+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:36.780893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575911+0000","last_change":"2024-09-21T17:45:28.269768+0000","last_active":"2024-09-21T17:45:57.575911+0000","last_peered":"2024-09-21T17:45:57.575911+0000","last_clean":"2024-09-21T17:45:57.575911+0000","last_became_active":"2024-09-21T17:45:28.269443+0000","last_became_peered":"2024-09-21T17:45:28.269443+0000","last_unstale":"2024-09-21T17:45:57.575911+0000","last_undegraded":"2024-09-21T17:45:57.575911+0000","last_fullsized":"2024-09-21T17:45:57.575911+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:27:21.484314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324648+0000","last_change":"2024-09-21T17:45:32.293520+0000","last_active":"2024-09-21T17:46:03.324648+0000","last_peered":"2024-09-21T17:46:03.324648+0000","last_clean":"2024-09-21T17:46:03.324648+0000","last_became_active":"2024-09-21T17:45:32.293206+0000","last_became_peered":"2024-09-21T17:45:32.293206+0000","last_unstale":"2024-09-21T17:46:03.324648+0000","last_undegraded":"2024-09-21T17:46:03.324648+0000","last_fullsized":"2024-09-21T17:46:03.324648+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:48:16.150174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155211+0000","last_change":"2024-09-21T17:45:34.312162+0000","last_active":"2024-09-21T17:45:57.155211+0000","last_peered":"2024-09-21T17:45:57.155211+0000","last_clean":"2024-09-21T17:45:57.155211+0000","last_became_active":"2024-09-21T17:45:34.311696+0000","last_became_peered":"2024-09-21T17:45:34.311696+0000","last_unstale":"2024-09-21T17:45:57.155211+0000","last_undegraded":"2024-09-21T17:45:57.155211+0000","last_fullsized":"2024-09-21T17:45:57.155211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:52:40.183559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"60'19","reported_seq":62,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155780+0000","last_change":"2024-09-21T17:45:30.493592+0000","last_active":"2024-09-21T17:45:57.155780+0000","last_peered":"2024-09-21T17:45:57.155780+0000","last_clean":"2024-09-21T17:45:57.155780+0000","last_became_active":"2024-09-21T17:45:30.493233+0000","last_became_peered":"2024-09-21T17:45:30.493233+0000","last_unstale":"2024-09-21T17:45:57.155780+0000","last_undegraded":"2024-09-21T17:45:57.155780+0000","last_fullsized":"2024-09-21T17:45:57.155780+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:24.186379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.157698+0000","last_change":"2024-09-21T17:45:28.264405+0000","last_active":"2024-09-21T17:45:57.157698+0000","last_peered":"2024-09-21T17:45:57.157698+0000","last_clean":"2024-09-21T17:45:57.157698+0000","last_became_active":"2024-09-21T17:45:28.264095+0000","last_became_peered":"2024-09-21T17:45:28.264095+0000","last_unstale":"2024-09-21T17:45:57.157698+0000","last_undegraded":"2024-09-21T17:45:57.157698+0000","last_fullsized":"2024-09-21T17:45:57.157698+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:19.971676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.228755+0000","last_change":"2024-09-21T17:45:32.296142+0000","last_active":"2024-09-21T17:45:57.228755+0000","last_peered":"2024-09-21T17:45:57.228755+0000","last_clean":"2024-09-21T17:45:57.228755+0000","last_became_active":"2024-09-21T17:45:32.295848+0000","last_became_peered":"2024-09-21T17:45:32.295848+0000","last_unstale":"2024-09-21T17:45:57.228755+0000","last_undegraded":"2024-09-21T17:45:57.228755+0000","last_fullsized":"2024-09-21T17:45:57.228755+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:22:24.458415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156427+0000","last_change":"2024-09-21T17:45:34.294705+0000","last_active":"2024-09-21T17:45:57.156427+0000","last_peered":"2024-09-21T17:45:57.156427+0000","last_clean":"2024-09-21T17:45:57.156427+0000","last_became_active":"2024-09-21T17:45:34.294350+0000","last_became_peered":"2024-09-21T17:45:34.294350+0000","last_unstale":"2024-09-21T17:45:57.156427+0000","last_undegraded":"2024-09-21T17:45:57.156427+0000","last_fullsized":"2024-09-21T17:45:57.156427+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:29:40.245114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"60'28","reported_seq":82,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.323588+0000","last_change":"2024-09-21T17:45:30.283846+0000","last_active":"2024-09-21T17:45:58.323588+0000","last_peered":"2024-09-21T17:45:58.323588+0000","last_clean":"2024-09-21T17:45:58.323588+0000","last_became_active":"2024-09-21T17:45:30.283496+0000","last_became_peered":"2024-09-21T17:45:30.283496+0000","last_unstale":"2024-09-21T17:45:58.323588+0000","last_undegraded":"2024-09-21T17:45:58.323588+0000","last_fullsized":"2024-09-21T17:45:58.323588+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:07.163370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795502+0000","last_change":"2024-09-21T17:45:28.269632+0000","last_active":"2024-09-21T17:45:57.795502+0000","last_peered":"2024-09-21T17:45:57.795502+0000","last_clean":"2024-09-21T17:45:57.795502+0000","last_became_active":"2024-09-21T17:45:28.269143+0000","last_became_peered":"2024-09-21T17:45:28.269143+0000","last_unstale":"2024-09-21T17:45:57.795502+0000","last_undegraded":"2024-09-21T17:45:57.795502+0000","last_fullsized":"2024-09-21T17:45:57.795502+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:38:57.660986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"55'2","reported_seq":40,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575429+0000","last_change":"2024-09-21T17:45:30.275193+0000","last_active":"2024-09-21T17:45:57.575429+0000","last_peered":"2024-09-21T17:45:57.575429+0000","last_clean":"2024-09-21T17:45:57.575429+0000","last_became_active":"2024-09-21T17:45:27.254648+0000","last_became_peered":"2024-09-21T17:45:27.254648+0000","last_unstale":"2024-09-21T17:45:57.575429+0000","last_undegraded":"2024-09-21T17:45:57.575429+0000","last_fullsized":"2024-09-21T17:45:57.575429+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_clean_scrub_stamp":"2024-09-21T17:45:26.239001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:13:14.036886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001285631,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155401+0000","last_change":"2024-09-21T17:45:32.297605+0000","last_active":"2024-09-21T17:45:57.155401+0000","last_peered":"2024-09-21T17:45:57.155401+0000","last_clean":"2024-09-21T17:45:57.155401+0000","last_became_active":"2024-09-21T17:45:32.297306+0000","last_became_peered":"2024-09-21T17:45:32.297306+0000","last_unstale":"2024-09-21T17:45:57.155401+0000","last_undegraded":"2024-09-21T17:45:57.155401+0000","last_fullsized":"2024-09-21T17:45:57.155401+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:47:27.237308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325084+0000","last_change":"2024-09-21T17:45:34.313913+0000","last_active":"2024-09-21T17:45:58.325084+0000","last_peered":"2024-09-21T17:45:58.325084+0000","last_clean":"2024-09-21T17:45:58.325084+0000","last_became_active":"2024-09-21T17:45:34.313527+0000","last_became_peered":"2024-09-21T17:45:34.313527+0000","last_unstale":"2024-09-21T17:45:58.325084+0000","last_undegraded":"2024-09-21T17:45:58.325084+0000","last_fullsized":"2024-09-21T17:45:58.325084+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:51:12.377586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"60'13","reported_seq":53,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.157377+0000","last_change":"2024-09-21T17:45:30.277489+0000","last_active":"2024-09-21T17:45:57.157377+0000","last_peered":"2024-09-21T17:45:57.157377+0000","last_clean":"2024-09-21T17:45:57.157377+0000","last_became_active":"2024-09-21T17:45:30.277082+0000","last_became_peered":"2024-09-21T17:45:30.277082+0000","last_unstale":"2024-09-21T17:45:57.157377+0000","last_undegraded":"2024-09-21T17:45:57.157377+0000","last_fullsized":"2024-09-21T17:45:57.157377+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:57:04.965792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156897+0000","last_change":"2024-09-21T17:45:28.257114+0000","last_active":"2024-09-21T17:45:57.156897+0000","last_peered":"2024-09-21T17:45:57.156897+0000","last_clean":"2024-09-21T17:45:57.156897+0000","last_became_active":"2024-09-21T17:45:28.256603+0000","last_became_peered":"2024-09-21T17:45:28.256603+0000","last_unstale":"2024-09-21T17:45:57.156897+0000","last_undegraded":"2024-09-21T17:45:57.156897+0000","last_fullsized":"2024-09-21T17:45:57.156897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:58:22.281752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"53'1","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.651374+0000","last_change":"2024-09-21T17:45:30.274329+0000","last_active":"2024-09-21T17:45:57.651374+0000","last_peered":"2024-09-21T17:45:57.651374+0000","last_clean":"2024-09-21T17:45:57.651374+0000","last_became_active":"2024-09-21T17:45:27.254972+0000","last_became_peered":"2024-09-21T17:45:27.254972+0000","last_unstale":"2024-09-21T17:45:57.651374+0000","last_undegraded":"2024-09-21T17:45:57.651374+0000","last_fullsized":"2024-09-21T17:45:57.651374+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_clean_scrub_stamp":"2024-09-21T17:45:26.239001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:17:44.060723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057337200000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.652146+0000","last_change":"2024-09-21T17:45:32.286679+0000","last_active":"2024-09-21T17:45:57.652146+0000","last_peered":"2024-09-21T17:45:57.652146+0000","last_clean":"2024-09-21T17:45:57.652146+0000","last_became_active":"2024-09-21T17:45:32.286103+0000","last_became_peered":"2024-09-21T17:45:32.286103+0000","last_unstale":"2024-09-21T17:45:57.652146+0000","last_undegraded":"2024-09-21T17:45:57.652146+0000","last_fullsized":"2024-09-21T17:45:57.652146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:27:43.912701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156548+0000","last_change":"2024-09-21T17:45:34.311878+0000","last_active":"2024-09-21T17:45:57.156548+0000","last_peered":"2024-09-21T17:45:57.156548+0000","last_clean":"2024-09-21T17:45:57.156548+0000","last_became_active":"2024-09-21T17:45:34.311610+0000","last_became_peered":"2024-09-21T17:45:34.311610+0000","last_unstale":"2024-09-21T17:45:57.156548+0000","last_undegraded":"2024-09-21T17:45:57.156548+0000","last_fullsized":"2024-09-21T17:45:57.156548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:56:48.850235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"60'12","reported_seq":44,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155642+0000","last_change":"2024-09-21T17:45:30.276708+0000","last_active":"2024-09-21T17:45:57.155642+0000","last_peered":"2024-09-21T17:45:57.155642+0000","last_clean":"2024-09-21T17:45:57.155642+0000","last_became_active":"2024-09-21T17:45:30.276345+0000","last_became_peered":"2024-09-21T17:45:30.276345+0000","last_unstale":"2024-09-21T17:45:57.155642+0000","last_undegraded":"2024-09-21T17:45:57.155642+0000","last_fullsized":"2024-09-21T17:45:57.155642+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:56.532126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"53'1","reported_seq":36,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155048+0000","last_change":"2024-09-21T17:45:28.271893+0000","last_active":"2024-09-21T17:45:57.155048+0000","last_peered":"2024-09-21T17:45:57.155048+0000","last_clean":"2024-09-21T17:45:57.155048+0000","last_became_active":"2024-09-21T17:45:28.271601+0000","last_became_peered":"2024-09-21T17:45:28.271601+0000","last_unstale":"2024-09-21T17:45:57.155048+0000","last_undegraded":"2024-09-21T17:45:57.155048+0000","last_fullsized":"2024-09-21T17:45:57.155048+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:52:16.898385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"60'5","reported_seq":76,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:06.567178+0000","last_change":"2024-09-21T17:45:30.494861+0000","last_active":"2024-09-21T17:46:06.567178+0000","last_peered":"2024-09-21T17:46:06.567178+0000","last_clean":"2024-09-21T17:46:06.567178+0000","last_became_active":"2024-09-21T17:45:27.257275+0000","last_became_peered":"2024-09-21T17:45:27.257275+0000","last_unstale":"2024-09-21T17:46:06.567178+0000","last_undegraded":"2024-09-21T17:46:06.567178+0000","last_fullsized":"2024-09-21T17:46:06.567178+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_clean_scrub_stamp":"2024-09-21T17:45:26.239001+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:29:47.428273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000562923,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575942+0000","last_change":"2024-09-21T17:45:32.293417+0000","last_active":"2024-09-21T17:45:57.575942+0000","last_peered":"2024-09-21T17:45:57.575942+0000","last_clean":"2024-09-21T17:45:57.575942+0000","last_became_active":"2024-09-21T17:45:32.293031+0000","last_became_peered":"2024-09-21T17:45:32.293031+0000","last_unstale":"2024-09-21T17:45:57.575942+0000","last_undegraded":"2024-09-21T17:45:57.575942+0000","last_fullsized":"2024-09-21T17:45:57.575942+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:45:25.106260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156790+0000","last_change":"2024-09-21T17:45:34.308762+0000","last_active":"2024-09-21T17:45:57.156790+0000","last_peered":"2024-09-21T17:45:57.156790+0000","last_clean":"2024-09-21T17:45:57.156790+0000","last_became_active":"2024-09-21T17:45:34.308439+0000","last_became_peered":"2024-09-21T17:45:34.308439+0000","last_unstale":"2024-09-21T17:45:57.156790+0000","last_undegraded":"2024-09-21T17:45:57.156790+0000","last_fullsized":"2024-09-21T17:45:57.156790+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:30:18.618695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'16","reported_seq":56,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.324148+0000","last_change":"2024-09-21T17:45:30.494644+0000","last_active":"2024-09-21T17:45:58.324148+0000","last_peered":"2024-09-21T17:45:58.324148+0000","last_clean":"2024-09-21T17:45:58.324148+0000","last_became_active":"2024-09-21T17:45:30.494327+0000","last_became_peered":"2024-09-21T17:45:30.494327+0000","last_unstale":"2024-09-21T17:45:58.324148+0000","last_undegraded":"2024-09-21T17:45:58.324148+0000","last_fullsized":"2024-09-21T17:45:58.324148+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:43:58.804985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325941+0000","last_change":"2024-09-21T17:45:28.265612+0000","last_active":"2024-09-21T17:45:58.325941+0000","last_peered":"2024-09-21T17:45:58.325941+0000","last_clean":"2024-09-21T17:45:58.325941+0000","last_became_active":"2024-09-21T17:45:28.265334+0000","last_became_peered":"2024-09-21T17:45:28.265334+0000","last_unstale":"2024-09-21T17:45:58.325941+0000","last_undegraded":"2024-09-21T17:45:58.325941+0000","last_fullsized":"2024-09-21T17:45:58.325941+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:11:19.230410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"62'79","reported_seq":67,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:59.632451+0000","last_change":"2024-09-21T17:45:20.073246+0000","last_active":"2024-09-21T17:45:59.632451+0000","last_peered":"2024-09-21T17:45:59.632451+0000","last_clean":"2024-09-21T17:45:59.632451+0000","last_became_active":"2024-09-21T17:45:20.066853+0000","last_became_peered":"2024-09-21T17:45:20.066853+0000","last_unstale":"2024-09-21T17:45:59.632451+0000","last_undegraded":"2024-09-21T17:45:59.632451+0000","last_fullsized":"2024-09-21T17:45:59.632451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:43:17.508151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:43:17.508151+0000","last_clean_scrub_stamp":"2024-09-21T17:43:17.508151+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:06.821130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156354+0000","last_change":"2024-09-21T17:45:32.290229+0000","last_active":"2024-09-21T17:45:57.156354+0000","last_peered":"2024-09-21T17:45:57.156354+0000","last_clean":"2024-09-21T17:45:57.156354+0000","last_became_active":"2024-09-21T17:45:32.289796+0000","last_became_peered":"2024-09-21T17:45:32.289796+0000","last_unstale":"2024-09-21T17:45:57.156354+0000","last_undegraded":"2024-09-21T17:45:57.156354+0000","last_fullsized":"2024-09-21T17:45:57.156354+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:14:50.966110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575777+0000","last_change":"2024-09-21T17:45:34.311673+0000","last_active":"2024-09-21T17:45:57.575777+0000","last_peered":"2024-09-21T17:45:57.575777+0000","last_clean":"2024-09-21T17:45:57.575777+0000","last_became_active":"2024-09-21T17:45:34.311395+0000","last_became_peered":"2024-09-21T17:45:34.311395+0000","last_unstale":"2024-09-21T17:45:57.575777+0000","last_undegraded":"2024-09-21T17:45:57.575777+0000","last_fullsized":"2024-09-21T17:45:57.575777+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:22:53.099080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"60'11","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795768+0000","last_change":"2024-09-21T17:45:30.278416+0000","last_active":"2024-09-21T17:45:57.795768+0000","last_peered":"2024-09-21T17:45:57.795768+0000","last_clean":"2024-09-21T17:45:57.795768+0000","last_became_active":"2024-09-21T17:45:30.277995+0000","last_became_peered":"2024-09-21T17:45:30.277995+0000","last_unstale":"2024-09-21T17:45:57.795768+0000","last_undegraded":"2024-09-21T17:45:57.795768+0000","last_fullsized":"2024-09-21T17:45:57.795768+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:11:45.100985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795278+0000","last_change":"2024-09-21T17:45:28.264947+0000","last_active":"2024-09-21T17:45:57.795278+0000","last_peered":"2024-09-21T17:45:57.795278+0000","last_clean":"2024-09-21T17:45:57.795278+0000","last_became_active":"2024-09-21T17:45:28.264639+0000","last_became_peered":"2024-09-21T17:45:28.264639+0000","last_unstale":"2024-09-21T17:45:57.795278+0000","last_undegraded":"2024-09-21T17:45:57.795278+0000","last_fullsized":"2024-09-21T17:45:57.795278+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:49:23.684529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575750+0000","last_change":"2024-09-21T17:45:32.290382+0000","last_active":"2024-09-21T17:45:57.575750+0000","last_peered":"2024-09-21T17:45:57.575750+0000","last_clean":"2024-09-21T17:45:57.575750+0000","last_became_active":"2024-09-21T17:45:32.290111+0000","last_became_peered":"2024-09-21T17:45:32.290111+0000","last_unstale":"2024-09-21T17:45:57.575750+0000","last_undegraded":"2024-09-21T17:45:57.575750+0000","last_fullsized":"2024-09-21T17:45:57.575750+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:51:03.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325254+0000","last_change":"2024-09-21T17:45:34.313097+0000","last_active":"2024-09-21T17:45:58.325254+0000","last_peered":"2024-09-21T17:45:58.325254+0000","last_clean":"2024-09-21T17:45:58.325254+0000","last_became_active":"2024-09-21T17:45:34.312791+0000","last_became_peered":"2024-09-21T17:45:34.312791+0000","last_unstale":"2024-09-21T17:45:58.325254+0000","last_undegraded":"2024-09-21T17:45:58.325254+0000","last_fullsized":"2024-09-21T17:45:58.325254+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:42:46.665144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"60'17","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795648+0000","last_change":"2024-09-21T17:45:30.277108+0000","last_active":"2024-09-21T17:45:57.795648+0000","last_peered":"2024-09-21T17:45:57.795648+0000","last_clean":"2024-09-21T17:45:57.795648+0000","last_became_active":"2024-09-21T17:45:30.276746+0000","last_became_peered":"2024-09-21T17:45:30.276746+0000","last_unstale":"2024-09-21T17:45:57.795648+0000","last_undegraded":"2024-09-21T17:45:57.795648+0000","last_fullsized":"2024-09-21T17:45:57.795648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:22:59.904046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.229088+0000","last_change":"2024-09-21T17:45:28.263847+0000","last_active":"2024-09-21T17:45:57.229088+0000","last_peered":"2024-09-21T17:45:57.229088+0000","last_clean":"2024-09-21T17:45:57.229088+0000","last_became_active":"2024-09-21T17:45:28.263596+0000","last_became_peered":"2024-09-21T17:45:28.263596+0000","last_unstale":"2024-09-21T17:45:57.229088+0000","last_undegraded":"2024-09-21T17:45:57.229088+0000","last_fullsized":"2024-09-21T17:45:57.229088+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:09:26.387310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156888+0000","last_change":"2024-09-21T17:45:32.293757+0000","last_active":"2024-09-21T17:45:57.156888+0000","last_peered":"2024-09-21T17:45:57.156888+0000","last_clean":"2024-09-21T17:45:57.156888+0000","last_became_active":"2024-09-21T17:45:32.293429+0000","last_became_peered":"2024-09-21T17:45:32.293429+0000","last_unstale":"2024-09-21T17:45:57.156888+0000","last_undegraded":"2024-09-21T17:45:57.156888+0000","last_fullsized":"2024-09-21T17:45:57.156888+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:33:46.043985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.652350+0000","last_change":"2024-09-21T17:45:34.308095+0000","last_active":"2024-09-21T17:45:57.652350+0000","last_peered":"2024-09-21T17:45:57.652350+0000","last_clean":"2024-09-21T17:45:57.652350+0000","last_became_active":"2024-09-21T17:45:34.307752+0000","last_became_peered":"2024-09-21T17:45:34.307752+0000","last_unstale":"2024-09-21T17:45:57.652350+0000","last_undegraded":"2024-09-21T17:45:57.652350+0000","last_fullsized":"2024-09-21T17:45:57.652350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:20:20.111261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"60'10","reported_seq":41,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795278+0000","last_change":"2024-09-21T17:45:30.287057+0000","last_active":"2024-09-21T17:45:57.795278+0000","last_peered":"2024-09-21T17:45:57.795278+0000","last_clean":"2024-09-21T17:45:57.795278+0000","last_became_active":"2024-09-21T17:45:30.286638+0000","last_became_peered":"2024-09-21T17:45:30.286638+0000","last_unstale":"2024-09-21T17:45:57.795278+0000","last_undegraded":"2024-09-21T17:45:57.795278+0000","last_fullsized":"2024-09-21T17:45:57.795278+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:29:25.480225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326089+0000","last_change":"2024-09-21T17:45:28.268980+0000","last_active":"2024-09-21T17:45:58.326089+0000","last_peered":"2024-09-21T17:45:58.326089+0000","last_clean":"2024-09-21T17:45:58.326089+0000","last_became_active":"2024-09-21T17:45:28.268654+0000","last_became_peered":"2024-09-21T17:45:28.268654+0000","last_unstale":"2024-09-21T17:45:58.326089+0000","last_undegraded":"2024-09-21T17:45:58.326089+0000","last_fullsized":"2024-09-21T17:45:58.326089+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:29:49.767876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324606+0000","last_change":"2024-09-21T17:45:32.289361+0000","last_active":"2024-09-21T17:46:03.324606+0000","last_peered":"2024-09-21T17:46:03.324606+0000","last_clean":"2024-09-21T17:46:03.324606+0000","last_became_active":"2024-09-21T17:45:32.289039+0000","last_became_peered":"2024-09-21T17:45:32.289039+0000","last_unstale":"2024-09-21T17:46:03.324606+0000","last_undegraded":"2024-09-21T17:46:03.324606+0000","last_fullsized":"2024-09-21T17:46:03.324606+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:24.074394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795598+0000","last_change":"2024-09-21T17:45:34.302478+0000","last_active":"2024-09-21T17:45:57.795598+0000","last_peered":"2024-09-21T17:45:57.795598+0000","last_clean":"2024-09-21T17:45:57.795598+0000","last_became_active":"2024-09-21T17:45:34.302204+0000","last_became_peered":"2024-09-21T17:45:34.302204+0000","last_unstale":"2024-09-21T17:45:57.795598+0000","last_undegraded":"2024-09-21T17:45:57.795598+0000","last_fullsized":"2024-09-21T17:45:57.795598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:46.618015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155672+0000","last_change":"2024-09-21T17:45:30.274673+0000","last_active":"2024-09-21T17:45:57.155672+0000","last_peered":"2024-09-21T17:45:57.155672+0000","last_clean":"2024-09-21T17:45:57.155672+0000","last_became_active":"2024-09-21T17:45:30.274278+0000","last_became_peered":"2024-09-21T17:45:30.274278+0000","last_unstale":"2024-09-21T17:45:57.155672+0000","last_undegraded":"2024-09-21T17:45:57.155672+0000","last_fullsized":"2024-09-21T17:45:57.155672+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:18:43.460503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575561+0000","last_change":"2024-09-21T17:45:28.268066+0000","last_active":"2024-09-21T17:45:57.575561+0000","last_peered":"2024-09-21T17:45:57.575561+0000","last_clean":"2024-09-21T17:45:57.575561+0000","last_became_active":"2024-09-21T17:45:28.267782+0000","last_became_peered":"2024-09-21T17:45:28.267782+0000","last_unstale":"2024-09-21T17:45:57.575561+0000","last_undegraded":"2024-09-21T17:45:57.575561+0000","last_fullsized":"2024-09-21T17:45:57.575561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:54:28.509317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.651261+0000","last_change":"2024-09-21T17:45:32.287615+0000","last_active":"2024-09-21T17:45:57.651261+0000","last_peered":"2024-09-21T17:45:57.651261+0000","last_clean":"2024-09-21T17:45:57.651261+0000","last_became_active":"2024-09-21T17:45:32.287271+0000","last_became_peered":"2024-09-21T17:45:32.287271+0000","last_unstale":"2024-09-21T17:45:57.651261+0000","last_undegraded":"2024-09-21T17:45:57.651261+0000","last_fullsized":"2024-09-21T17:45:57.651261+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:53.919101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.154974+0000","last_change":"2024-09-21T17:45:34.305557+0000","last_active":"2024-09-21T17:45:57.154974+0000","last_peered":"2024-09-21T17:45:57.154974+0000","last_clean":"2024-09-21T17:45:57.154974+0000","last_became_active":"2024-09-21T17:45:34.305243+0000","last_became_peered":"2024-09-21T17:45:34.305243+0000","last_unstale":"2024-09-21T17:45:57.154974+0000","last_undegraded":"2024-09-21T17:45:57.154974+0000","last_fullsized":"2024-09-21T17:45:57.154974+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:32.515860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'19","reported_seq":57,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.228848+0000","last_change":"2024-09-21T17:45:30.493465+0000","last_active":"2024-09-21T17:45:57.228848+0000","last_peered":"2024-09-21T17:45:57.228848+0000","last_clean":"2024-09-21T17:45:57.228848+0000","last_became_active":"2024-09-21T17:45:30.493151+0000","last_became_peered":"2024-09-21T17:45:30.493151+0000","last_unstale":"2024-09-21T17:45:57.228848+0000","last_undegraded":"2024-09-21T17:45:57.228848+0000","last_fullsized":"2024-09-21T17:45:57.228848+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:10.871178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156818+0000","last_change":"2024-09-21T17:45:28.264453+0000","last_active":"2024-09-21T17:45:57.156818+0000","last_peered":"2024-09-21T17:45:57.156818+0000","last_clean":"2024-09-21T17:45:57.156818+0000","last_became_active":"2024-09-21T17:45:28.264164+0000","last_became_peered":"2024-09-21T17:45:28.264164+0000","last_unstale":"2024-09-21T17:45:57.156818+0000","last_undegraded":"2024-09-21T17:45:57.156818+0000","last_fullsized":"2024-09-21T17:45:57.156818+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:27.470221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.651342+0000","last_change":"2024-09-21T17:45:32.295370+0000","last_active":"2024-09-21T17:45:57.651342+0000","last_peered":"2024-09-21T17:45:57.651342+0000","last_clean":"2024-09-21T17:45:57.651342+0000","last_became_active":"2024-09-21T17:45:32.294790+0000","last_became_peered":"2024-09-21T17:45:32.294790+0000","last_unstale":"2024-09-21T17:45:57.651342+0000","last_undegraded":"2024-09-21T17:45:57.651342+0000","last_fullsized":"2024-09-21T17:45:57.651342+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:59:32.941690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156708+0000","last_change":"2024-09-21T17:45:34.313206+0000","last_active":"2024-09-21T17:45:57.156708+0000","last_peered":"2024-09-21T17:45:57.156708+0000","last_clean":"2024-09-21T17:45:57.156708+0000","last_became_active":"2024-09-21T17:45:34.312903+0000","last_became_peered":"2024-09-21T17:45:34.312903+0000","last_unstale":"2024-09-21T17:45:57.156708+0000","last_undegraded":"2024-09-21T17:45:57.156708+0000","last_fullsized":"2024-09-21T17:45:57.156708+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:33:55.926914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"60'12","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795069+0000","last_change":"2024-09-21T17:45:30.283980+0000","last_active":"2024-09-21T17:45:57.795069+0000","last_peered":"2024-09-21T17:45:57.795069+0000","last_clean":"2024-09-21T17:45:57.795069+0000","last_became_active":"2024-09-21T17:45:30.283670+0000","last_became_peered":"2024-09-21T17:45:30.283670+0000","last_unstale":"2024-09-21T17:45:57.795069+0000","last_undegraded":"2024-09-21T17:45:57.795069+0000","last_fullsized":"2024-09-21T17:45:57.795069+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:47:44.013632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.157026+0000","last_change":"2024-09-21T17:45:28.266940+0000","last_active":"2024-09-21T17:45:57.157026+0000","last_peered":"2024-09-21T17:45:57.157026+0000","last_clean":"2024-09-21T17:45:57.157026+0000","last_became_active":"2024-09-21T17:45:28.266635+0000","last_became_peered":"2024-09-21T17:45:28.266635+0000","last_unstale":"2024-09-21T17:45:57.157026+0000","last_undegraded":"2024-09-21T17:45:57.157026+0000","last_fullsized":"2024-09-21T17:45:57.157026+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:34:21.294717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.650958+0000","last_change":"2024-09-21T17:45:32.294294+0000","last_active":"2024-09-21T17:45:57.650958+0000","last_peered":"2024-09-21T17:45:57.650958+0000","last_clean":"2024-09-21T17:45:57.650958+0000","last_became_active":"2024-09-21T17:45:32.293955+0000","last_became_peered":"2024-09-21T17:45:32.293955+0000","last_unstale":"2024-09-21T17:45:57.650958+0000","last_undegraded":"2024-09-21T17:45:57.650958+0000","last_fullsized":"2024-09-21T17:45:57.650958+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:12:07.324972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325002+0000","last_change":"2024-09-21T17:45:34.313959+0000","last_active":"2024-09-21T17:45:58.325002+0000","last_peered":"2024-09-21T17:45:58.325002+0000","last_clean":"2024-09-21T17:45:58.325002+0000","last_became_active":"2024-09-21T17:45:34.313497+0000","last_became_peered":"2024-09-21T17:45:34.313497+0000","last_unstale":"2024-09-21T17:45:58.325002+0000","last_undegraded":"2024-09-21T17:45:58.325002+0000","last_fullsized":"2024-09-21T17:45:58.325002+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:06.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"60'15","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575049+0000","last_change":"2024-09-21T17:45:30.496302+0000","last_active":"2024-09-21T17:45:57.575049+0000","last_peered":"2024-09-21T17:45:57.575049+0000","last_clean":"2024-09-21T17:45:57.575049+0000","last_became_active":"2024-09-21T17:45:30.495921+0000","last_became_peered":"2024-09-21T17:45:30.495921+0000","last_unstale":"2024-09-21T17:45:57.575049+0000","last_undegraded":"2024-09-21T17:45:57.575049+0000","last_fullsized":"2024-09-21T17:45:57.575049+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:11:26.947164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"53'3","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156994+0000","last_change":"2024-09-21T17:45:28.271676+0000","last_active":"2024-09-21T17:45:57.156994+0000","last_peered":"2024-09-21T17:45:57.156994+0000","last_clean":"2024-09-21T17:45:57.156994+0000","last_became_active":"2024-09-21T17:45:28.271335+0000","last_became_peered":"2024-09-21T17:45:28.271335+0000","last_unstale":"2024-09-21T17:45:57.156994+0000","last_undegraded":"2024-09-21T17:45:57.156994+0000","last_fullsized":"2024-09-21T17:45:57.156994+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:17:58.993202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"60'8","reported_seq":38,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.324079+0000","last_change":"2024-09-21T17:45:32.290446+0000","last_active":"2024-09-21T17:45:58.324079+0000","last_peered":"2024-09-21T17:45:58.324079+0000","last_clean":"2024-09-21T17:45:58.324079+0000","last_became_active":"2024-09-21T17:45:32.290143+0000","last_became_peered":"2024-09-21T17:45:32.290143+0000","last_unstale":"2024-09-21T17:45:58.324079+0000","last_undegraded":"2024-09-21T17:45:58.324079+0000","last_fullsized":"2024-09-21T17:45:58.324079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:31.200568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575172+0000","last_change":"2024-09-21T17:45:34.305158+0000","last_active":"2024-09-21T17:45:57.575172+0000","last_peered":"2024-09-21T17:45:57.575172+0000","last_clean":"2024-09-21T17:45:57.575172+0000","last_became_active":"2024-09-21T17:45:34.304833+0000","last_became_peered":"2024-09-21T17:45:34.304833+0000","last_unstale":"2024-09-21T17:45:57.575172+0000","last_undegraded":"2024-09-21T17:45:57.575172+0000","last_fullsized":"2024-09-21T17:45:57.575172+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:56.803738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.228834+0000","last_change":"2024-09-21T17:45:28.271218+0000","last_active":"2024-09-21T17:45:57.228834+0000","last_peered":"2024-09-21T17:45:57.228834+0000","last_clean":"2024-09-21T17:45:57.228834+0000","last_became_active":"2024-09-21T17:45:28.270933+0000","last_became_peered":"2024-09-21T17:45:28.270933+0000","last_unstale":"2024-09-21T17:45:57.228834+0000","last_undegraded":"2024-09-21T17:45:57.228834+0000","last_fullsized":"2024-09-21T17:45:57.228834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:43:27.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"60'6","reported_seq":35,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326637+0000","last_change":"2024-09-21T17:45:30.496433+0000","last_active":"2024-09-21T17:45:58.326637+0000","last_peered":"2024-09-21T17:45:58.326637+0000","last_clean":"2024-09-21T17:45:58.326637+0000","last_became_active":"2024-09-21T17:45:30.495713+0000","last_became_peered":"2024-09-21T17:45:30.495713+0000","last_unstale":"2024-09-21T17:45:58.326637+0000","last_undegraded":"2024-09-21T17:45:58.326637+0000","last_fullsized":"2024-09-21T17:45:58.326637+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:44:08.216902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575713+0000","last_change":"2024-09-21T17:45:32.294282+0000","last_active":"2024-09-21T17:45:57.575713+0000","last_peered":"2024-09-21T17:45:57.575713+0000","last_clean":"2024-09-21T17:45:57.575713+0000","last_became_active":"2024-09-21T17:45:32.293972+0000","last_became_peered":"2024-09-21T17:45:32.293972+0000","last_unstale":"2024-09-21T17:45:57.575713+0000","last_undegraded":"2024-09-21T17:45:57.575713+0000","last_fullsized":"2024-09-21T17:45:57.575713+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:17:47.265533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156233+0000","last_change":"2024-09-21T17:45:34.308499+0000","last_active":"2024-09-21T17:45:57.156233+0000","last_peered":"2024-09-21T17:45:57.156233+0000","last_clean":"2024-09-21T17:45:57.156233+0000","last_became_active":"2024-09-21T17:45:34.308202+0000","last_became_peered":"2024-09-21T17:45:34.308202+0000","last_unstale":"2024-09-21T17:45:57.156233+0000","last_undegraded":"2024-09-21T17:45:57.156233+0000","last_fullsized":"2024-09-21T17:45:57.156233+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:21:30.379231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155702+0000","last_change":"2024-09-21T17:45:30.494488+0000","last_active":"2024-09-21T17:45:57.155702+0000","last_peered":"2024-09-21T17:45:57.155702+0000","last_clean":"2024-09-21T17:45:57.155702+0000","last_became_active":"2024-09-21T17:45:30.494181+0000","last_became_peered":"2024-09-21T17:45:30.494181+0000","last_unstale":"2024-09-21T17:45:57.155702+0000","last_undegraded":"2024-09-21T17:45:57.155702+0000","last_fullsized":"2024-09-21T17:45:57.155702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:02:45.248188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156390+0000","last_change":"2024-09-21T17:45:28.266862+0000","last_active":"2024-09-21T17:45:57.156390+0000","last_peered":"2024-09-21T17:45:57.156390+0000","last_clean":"2024-09-21T17:45:57.156390+0000","last_became_active":"2024-09-21T17:45:28.266464+0000","last_became_peered":"2024-09-21T17:45:28.266464+0000","last_unstale":"2024-09-21T17:45:57.156390+0000","last_undegraded":"2024-09-21T17:45:57.156390+0000","last_fullsized":"2024-09-21T17:45:57.156390+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:07:34.333645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326637+0000","last_change":"2024-09-21T17:45:32.288913+0000","last_active":"2024-09-21T17:45:58.326637+0000","last_peered":"2024-09-21T17:45:58.326637+0000","last_clean":"2024-09-21T17:45:58.326637+0000","last_became_active":"2024-09-21T17:45:32.288526+0000","last_became_peered":"2024-09-21T17:45:32.288526+0000","last_unstale":"2024-09-21T17:45:58.326637+0000","last_undegraded":"2024-09-21T17:45:58.326637+0000","last_fullsized":"2024-09-21T17:45:58.326637+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:02:22.497575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.651266+0000","last_change":"2024-09-21T17:45:34.309164+0000","last_active":"2024-09-21T17:45:57.651266+0000","last_peered":"2024-09-21T17:45:57.651266+0000","last_clean":"2024-09-21T17:45:57.651266+0000","last_became_active":"2024-09-21T17:45:34.308870+0000","last_became_peered":"2024-09-21T17:45:34.308870+0000","last_unstale":"2024-09-21T17:45:57.651266+0000","last_undegraded":"2024-09-21T17:45:57.651266+0000","last_fullsized":"2024-09-21T17:45:57.651266+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:36:10.419374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575761+0000","last_change":"2024-09-21T17:45:30.497013+0000","last_active":"2024-09-21T17:45:57.575761+0000","last_peered":"2024-09-21T17:45:57.575761+0000","last_clean":"2024-09-21T17:45:57.575761+0000","last_became_active":"2024-09-21T17:45:30.496696+0000","last_became_peered":"2024-09-21T17:45:30.496696+0000","last_unstale":"2024-09-21T17:45:57.575761+0000","last_undegraded":"2024-09-21T17:45:57.575761+0000","last_fullsized":"2024-09-21T17:45:57.575761+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:38:09.683947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155220+0000","last_change":"2024-09-21T17:45:28.268661+0000","last_active":"2024-09-21T17:45:57.155220+0000","last_peered":"2024-09-21T17:45:57.155220+0000","last_clean":"2024-09-21T17:45:57.155220+0000","last_became_active":"2024-09-21T17:45:28.268377+0000","last_became_peered":"2024-09-21T17:45:28.268377+0000","last_unstale":"2024-09-21T17:45:57.155220+0000","last_undegraded":"2024-09-21T17:45:57.155220+0000","last_fullsized":"2024-09-21T17:45:57.155220+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:52:52.298239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324660+0000","last_change":"2024-09-21T17:45:32.289519+0000","last_active":"2024-09-21T17:46:03.324660+0000","last_peered":"2024-09-21T17:46:03.324660+0000","last_clean":"2024-09-21T17:46:03.324660+0000","last_became_active":"2024-09-21T17:45:32.289209+0000","last_became_peered":"2024-09-21T17:45:32.289209+0000","last_unstale":"2024-09-21T17:46:03.324660+0000","last_undegraded":"2024-09-21T17:46:03.324660+0000","last_fullsized":"2024-09-21T17:46:03.324660+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:32:37.669483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795775+0000","last_change":"2024-09-21T17:45:34.306879+0000","last_active":"2024-09-21T17:45:57.795775+0000","last_peered":"2024-09-21T17:45:57.795775+0000","last_clean":"2024-09-21T17:45:57.795775+0000","last_became_active":"2024-09-21T17:45:34.306603+0000","last_became_peered":"2024-09-21T17:45:34.306603+0000","last_unstale":"2024-09-21T17:45:57.795775+0000","last_undegraded":"2024-09-21T17:45:57.795775+0000","last_fullsized":"2024-09-21T17:45:57.795775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:02:26.086368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"60'10","reported_seq":41,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326234+0000","last_change":"2024-09-21T17:45:30.495950+0000","last_active":"2024-09-21T17:45:58.326234+0000","last_peered":"2024-09-21T17:45:58.326234+0000","last_clean":"2024-09-21T17:45:58.326234+0000","last_became_active":"2024-09-21T17:45:30.495562+0000","last_became_peered":"2024-09-21T17:45:30.495562+0000","last_unstale":"2024-09-21T17:45:58.326234+0000","last_undegraded":"2024-09-21T17:45:58.326234+0000","last_fullsized":"2024-09-21T17:45:58.326234+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:38:17.479053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156510+0000","last_change":"2024-09-21T17:45:28.266511+0000","last_active":"2024-09-21T17:45:57.156510+0000","last_peered":"2024-09-21T17:45:57.156510+0000","last_clean":"2024-09-21T17:45:57.156510+0000","last_became_active":"2024-09-21T17:45:28.266233+0000","last_became_peered":"2024-09-21T17:45:28.266233+0000","last_unstale":"2024-09-21T17:45:57.156510+0000","last_undegraded":"2024-09-21T17:45:57.156510+0000","last_fullsized":"2024-09-21T17:45:57.156510+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:46.384134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"60'8","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324842+0000","last_change":"2024-09-21T17:45:32.293535+0000","last_active":"2024-09-21T17:46:03.324842+0000","last_peered":"2024-09-21T17:46:03.324842+0000","last_clean":"2024-09-21T17:46:03.324842+0000","last_became_active":"2024-09-21T17:45:32.293133+0000","last_became_peered":"2024-09-21T17:45:32.293133+0000","last_unstale":"2024-09-21T17:46:03.324842+0000","last_undegraded":"2024-09-21T17:46:03.324842+0000","last_fullsized":"2024-09-21T17:46:03.324842+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:26.880168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155362+0000","last_change":"2024-09-21T17:45:34.309013+0000","last_active":"2024-09-21T17:45:57.155362+0000","last_peered":"2024-09-21T17:45:57.155362+0000","last_clean":"2024-09-21T17:45:57.155362+0000","last_became_active":"2024-09-21T17:45:34.308453+0000","last_became_peered":"2024-09-21T17:45:34.308453+0000","last_unstale":"2024-09-21T17:45:57.155362+0000","last_undegraded":"2024-09-21T17:45:57.155362+0000","last_fullsized":"2024-09-21T17:45:57.155362+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:47.619623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'11","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795177+0000","last_change":"2024-09-21T17:45:30.278097+0000","last_active":"2024-09-21T17:45:57.795177+0000","last_peered":"2024-09-21T17:45:57.795177+0000","last_clean":"2024-09-21T17:45:57.795177+0000","last_became_active":"2024-09-21T17:45:30.277749+0000","last_became_peered":"2024-09-21T17:45:30.277749+0000","last_unstale":"2024-09-21T17:45:57.795177+0000","last_undegraded":"2024-09-21T17:45:57.795177+0000","last_fullsized":"2024-09-21T17:45:57.795177+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:24:46.172699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795466+0000","last_change":"2024-09-21T17:45:28.266150+0000","last_active":"2024-09-21T17:45:57.795466+0000","last_peered":"2024-09-21T17:45:57.795466+0000","last_clean":"2024-09-21T17:45:57.795466+0000","last_became_active":"2024-09-21T17:45:28.265790+0000","last_became_peered":"2024-09-21T17:45:28.265790+0000","last_unstale":"2024-09-21T17:45:57.795466+0000","last_undegraded":"2024-09-21T17:45:57.795466+0000","last_fullsized":"2024-09-21T17:45:57.795466+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:13.427658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156560+0000","last_change":"2024-09-21T17:45:32.290633+0000","last_active":"2024-09-21T17:45:57.156560+0000","last_peered":"2024-09-21T17:45:57.156560+0000","last_clean":"2024-09-21T17:45:57.156560+0000","last_became_active":"2024-09-21T17:45:32.290227+0000","last_became_peered":"2024-09-21T17:45:32.290227+0000","last_unstale":"2024-09-21T17:45:57.156560+0000","last_undegraded":"2024-09-21T17:45:57.156560+0000","last_fullsized":"2024-09-21T17:45:57.156560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:10.286217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.324741+0000","last_change":"2024-09-21T17:45:34.312510+0000","last_active":"2024-09-21T17:45:58.324741+0000","last_peered":"2024-09-21T17:45:58.324741+0000","last_clean":"2024-09-21T17:45:58.324741+0000","last_became_active":"2024-09-21T17:45:34.311165+0000","last_became_peered":"2024-09-21T17:45:34.311165+0000","last_unstale":"2024-09-21T17:45:58.324741+0000","last_undegraded":"2024-09-21T17:45:58.324741+0000","last_fullsized":"2024-09-21T17:45:58.324741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:39:08.312079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156925+0000","last_change":"2024-09-21T17:45:30.277998+0000","last_active":"2024-09-21T17:45:57.156925+0000","last_peered":"2024-09-21T17:45:57.156925+0000","last_clean":"2024-09-21T17:45:57.156925+0000","last_became_active":"2024-09-21T17:45:30.277710+0000","last_became_peered":"2024-09-21T17:45:30.277710+0000","last_unstale":"2024-09-21T17:45:57.156925+0000","last_undegraded":"2024-09-21T17:45:57.156925+0000","last_fullsized":"2024-09-21T17:45:57.156925+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:24:40.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156737+0000","last_change":"2024-09-21T17:45:28.267838+0000","last_active":"2024-09-21T17:45:57.156737+0000","last_peered":"2024-09-21T17:45:57.156737+0000","last_clean":"2024-09-21T17:45:57.156737+0000","last_became_active":"2024-09-21T17:45:28.267556+0000","last_became_peered":"2024-09-21T17:45:28.267556+0000","last_unstale":"2024-09-21T17:45:57.156737+0000","last_undegraded":"2024-09-21T17:45:57.156737+0000","last_fullsized":"2024-09-21T17:45:57.156737+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:07:50.187884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325968+0000","last_change":"2024-09-21T17:45:32.298260+0000","last_active":"2024-09-21T17:45:58.325968+0000","last_peered":"2024-09-21T17:45:58.325968+0000","last_clean":"2024-09-21T17:45:58.325968+0000","last_became_active":"2024-09-21T17:45:32.297834+0000","last_became_peered":"2024-09-21T17:45:32.297834+0000","last_unstale":"2024-09-21T17:45:58.325968+0000","last_undegraded":"2024-09-21T17:45:58.325968+0000","last_fullsized":"2024-09-21T17:45:58.325968+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:29.848063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.154865+0000","last_change":"2024-09-21T17:45:34.308884+0000","last_active":"2024-09-21T17:45:57.154865+0000","last_peered":"2024-09-21T17:45:57.154865+0000","last_clean":"2024-09-21T17:45:57.154865+0000","last_became_active":"2024-09-21T17:45:34.308515+0000","last_became_peered":"2024-09-21T17:45:34.308515+0000","last_unstale":"2024-09-21T17:45:57.154865+0000","last_undegraded":"2024-09-21T17:45:57.154865+0000","last_fullsized":"2024-09-21T17:45:57.154865+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:03:29.453060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'11","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325602+0000","last_change":"2024-09-21T17:45:30.496060+0000","last_active":"2024-09-21T17:45:58.325602+0000","last_peered":"2024-09-21T17:45:58.325602+0000","last_clean":"2024-09-21T17:45:58.325602+0000","last_became_active":"2024-09-21T17:45:30.495606+0000","last_became_peered":"2024-09-21T17:45:30.495606+0000","last_unstale":"2024-09-21T17:45:58.325602+0000","last_undegraded":"2024-09-21T17:45:58.325602+0000","last_fullsized":"2024-09-21T17:45:58.325602+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:34:48.258242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575747+0000","last_change":"2024-09-21T17:45:28.266056+0000","last_active":"2024-09-21T17:45:57.575747+0000","last_peered":"2024-09-21T17:45:57.575747+0000","last_clean":"2024-09-21T17:45:57.575747+0000","last_became_active":"2024-09-21T17:45:28.265719+0000","last_became_peered":"2024-09-21T17:45:28.265719+0000","last_unstale":"2024-09-21T17:45:57.575747+0000","last_undegraded":"2024-09-21T17:45:57.575747+0000","last_fullsized":"2024-09-21T17:45:57.575747+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:26:11.119353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155962+0000","last_change":"2024-09-21T17:45:32.291307+0000","last_active":"2024-09-21T17:45:57.155962+0000","last_peered":"2024-09-21T17:45:57.155962+0000","last_clean":"2024-09-21T17:45:57.155962+0000","last_became_active":"2024-09-21T17:45:32.290976+0000","last_became_peered":"2024-09-21T17:45:32.290976+0000","last_unstale":"2024-09-21T17:45:57.155962+0000","last_undegraded":"2024-09-21T17:45:57.155962+0000","last_fullsized":"2024-09-21T17:45:57.155962+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:28:22.935140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.324894+0000","last_change":"2024-09-21T17:45:34.306620+0000","last_active":"2024-09-21T17:45:58.324894+0000","last_peered":"2024-09-21T17:45:58.324894+0000","last_clean":"2024-09-21T17:45:58.324894+0000","last_became_active":"2024-09-21T17:45:34.305506+0000","last_became_peered":"2024-09-21T17:45:34.305506+0000","last_unstale":"2024-09-21T17:45:58.324894+0000","last_undegraded":"2024-09-21T17:45:58.324894+0000","last_fullsized":"2024-09-21T17:45:58.324894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:05:55.806569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"60'4","reported_seq":32,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325323+0000","last_change":"2024-09-21T17:45:30.283382+0000","last_active":"2024-09-21T17:45:58.325323+0000","last_peered":"2024-09-21T17:45:58.325323+0000","last_clean":"2024-09-21T17:45:58.325323+0000","last_became_active":"2024-09-21T17:45:30.283069+0000","last_became_peered":"2024-09-21T17:45:30.283069+0000","last_unstale":"2024-09-21T17:45:58.325323+0000","last_undegraded":"2024-09-21T17:45:58.325323+0000","last_fullsized":"2024-09-21T17:45:58.325323+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:51:20.470738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155651+0000","last_change":"2024-09-21T17:45:28.269616+0000","last_active":"2024-09-21T17:45:57.155651+0000","last_peered":"2024-09-21T17:45:57.155651+0000","last_clean":"2024-09-21T17:45:57.155651+0000","last_became_active":"2024-09-21T17:45:28.269096+0000","last_became_peered":"2024-09-21T17:45:28.269096+0000","last_unstale":"2024-09-21T17:45:57.155651+0000","last_undegraded":"2024-09-21T17:45:57.155651+0000","last_fullsized":"2024-09-21T17:45:57.155651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:40:35.598001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.228744+0000","last_change":"2024-09-21T17:45:32.286968+0000","last_active":"2024-09-21T17:45:57.228744+0000","last_peered":"2024-09-21T17:45:57.228744+0000","last_clean":"2024-09-21T17:45:57.228744+0000","last_became_active":"2024-09-21T17:45:32.286653+0000","last_became_peered":"2024-09-21T17:45:32.286653+0000","last_unstale":"2024-09-21T17:45:57.228744+0000","last_undegraded":"2024-09-21T17:45:57.228744+0000","last_fullsized":"2024-09-21T17:45:57.228744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:22:35.713004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156096+0000","last_change":"2024-09-21T17:45:34.312066+0000","last_active":"2024-09-21T17:45:57.156096+0000","last_peered":"2024-09-21T17:45:57.156096+0000","last_clean":"2024-09-21T17:45:57.156096+0000","last_became_active":"2024-09-21T17:45:34.311175+0000","last_became_peered":"2024-09-21T17:45:34.311175+0000","last_unstale":"2024-09-21T17:45:57.156096+0000","last_undegraded":"2024-09-21T17:45:57.156096+0000","last_fullsized":"2024-09-21T17:45:57.156096+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:15.424875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156837+0000","last_change":"2024-09-21T17:45:34.299079+0000","last_active":"2024-09-21T17:45:57.156837+0000","last_peered":"2024-09-21T17:45:57.156837+0000","last_clean":"2024-09-21T17:45:57.156837+0000","last_became_active":"2024-09-21T17:45:34.298773+0000","last_became_peered":"2024-09-21T17:45:34.298773+0000","last_unstale":"2024-09-21T17:45:57.156837+0000","last_undegraded":"2024-09-21T17:45:57.156837+0000","last_fullsized":"2024-09-21T17:45:57.156837+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:17:46.580007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325774+0000","last_change":"2024-09-21T17:45:28.272421+0000","last_active":"2024-09-21T17:45:58.325774+0000","last_peered":"2024-09-21T17:45:58.325774+0000","last_clean":"2024-09-21T17:45:58.325774+0000","last_became_active":"2024-09-21T17:45:28.272083+0000","last_became_peered":"2024-09-21T17:45:28.272083+0000","last_unstale":"2024-09-21T17:45:58.325774+0000","last_undegraded":"2024-09-21T17:45:58.325774+0000","last_fullsized":"2024-09-21T17:45:58.325774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:14.195969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"60'11","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.229298+0000","last_change":"2024-09-21T17:45:30.280021+0000","last_active":"2024-09-21T17:45:57.229298+0000","last_peered":"2024-09-21T17:45:57.229298+0000","last_clean":"2024-09-21T17:45:57.229298+0000","last_became_active":"2024-09-21T17:45:30.279657+0000","last_became_peered":"2024-09-21T17:45:30.279657+0000","last_unstale":"2024-09-21T17:45:57.229298+0000","last_undegraded":"2024-09-21T17:45:57.229298+0000","last_fullsized":"2024-09-21T17:45:57.229298+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:54:20.562355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155536+0000","last_change":"2024-09-21T17:45:32.297148+0000","last_active":"2024-09-21T17:45:57.155536+0000","last_peered":"2024-09-21T17:45:57.155536+0000","last_clean":"2024-09-21T17:45:57.155536+0000","last_became_active":"2024-09-21T17:45:32.296725+0000","last_became_peered":"2024-09-21T17:45:32.296725+0000","last_unstale":"2024-09-21T17:45:57.155536+0000","last_undegraded":"2024-09-21T17:45:57.155536+0000","last_fullsized":"2024-09-21T17:45:57.155536+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:30.516539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430218,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28224,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716928,"statfs":{"total":95995035648,"available":95966134272,"internally_reserved":0,"allocated":1228800,"data_stored":828781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28200,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716952,"statfs":{"total":95995035648,"available":95966158848,"internally_reserved":0,"allocated":1204224,"data_stored":827260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822679,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27624,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717528,"statfs":{"total":95995035648,"available":95966748672,"internally_reserved":0,"allocated":610304,"data_stored":237238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018907,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713336,"statfs":{"total":95995035648,"available":95962456064,"internally_reserved":0,"allocated":643072,"data_stored":238913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182433,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717488,"statfs":{"total":95995035648,"available":95966707712,"internally_reserved":0,"allocated":651264,"data_stored":238776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411366,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31776,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713376,"statfs":{"total":95995035648,"available":95962497024,"internally_reserved":0,"allocated":602112,"data_stored":237027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717468,"statfs":{"total":95995035648,"available":95966687232,"internally_reserved":0,"allocated":671744,"data_stored":238664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738414,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32392,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712760,"statfs":{"total":95995035648,"available":95961866240,"internally_reserved":0,"allocated":1232896,"data_stored":829470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T17:46:14.327 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T17:46:14.591 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:46:14.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T17:46:14.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='client.24617 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T17:46:14.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi042 to 3761M 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='client.24617 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi042 to 3761M 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:46:14.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T17:46:14.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T17:46:14.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T17:46:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='client.24617 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi042 to 3761M 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:14.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:15.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.114+0000 7f476edc2640 1 -- 172.21.15.42:0/3280419897 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4768102da0 msgr2=0x7f4768103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.114+0000 7f476edc2640 1 --2- 172.21.15.42:0/3280419897 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4768102da0 0x7f4768103180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f475c009900 tx=0x7f475c02a3f0 comp rx=0 tx=0).stop 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.114+0000 7f476edc2640 1 -- 172.21.15.42:0/3280419897 shutdown_connections 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.114+0000 7f476edc2640 1 --2- 172.21.15.42:0/3280419897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4768109130 0x7f476810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.114+0000 7f476edc2640 1 --2- 172.21.15.42:0/3280419897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47681087b0 0x7f4768108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.114+0000 7f476edc2640 1 --2- 172.21.15.42:0/3280419897 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4768102da0 0x7f4768103180 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.114+0000 7f476edc2640 1 -- 172.21.15.42:0/3280419897 >> 172.21.15.42:0/3280419897 conn(0x7f47680fe810 msgr2=0x7f4768100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.114+0000 7f476edc2640 1 -- 172.21.15.42:0/3280419897 shutdown_connections 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.114+0000 7f476edc2640 1 -- 172.21.15.42:0/3280419897 wait complete. 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476edc2640 1 Processor -- start 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476edc2640 1 -- start start 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476edc2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4768102da0 0x7f47680754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476edc2640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f47681087b0 0x7f47680759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476edc2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4768109130 0x7f4768075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:15.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476edc2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4768112500 con 0x7f4768102da0 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476edc2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4768112380 con 0x7f4768109130 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476edc2640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f4768112680 con 0x7f47681087b0 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476cb5e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4768102da0 0x7f47680754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f4767fff640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f47681087b0 0x7f47680759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476cb5e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4768102da0 0x7f47680754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60410/0 (socket says 172.21.15.42:60410) 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476cb5e640 1 -- 172.21.15.42:0/1495662380 learned_addr learned my addr 172.21.15.42:0/1495662380 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.115+0000 7f476d35f640 1 --2- 172.21.15.42:0/1495662380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4768109130 0x7f4768075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f476cb5e640 1 -- 172.21.15.42:0/1495662380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f47681087b0 msgr2=0x7f47680759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f476cb5e640 1 --2- 172.21.15.42:0/1495662380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f47681087b0 0x7f47680759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f476cb5e640 1 -- 172.21.15.42:0/1495662380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4768109130 msgr2=0x7f4768075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f476cb5e640 1 --2- 172.21.15.42:0/1495662380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4768109130 0x7f4768075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f476cb5e640 1 -- 172.21.15.42:0/1495662380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47681a6df0 con 0x7f4768102da0 2024-09-21T17:46:15.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f476d35f640 1 --2- 172.21.15.42:0/1495662380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4768109130 0x7f4768075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f4767fff640 1 --2- 172.21.15.42:0/1495662380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f47681087b0 0x7f47680759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f476cb5e640 1 --2- 172.21.15.42:0/1495662380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4768102da0 0x7f47680754a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f475c005940 tx=0x7f475c032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f4765ffb640 1 -- 172.21.15.42:0/1495662380 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c03f030 con 0x7f4768102da0 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f4765ffb640 1 -- 172.21.15.42:0/1495662380 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f475c005480 con 0x7f4768102da0 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f476edc2640 1 -- 172.21.15.42:0/1495662380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47681a7080 con 0x7f4768102da0 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f4765ffb640 1 -- 172.21.15.42:0/1495662380 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c035070 con 0x7f4768102da0 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.116+0000 7f476edc2640 1 -- 172.21.15.42:0/1495662380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47681a75b0 con 0x7f4768102da0 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.117+0000 7f476edc2640 1 -- 172.21.15.42:0/1495662380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4768103180 con 0x7f4768102da0 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.118+0000 7f4765ffb640 1 -- 172.21.15.42:0/1495662380 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f475c042030 con 0x7f4768102da0 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.119+0000 7f4765ffb640 1 --2- 172.21.15.42:0/1495662380 >> v2:172.21.15.42:6800/36970769 conn(0x7f475807b110 0x7f475807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.119+0000 7f4767fff640 1 --2- 172.21.15.42:0/1495662380 >> v2:172.21.15.42:6800/36970769 conn(0x7f475807b110 0x7f475807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.119+0000 7f4765ffb640 1 -- 172.21.15.42:0/1495662380 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7f475c0be7b0 con 0x7f4768102da0 2024-09-21T17:46:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.119+0000 7f4767fff640 1 --2- 172.21.15.42:0/1495662380 >> v2:172.21.15.42:6800/36970769 conn(0x7f475807b110 0x7f475807d5d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4768076f90 tx=0x7f475400a250 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:15.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.123+0000 7f4765ffb640 1 -- 172.21.15.42:0/1495662380 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f475c089d80 con 0x7f4768102da0 2024-09-21T17:46:15.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.309+0000 7f476edc2640 1 -- 172.21.15.42:0/1495662380 --> v2:172.21.15.42:6800/36970769 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4768063590 con 0x7f475807b110 2024-09-21T17:46:15.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.315+0000 7f4765ffb640 1 -- 172.21.15.42:0/1495662380 <== mgr.14598 v2:172.21.15.42:6800/36970769 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346434 (secure 0 0 0) 0x7f4768063590 con 0x7f475807b110 2024-09-21T17:46:15.320 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:46:15.322 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-21T17:46:15.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.319+0000 7f476edc2640 1 -- 172.21.15.42:0/1495662380 >> v2:172.21.15.42:6800/36970769 conn(0x7f475807b110 msgr2=0x7f475807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:15.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.319+0000 7f476edc2640 1 --2- 172.21.15.42:0/1495662380 >> v2:172.21.15.42:6800/36970769 conn(0x7f475807b110 0x7f475807d5d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4768076f90 tx=0x7f475400a250 comp rx=0 tx=0).stop 2024-09-21T17:46:15.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.319+0000 7f476edc2640 1 -- 172.21.15.42:0/1495662380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4768102da0 msgr2=0x7f47680754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:15.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.319+0000 7f476edc2640 1 --2- 172.21.15.42:0/1495662380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4768102da0 0x7f47680754a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f475c005940 tx=0x7f475c032c70 comp rx=0 tx=0).stop 2024-09-21T17:46:15.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.319+0000 7f476edc2640 1 -- 172.21.15.42:0/1495662380 shutdown_connections 2024-09-21T17:46:15.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.319+0000 7f476edc2640 1 --2- 172.21.15.42:0/1495662380 >> v2:172.21.15.42:6800/36970769 conn(0x7f475807b110 0x7f475807d5d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:15.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.319+0000 7f476edc2640 1 --2- 172.21.15.42:0/1495662380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4768109130 0x7f4768075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:15.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.319+0000 7f476edc2640 1 --2- 172.21.15.42:0/1495662380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f47681087b0 0x7f47680759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:15.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.319+0000 7f476edc2640 1 --2- 172.21.15.42:0/1495662380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4768102da0 0x7f47680754a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:15.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.319+0000 7f476edc2640 1 -- 172.21.15.42:0/1495662380 >> 172.21.15.42:0/1495662380 conn(0x7f47680fe810 msgr2=0x7f4768100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:15.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.319+0000 7f476edc2640 1 -- 172.21.15.42:0/1495662380 shutdown_connections 2024-09-21T17:46:15.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:15.320+0000 7f476edc2640 1 -- 172.21.15.42:0/1495662380 wait complete. 2024-09-21T17:46:15.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[29361]: Updating smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:46:15.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[29361]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:46:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[29361]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:46:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[29361]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:46:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[29361]: Updating smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T17:46:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[29361]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T17:46:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[29361]: Deploying daemon alertmanager.a on smithi042 2024-09-21T17:46:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[38309]: Updating smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:46:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[38309]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:46:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[38309]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:46:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[38309]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:46:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[38309]: Updating smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T17:46:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[38309]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T17:46:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:15 smithi042 ceph-mon[38309]: Deploying daemon alertmanager.a on smithi042 2024-09-21T17:46:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:15 smithi162 ceph-mon[32106]: Updating smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:46:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:15 smithi162 ceph-mon[32106]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T17:46:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:15 smithi162 ceph-mon[32106]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:46:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:15 smithi162 ceph-mon[32106]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T17:46:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:15 smithi162 ceph-mon[32106]: Updating smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T17:46:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:15 smithi162 ceph-mon[32106]: Updating smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T17:46:15.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:15 smithi162 ceph-mon[32106]: Deploying daemon alertmanager.a on smithi042 2024-09-21T17:46:16.346 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-21T17:46:15.171060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":888,"num_read_kb":745,"num_write":549,"num_write_kb":1673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":552,"ondisk_log_size":552,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":235380,"kb_used_data":6684,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":749725836,"statfs":{"total":767960285184,"available":767719256064,"internally_reserved":0,"allocated":6844416,"data_stored":3676129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":191,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002737"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155555+0000","last_change":"2024-09-21T17:45:28.273698+0000","last_active":"2024-09-21T17:45:57.155555+0000","last_peered":"2024-09-21T17:45:57.155555+0000","last_clean":"2024-09-21T17:45:57.155555+0000","last_became_active":"2024-09-21T17:45:28.273409+0000","last_became_peered":"2024-09-21T17:45:28.273409+0000","last_unstale":"2024-09-21T17:45:57.155555+0000","last_undegraded":"2024-09-21T17:45:57.155555+0000","last_fullsized":"2024-09-21T17:45:57.155555+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:23:22.913929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.794780+0000","last_change":"2024-09-21T17:45:30.278895+0000","last_active":"2024-09-21T17:45:57.794780+0000","last_peered":"2024-09-21T17:45:57.794780+0000","last_clean":"2024-09-21T17:45:57.794780+0000","last_became_active":"2024-09-21T17:45:30.278555+0000","last_became_peered":"2024-09-21T17:45:30.278555+0000","last_unstale":"2024-09-21T17:45:57.794780+0000","last_undegraded":"2024-09-21T17:45:57.794780+0000","last_fullsized":"2024-09-21T17:45:57.794780+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:42:50.272397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156523+0000","last_change":"2024-09-21T17:45:32.285397+0000","last_active":"2024-09-21T17:45:57.156523+0000","last_peered":"2024-09-21T17:45:57.156523+0000","last_clean":"2024-09-21T17:45:57.156523+0000","last_became_active":"2024-09-21T17:45:32.285089+0000","last_became_peered":"2024-09-21T17:45:32.285089+0000","last_unstale":"2024-09-21T17:45:57.156523+0000","last_undegraded":"2024-09-21T17:45:57.156523+0000","last_fullsized":"2024-09-21T17:45:57.156523+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:43:49.823726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.794935+0000","last_change":"2024-09-21T17:45:34.305939+0000","last_active":"2024-09-21T17:45:57.794935+0000","last_peered":"2024-09-21T17:45:57.794935+0000","last_clean":"2024-09-21T17:45:57.794935+0000","last_became_active":"2024-09-21T17:45:34.305662+0000","last_became_peered":"2024-09-21T17:45:34.305662+0000","last_unstale":"2024-09-21T17:45:57.794935+0000","last_undegraded":"2024-09-21T17:45:57.794935+0000","last_fullsized":"2024-09-21T17:45:57.794935+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:21.023722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"60'1","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325092+0000","last_change":"2024-09-21T17:45:34.313830+0000","last_active":"2024-09-21T17:45:58.325092+0000","last_peered":"2024-09-21T17:45:58.325092+0000","last_clean":"2024-09-21T17:45:58.325092+0000","last_became_active":"2024-09-21T17:45:34.313161+0000","last_became_peered":"2024-09-21T17:45:34.313161+0000","last_unstale":"2024-09-21T17:45:58.325092+0000","last_undegraded":"2024-09-21T17:45:58.325092+0000","last_fullsized":"2024-09-21T17:45:58.325092+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:11:01.947571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326609+0000","last_change":"2024-09-21T17:45:28.263666+0000","last_active":"2024-09-21T17:45:58.326609+0000","last_peered":"2024-09-21T17:45:58.326609+0000","last_clean":"2024-09-21T17:45:58.326609+0000","last_became_active":"2024-09-21T17:45:28.263176+0000","last_became_peered":"2024-09-21T17:45:28.263176+0000","last_unstale":"2024-09-21T17:45:58.326609+0000","last_undegraded":"2024-09-21T17:45:58.326609+0000","last_fullsized":"2024-09-21T17:45:58.326609+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:19:41.892268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"60'15","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325709+0000","last_change":"2024-09-21T17:45:30.284142+0000","last_active":"2024-09-21T17:45:58.325709+0000","last_peered":"2024-09-21T17:45:58.325709+0000","last_clean":"2024-09-21T17:45:58.325709+0000","last_became_active":"2024-09-21T17:45:30.283075+0000","last_became_peered":"2024-09-21T17:45:30.283075+0000","last_unstale":"2024-09-21T17:45:58.325709+0000","last_undegraded":"2024-09-21T17:45:58.325709+0000","last_fullsized":"2024-09-21T17:45:58.325709+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:53.714375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.794747+0000","last_change":"2024-09-21T17:45:32.285388+0000","last_active":"2024-09-21T17:45:57.794747+0000","last_peered":"2024-09-21T17:45:57.794747+0000","last_clean":"2024-09-21T17:45:57.794747+0000","last_became_active":"2024-09-21T17:45:32.285101+0000","last_became_peered":"2024-09-21T17:45:32.285101+0000","last_unstale":"2024-09-21T17:45:57.794747+0000","last_undegraded":"2024-09-21T17:45:57.794747+0000","last_fullsized":"2024-09-21T17:45:57.794747+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:02:41.191258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575814+0000","last_change":"2024-09-21T17:45:28.266945+0000","last_active":"2024-09-21T17:45:57.575814+0000","last_peered":"2024-09-21T17:45:57.575814+0000","last_clean":"2024-09-21T17:45:57.575814+0000","last_became_active":"2024-09-21T17:45:28.266655+0000","last_became_peered":"2024-09-21T17:45:28.266655+0000","last_unstale":"2024-09-21T17:45:57.575814+0000","last_undegraded":"2024-09-21T17:45:57.575814+0000","last_fullsized":"2024-09-21T17:45:57.575814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:16:28.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795072+0000","last_change":"2024-09-21T17:45:30.283915+0000","last_active":"2024-09-21T17:45:57.795072+0000","last_peered":"2024-09-21T17:45:57.795072+0000","last_clean":"2024-09-21T17:45:57.795072+0000","last_became_active":"2024-09-21T17:45:30.283546+0000","last_became_peered":"2024-09-21T17:45:30.283546+0000","last_unstale":"2024-09-21T17:45:57.795072+0000","last_undegraded":"2024-09-21T17:45:57.795072+0000","last_fullsized":"2024-09-21T17:45:57.795072+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:59.618804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575339+0000","last_change":"2024-09-21T17:45:32.293716+0000","last_active":"2024-09-21T17:45:57.575339+0000","last_peered":"2024-09-21T17:45:57.575339+0000","last_clean":"2024-09-21T17:45:57.575339+0000","last_became_active":"2024-09-21T17:45:32.293419+0000","last_became_peered":"2024-09-21T17:45:32.293419+0000","last_unstale":"2024-09-21T17:45:57.575339+0000","last_undegraded":"2024-09-21T17:45:57.575339+0000","last_fullsized":"2024-09-21T17:45:57.575339+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:22:46.993494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.154962+0000","last_change":"2024-09-21T17:45:34.306844+0000","last_active":"2024-09-21T17:45:57.154962+0000","last_peered":"2024-09-21T17:45:57.154962+0000","last_clean":"2024-09-21T17:45:57.154962+0000","last_became_active":"2024-09-21T17:45:34.306418+0000","last_became_peered":"2024-09-21T17:45:34.306418+0000","last_unstale":"2024-09-21T17:45:57.154962+0000","last_undegraded":"2024-09-21T17:45:57.154962+0000","last_fullsized":"2024-09-21T17:45:57.154962+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:33:01.917182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575476+0000","last_change":"2024-09-21T17:45:28.266419+0000","last_active":"2024-09-21T17:45:57.575476+0000","last_peered":"2024-09-21T17:45:57.575476+0000","last_clean":"2024-09-21T17:45:57.575476+0000","last_became_active":"2024-09-21T17:45:28.266121+0000","last_became_peered":"2024-09-21T17:45:28.266121+0000","last_unstale":"2024-09-21T17:45:57.575476+0000","last_undegraded":"2024-09-21T17:45:57.575476+0000","last_fullsized":"2024-09-21T17:45:57.575476+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:24:25.294064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"60'5","reported_seq":36,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795026+0000","last_change":"2024-09-21T17:45:30.283965+0000","last_active":"2024-09-21T17:45:57.795026+0000","last_peered":"2024-09-21T17:45:57.795026+0000","last_clean":"2024-09-21T17:45:57.795026+0000","last_became_active":"2024-09-21T17:45:30.283630+0000","last_became_peered":"2024-09-21T17:45:30.283630+0000","last_unstale":"2024-09-21T17:45:57.795026+0000","last_undegraded":"2024-09-21T17:45:57.795026+0000","last_fullsized":"2024-09-21T17:45:57.795026+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:39.567305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156182+0000","last_change":"2024-09-21T17:45:32.288554+0000","last_active":"2024-09-21T17:45:57.156182+0000","last_peered":"2024-09-21T17:45:57.156182+0000","last_clean":"2024-09-21T17:45:57.156182+0000","last_became_active":"2024-09-21T17:45:32.288292+0000","last_became_peered":"2024-09-21T17:45:32.288292+0000","last_unstale":"2024-09-21T17:45:57.156182+0000","last_undegraded":"2024-09-21T17:45:57.156182+0000","last_fullsized":"2024-09-21T17:45:57.156182+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:30:16.222190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575169+0000","last_change":"2024-09-21T17:45:34.306842+0000","last_active":"2024-09-21T17:45:57.575169+0000","last_peered":"2024-09-21T17:45:57.575169+0000","last_clean":"2024-09-21T17:45:57.575169+0000","last_became_active":"2024-09-21T17:45:34.306564+0000","last_became_peered":"2024-09-21T17:45:34.306564+0000","last_unstale":"2024-09-21T17:45:57.575169+0000","last_undegraded":"2024-09-21T17:45:57.575169+0000","last_fullsized":"2024-09-21T17:45:57.575169+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:27:12.195459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795607+0000","last_change":"2024-09-21T17:45:34.305108+0000","last_active":"2024-09-21T17:45:57.795607+0000","last_peered":"2024-09-21T17:45:57.795607+0000","last_clean":"2024-09-21T17:45:57.795607+0000","last_became_active":"2024-09-21T17:45:34.304832+0000","last_became_peered":"2024-09-21T17:45:34.304832+0000","last_unstale":"2024-09-21T17:45:57.795607+0000","last_undegraded":"2024-09-21T17:45:57.795607+0000","last_fullsized":"2024-09-21T17:45:57.795607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:51:46.342768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155902+0000","last_change":"2024-09-21T17:45:28.272859+0000","last_active":"2024-09-21T17:45:57.155902+0000","last_peered":"2024-09-21T17:45:57.155902+0000","last_clean":"2024-09-21T17:45:57.155902+0000","last_became_active":"2024-09-21T17:45:28.272528+0000","last_became_peered":"2024-09-21T17:45:28.272528+0000","last_unstale":"2024-09-21T17:45:57.155902+0000","last_undegraded":"2024-09-21T17:45:57.155902+0000","last_fullsized":"2024-09-21T17:45:57.155902+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:48.598749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'15","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.651806+0000","last_change":"2024-09-21T17:45:30.286432+0000","last_active":"2024-09-21T17:45:57.651806+0000","last_peered":"2024-09-21T17:45:57.651806+0000","last_clean":"2024-09-21T17:45:57.651806+0000","last_became_active":"2024-09-21T17:45:30.286087+0000","last_became_peered":"2024-09-21T17:45:30.286087+0000","last_unstale":"2024-09-21T17:45:57.651806+0000","last_undegraded":"2024-09-21T17:45:57.651806+0000","last_fullsized":"2024-09-21T17:45:57.651806+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:41:16.754229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.157304+0000","last_change":"2024-09-21T17:45:32.295239+0000","last_active":"2024-09-21T17:45:57.157304+0000","last_peered":"2024-09-21T17:45:57.157304+0000","last_clean":"2024-09-21T17:45:57.157304+0000","last_became_active":"2024-09-21T17:45:32.294940+0000","last_became_peered":"2024-09-21T17:45:32.294940+0000","last_unstale":"2024-09-21T17:45:57.157304+0000","last_undegraded":"2024-09-21T17:45:57.157304+0000","last_fullsized":"2024-09-21T17:45:57.157304+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:57:06.034475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.324974+0000","last_change":"2024-09-21T17:45:34.306515+0000","last_active":"2024-09-21T17:45:58.324974+0000","last_peered":"2024-09-21T17:45:58.324974+0000","last_clean":"2024-09-21T17:45:58.324974+0000","last_became_active":"2024-09-21T17:45:34.306126+0000","last_became_peered":"2024-09-21T17:45:34.306126+0000","last_unstale":"2024-09-21T17:45:58.324974+0000","last_undegraded":"2024-09-21T17:45:58.324974+0000","last_fullsized":"2024-09-21T17:45:58.324974+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:22:57.960192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795312+0000","last_change":"2024-09-21T17:45:28.266988+0000","last_active":"2024-09-21T17:45:57.795312+0000","last_peered":"2024-09-21T17:45:57.795312+0000","last_clean":"2024-09-21T17:45:57.795312+0000","last_became_active":"2024-09-21T17:45:28.266718+0000","last_became_peered":"2024-09-21T17:45:28.266718+0000","last_unstale":"2024-09-21T17:45:57.795312+0000","last_undegraded":"2024-09-21T17:45:57.795312+0000","last_fullsized":"2024-09-21T17:45:57.795312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:08.885759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"60'12","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326240+0000","last_change":"2024-09-21T17:45:30.283618+0000","last_active":"2024-09-21T17:45:58.326240+0000","last_peered":"2024-09-21T17:45:58.326240+0000","last_clean":"2024-09-21T17:45:58.326240+0000","last_became_active":"2024-09-21T17:45:30.283322+0000","last_became_peered":"2024-09-21T17:45:30.283322+0000","last_unstale":"2024-09-21T17:45:58.326240+0000","last_undegraded":"2024-09-21T17:45:58.326240+0000","last_fullsized":"2024-09-21T17:45:58.326240+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:36:13.057699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795163+0000","last_change":"2024-09-21T17:45:32.288493+0000","last_active":"2024-09-21T17:45:57.795163+0000","last_peered":"2024-09-21T17:45:57.795163+0000","last_clean":"2024-09-21T17:45:57.795163+0000","last_became_active":"2024-09-21T17:45:32.288166+0000","last_became_peered":"2024-09-21T17:45:32.288166+0000","last_unstale":"2024-09-21T17:45:57.795163+0000","last_undegraded":"2024-09-21T17:45:57.795163+0000","last_fullsized":"2024-09-21T17:45:57.795163+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:14:30.613124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"60'1","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156836+0000","last_change":"2024-09-21T17:45:34.312028+0000","last_active":"2024-09-21T17:45:57.156836+0000","last_peered":"2024-09-21T17:45:57.156836+0000","last_clean":"2024-09-21T17:45:57.156836+0000","last_became_active":"2024-09-21T17:45:34.311614+0000","last_became_peered":"2024-09-21T17:45:34.311614+0000","last_unstale":"2024-09-21T17:45:57.156836+0000","last_undegraded":"2024-09-21T17:45:57.156836+0000","last_fullsized":"2024-09-21T17:45:57.156836+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:53:26.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"53'1","reported_seq":31,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156661+0000","last_change":"2024-09-21T17:45:28.264451+0000","last_active":"2024-09-21T17:45:57.156661+0000","last_peered":"2024-09-21T17:45:57.156661+0000","last_clean":"2024-09-21T17:45:57.156661+0000","last_became_active":"2024-09-21T17:45:28.264154+0000","last_became_peered":"2024-09-21T17:45:28.264154+0000","last_unstale":"2024-09-21T17:45:57.156661+0000","last_undegraded":"2024-09-21T17:45:57.156661+0000","last_fullsized":"2024-09-21T17:45:57.156661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:08:40.484028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'10","reported_seq":41,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155567+0000","last_change":"2024-09-21T17:45:30.493568+0000","last_active":"2024-09-21T17:45:57.155567+0000","last_peered":"2024-09-21T17:45:57.155567+0000","last_clean":"2024-09-21T17:45:57.155567+0000","last_became_active":"2024-09-21T17:45:30.493045+0000","last_became_peered":"2024-09-21T17:45:30.493045+0000","last_unstale":"2024-09-21T17:45:57.155567+0000","last_undegraded":"2024-09-21T17:45:57.155567+0000","last_fullsized":"2024-09-21T17:45:57.155567+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:25:30.745855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"60'8","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324842+0000","last_change":"2024-09-21T17:45:32.286302+0000","last_active":"2024-09-21T17:46:03.324842+0000","last_peered":"2024-09-21T17:46:03.324842+0000","last_clean":"2024-09-21T17:46:03.324842+0000","last_became_active":"2024-09-21T17:45:32.286015+0000","last_became_peered":"2024-09-21T17:45:32.286015+0000","last_unstale":"2024-09-21T17:46:03.324842+0000","last_undegraded":"2024-09-21T17:46:03.324842+0000","last_fullsized":"2024-09-21T17:46:03.324842+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:05.883828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"60'15","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.157274+0000","last_change":"2024-09-21T17:45:30.284549+0000","last_active":"2024-09-21T17:45:57.157274+0000","last_peered":"2024-09-21T17:45:57.157274+0000","last_clean":"2024-09-21T17:45:57.157274+0000","last_became_active":"2024-09-21T17:45:30.284250+0000","last_became_peered":"2024-09-21T17:45:30.284250+0000","last_unstale":"2024-09-21T17:45:57.157274+0000","last_undegraded":"2024-09-21T17:45:57.157274+0000","last_fullsized":"2024-09-21T17:45:57.157274+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:42.936878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325874+0000","last_change":"2024-09-21T17:45:28.264023+0000","last_active":"2024-09-21T17:45:58.325874+0000","last_peered":"2024-09-21T17:45:58.325874+0000","last_clean":"2024-09-21T17:45:58.325874+0000","last_became_active":"2024-09-21T17:45:28.263594+0000","last_became_peered":"2024-09-21T17:45:28.263594+0000","last_unstale":"2024-09-21T17:45:58.325874+0000","last_undegraded":"2024-09-21T17:45:58.325874+0000","last_fullsized":"2024-09-21T17:45:58.325874+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:47:05.029137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324868+0000","last_change":"2024-09-21T17:45:32.293259+0000","last_active":"2024-09-21T17:46:03.324868+0000","last_peered":"2024-09-21T17:46:03.324868+0000","last_clean":"2024-09-21T17:46:03.324868+0000","last_became_active":"2024-09-21T17:45:32.292968+0000","last_became_peered":"2024-09-21T17:45:32.292968+0000","last_unstale":"2024-09-21T17:46:03.324868+0000","last_undegraded":"2024-09-21T17:46:03.324868+0000","last_fullsized":"2024-09-21T17:46:03.324868+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:33:45.265118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575491+0000","last_change":"2024-09-21T17:45:34.307543+0000","last_active":"2024-09-21T17:45:57.575491+0000","last_peered":"2024-09-21T17:45:57.575491+0000","last_clean":"2024-09-21T17:45:57.575491+0000","last_became_active":"2024-09-21T17:45:34.307254+0000","last_became_peered":"2024-09-21T17:45:34.307254+0000","last_unstale":"2024-09-21T17:45:57.575491+0000","last_undegraded":"2024-09-21T17:45:57.575491+0000","last_fullsized":"2024-09-21T17:45:57.575491+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:58:26.751665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"60'18","reported_seq":58,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325606+0000","last_change":"2024-09-21T17:45:30.496591+0000","last_active":"2024-09-21T17:45:58.325606+0000","last_peered":"2024-09-21T17:45:58.325606+0000","last_clean":"2024-09-21T17:45:58.325606+0000","last_became_active":"2024-09-21T17:45:30.496278+0000","last_became_peered":"2024-09-21T17:45:30.496278+0000","last_unstale":"2024-09-21T17:45:58.325606+0000","last_undegraded":"2024-09-21T17:45:58.325606+0000","last_fullsized":"2024-09-21T17:45:58.325606+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:06:48.586416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326743+0000","last_change":"2024-09-21T17:45:28.271170+0000","last_active":"2024-09-21T17:45:58.326743+0000","last_peered":"2024-09-21T17:45:58.326743+0000","last_clean":"2024-09-21T17:45:58.326743+0000","last_became_active":"2024-09-21T17:45:28.270860+0000","last_became_peered":"2024-09-21T17:45:28.270860+0000","last_unstale":"2024-09-21T17:45:58.326743+0000","last_undegraded":"2024-09-21T17:45:58.326743+0000","last_fullsized":"2024-09-21T17:45:58.326743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:02.512909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.794847+0000","last_change":"2024-09-21T17:45:32.289203+0000","last_active":"2024-09-21T17:45:57.794847+0000","last_peered":"2024-09-21T17:45:57.794847+0000","last_clean":"2024-09-21T17:45:57.794847+0000","last_became_active":"2024-09-21T17:45:32.288345+0000","last_became_peered":"2024-09-21T17:45:32.288345+0000","last_unstale":"2024-09-21T17:45:57.794847+0000","last_undegraded":"2024-09-21T17:45:57.794847+0000","last_fullsized":"2024-09-21T17:45:57.794847+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:59.461168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795067+0000","last_change":"2024-09-21T17:45:34.306107+0000","last_active":"2024-09-21T17:45:57.795067+0000","last_peered":"2024-09-21T17:45:57.795067+0000","last_clean":"2024-09-21T17:45:57.795067+0000","last_became_active":"2024-09-21T17:45:34.305841+0000","last_became_peered":"2024-09-21T17:45:34.305841+0000","last_unstale":"2024-09-21T17:45:57.795067+0000","last_undegraded":"2024-09-21T17:45:57.795067+0000","last_fullsized":"2024-09-21T17:45:57.795067+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:30.344076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"60'14","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.794991+0000","last_change":"2024-09-21T17:45:30.277288+0000","last_active":"2024-09-21T17:45:57.794991+0000","last_peered":"2024-09-21T17:45:57.794991+0000","last_clean":"2024-09-21T17:45:57.794991+0000","last_became_active":"2024-09-21T17:45:30.276910+0000","last_became_peered":"2024-09-21T17:45:30.276910+0000","last_unstale":"2024-09-21T17:45:57.794991+0000","last_undegraded":"2024-09-21T17:45:57.794991+0000","last_fullsized":"2024-09-21T17:45:57.794991+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:27:53.558361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"53'1","reported_seq":31,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155797+0000","last_change":"2024-09-21T17:45:28.268522+0000","last_active":"2024-09-21T17:45:57.155797+0000","last_peered":"2024-09-21T17:45:57.155797+0000","last_clean":"2024-09-21T17:45:57.155797+0000","last_became_active":"2024-09-21T17:45:28.268223+0000","last_became_peered":"2024-09-21T17:45:28.268223+0000","last_unstale":"2024-09-21T17:45:57.155797+0000","last_undegraded":"2024-09-21T17:45:57.155797+0000","last_fullsized":"2024-09-21T17:45:57.155797+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:18.754359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324613+0000","last_change":"2024-09-21T17:45:32.289975+0000","last_active":"2024-09-21T17:46:03.324613+0000","last_peered":"2024-09-21T17:46:03.324613+0000","last_clean":"2024-09-21T17:46:03.324613+0000","last_became_active":"2024-09-21T17:45:32.289665+0000","last_became_peered":"2024-09-21T17:45:32.289665+0000","last_unstale":"2024-09-21T17:46:03.324613+0000","last_undegraded":"2024-09-21T17:46:03.324613+0000","last_fullsized":"2024-09-21T17:46:03.324613+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:57.619981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156222+0000","last_change":"2024-09-21T17:45:34.311732+0000","last_active":"2024-09-21T17:45:57.156222+0000","last_peered":"2024-09-21T17:45:57.156222+0000","last_clean":"2024-09-21T17:45:57.156222+0000","last_became_active":"2024-09-21T17:45:34.311404+0000","last_became_peered":"2024-09-21T17:45:34.311404+0000","last_unstale":"2024-09-21T17:45:57.156222+0000","last_undegraded":"2024-09-21T17:45:57.156222+0000","last_fullsized":"2024-09-21T17:45:57.156222+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:52:23.044718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"60'10","reported_seq":41,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156729+0000","last_change":"2024-09-21T17:45:30.278241+0000","last_active":"2024-09-21T17:45:57.156729+0000","last_peered":"2024-09-21T17:45:57.156729+0000","last_clean":"2024-09-21T17:45:57.156729+0000","last_became_active":"2024-09-21T17:45:30.276669+0000","last_became_peered":"2024-09-21T17:45:30.276669+0000","last_unstale":"2024-09-21T17:45:57.156729+0000","last_undegraded":"2024-09-21T17:45:57.156729+0000","last_fullsized":"2024-09-21T17:45:57.156729+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:36.780893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575911+0000","last_change":"2024-09-21T17:45:28.269768+0000","last_active":"2024-09-21T17:45:57.575911+0000","last_peered":"2024-09-21T17:45:57.575911+0000","last_clean":"2024-09-21T17:45:57.575911+0000","last_became_active":"2024-09-21T17:45:28.269443+0000","last_became_peered":"2024-09-21T17:45:28.269443+0000","last_unstale":"2024-09-21T17:45:57.575911+0000","last_undegraded":"2024-09-21T17:45:57.575911+0000","last_fullsized":"2024-09-21T17:45:57.575911+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:27:21.484314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324648+0000","last_change":"2024-09-21T17:45:32.293520+0000","last_active":"2024-09-21T17:46:03.324648+0000","last_peered":"2024-09-21T17:46:03.324648+0000","last_clean":"2024-09-21T17:46:03.324648+0000","last_became_active":"2024-09-21T17:45:32.293206+0000","last_became_peered":"2024-09-21T17:45:32.293206+0000","last_unstale":"2024-09-21T17:46:03.324648+0000","last_undegraded":"2024-09-21T17:46:03.324648+0000","last_fullsized":"2024-09-21T17:46:03.324648+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:48:16.150174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155211+0000","last_change":"2024-09-21T17:45:34.312162+0000","last_active":"2024-09-21T17:45:57.155211+0000","last_peered":"2024-09-21T17:45:57.155211+0000","last_clean":"2024-09-21T17:45:57.155211+0000","last_became_active":"2024-09-21T17:45:34.311696+0000","last_became_peered":"2024-09-21T17:45:34.311696+0000","last_unstale":"2024-09-21T17:45:57.155211+0000","last_undegraded":"2024-09-21T17:45:57.155211+0000","last_fullsized":"2024-09-21T17:45:57.155211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:52:40.183559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"60'19","reported_seq":62,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155780+0000","last_change":"2024-09-21T17:45:30.493592+0000","last_active":"2024-09-21T17:45:57.155780+0000","last_peered":"2024-09-21T17:45:57.155780+0000","last_clean":"2024-09-21T17:45:57.155780+0000","last_became_active":"2024-09-21T17:45:30.493233+0000","last_became_peered":"2024-09-21T17:45:30.493233+0000","last_unstale":"2024-09-21T17:45:57.155780+0000","last_undegraded":"2024-09-21T17:45:57.155780+0000","last_fullsized":"2024-09-21T17:45:57.155780+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:24.186379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.157698+0000","last_change":"2024-09-21T17:45:28.264405+0000","last_active":"2024-09-21T17:45:57.157698+0000","last_peered":"2024-09-21T17:45:57.157698+0000","last_clean":"2024-09-21T17:45:57.157698+0000","last_became_active":"2024-09-21T17:45:28.264095+0000","last_became_peered":"2024-09-21T17:45:28.264095+0000","last_unstale":"2024-09-21T17:45:57.157698+0000","last_undegraded":"2024-09-21T17:45:57.157698+0000","last_fullsized":"2024-09-21T17:45:57.157698+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:19.971676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.228755+0000","last_change":"2024-09-21T17:45:32.296142+0000","last_active":"2024-09-21T17:45:57.228755+0000","last_peered":"2024-09-21T17:45:57.228755+0000","last_clean":"2024-09-21T17:45:57.228755+0000","last_became_active":"2024-09-21T17:45:32.295848+0000","last_became_peered":"2024-09-21T17:45:32.295848+0000","last_unstale":"2024-09-21T17:45:57.228755+0000","last_undegraded":"2024-09-21T17:45:57.228755+0000","last_fullsized":"2024-09-21T17:45:57.228755+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:22:24.458415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156427+0000","last_change":"2024-09-21T17:45:34.294705+0000","last_active":"2024-09-21T17:45:57.156427+0000","last_peered":"2024-09-21T17:45:57.156427+0000","last_clean":"2024-09-21T17:45:57.156427+0000","last_became_active":"2024-09-21T17:45:34.294350+0000","last_became_peered":"2024-09-21T17:45:34.294350+0000","last_unstale":"2024-09-21T17:45:57.156427+0000","last_undegraded":"2024-09-21T17:45:57.156427+0000","last_fullsized":"2024-09-21T17:45:57.156427+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:29:40.245114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"60'28","reported_seq":83,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324606+0000","last_change":"2024-09-21T17:45:30.283846+0000","last_active":"2024-09-21T17:46:03.324606+0000","last_peered":"2024-09-21T17:46:03.324606+0000","last_clean":"2024-09-21T17:46:03.324606+0000","last_became_active":"2024-09-21T17:45:30.283496+0000","last_became_peered":"2024-09-21T17:45:30.283496+0000","last_unstale":"2024-09-21T17:46:03.324606+0000","last_undegraded":"2024-09-21T17:46:03.324606+0000","last_fullsized":"2024-09-21T17:46:03.324606+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:07.163370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795502+0000","last_change":"2024-09-21T17:45:28.269632+0000","last_active":"2024-09-21T17:45:57.795502+0000","last_peered":"2024-09-21T17:45:57.795502+0000","last_clean":"2024-09-21T17:45:57.795502+0000","last_became_active":"2024-09-21T17:45:28.269143+0000","last_became_peered":"2024-09-21T17:45:28.269143+0000","last_unstale":"2024-09-21T17:45:57.795502+0000","last_undegraded":"2024-09-21T17:45:57.795502+0000","last_fullsized":"2024-09-21T17:45:57.795502+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:38:57.660986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"55'2","reported_seq":40,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575429+0000","last_change":"2024-09-21T17:45:30.275193+0000","last_active":"2024-09-21T17:45:57.575429+0000","last_peered":"2024-09-21T17:45:57.575429+0000","last_clean":"2024-09-21T17:45:57.575429+0000","last_became_active":"2024-09-21T17:45:27.254648+0000","last_became_peered":"2024-09-21T17:45:27.254648+0000","last_unstale":"2024-09-21T17:45:57.575429+0000","last_undegraded":"2024-09-21T17:45:57.575429+0000","last_fullsized":"2024-09-21T17:45:57.575429+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_clean_scrub_stamp":"2024-09-21T17:45:26.239001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:13:14.036886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001285631,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155401+0000","last_change":"2024-09-21T17:45:32.297605+0000","last_active":"2024-09-21T17:45:57.155401+0000","last_peered":"2024-09-21T17:45:57.155401+0000","last_clean":"2024-09-21T17:45:57.155401+0000","last_became_active":"2024-09-21T17:45:32.297306+0000","last_became_peered":"2024-09-21T17:45:32.297306+0000","last_unstale":"2024-09-21T17:45:57.155401+0000","last_undegraded":"2024-09-21T17:45:57.155401+0000","last_fullsized":"2024-09-21T17:45:57.155401+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:47:27.237308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325084+0000","last_change":"2024-09-21T17:45:34.313913+0000","last_active":"2024-09-21T17:45:58.325084+0000","last_peered":"2024-09-21T17:45:58.325084+0000","last_clean":"2024-09-21T17:45:58.325084+0000","last_became_active":"2024-09-21T17:45:34.313527+0000","last_became_peered":"2024-09-21T17:45:34.313527+0000","last_unstale":"2024-09-21T17:45:58.325084+0000","last_undegraded":"2024-09-21T17:45:58.325084+0000","last_fullsized":"2024-09-21T17:45:58.325084+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:51:12.377586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"60'13","reported_seq":53,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.157377+0000","last_change":"2024-09-21T17:45:30.277489+0000","last_active":"2024-09-21T17:45:57.157377+0000","last_peered":"2024-09-21T17:45:57.157377+0000","last_clean":"2024-09-21T17:45:57.157377+0000","last_became_active":"2024-09-21T17:45:30.277082+0000","last_became_peered":"2024-09-21T17:45:30.277082+0000","last_unstale":"2024-09-21T17:45:57.157377+0000","last_undegraded":"2024-09-21T17:45:57.157377+0000","last_fullsized":"2024-09-21T17:45:57.157377+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:57:04.965792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156897+0000","last_change":"2024-09-21T17:45:28.257114+0000","last_active":"2024-09-21T17:45:57.156897+0000","last_peered":"2024-09-21T17:45:57.156897+0000","last_clean":"2024-09-21T17:45:57.156897+0000","last_became_active":"2024-09-21T17:45:28.256603+0000","last_became_peered":"2024-09-21T17:45:28.256603+0000","last_unstale":"2024-09-21T17:45:57.156897+0000","last_undegraded":"2024-09-21T17:45:57.156897+0000","last_fullsized":"2024-09-21T17:45:57.156897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:58:22.281752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"53'1","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.651374+0000","last_change":"2024-09-21T17:45:30.274329+0000","last_active":"2024-09-21T17:45:57.651374+0000","last_peered":"2024-09-21T17:45:57.651374+0000","last_clean":"2024-09-21T17:45:57.651374+0000","last_became_active":"2024-09-21T17:45:27.254972+0000","last_became_peered":"2024-09-21T17:45:27.254972+0000","last_unstale":"2024-09-21T17:45:57.651374+0000","last_undegraded":"2024-09-21T17:45:57.651374+0000","last_fullsized":"2024-09-21T17:45:57.651374+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_clean_scrub_stamp":"2024-09-21T17:45:26.239001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:17:44.060723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057337200000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.652146+0000","last_change":"2024-09-21T17:45:32.286679+0000","last_active":"2024-09-21T17:45:57.652146+0000","last_peered":"2024-09-21T17:45:57.652146+0000","last_clean":"2024-09-21T17:45:57.652146+0000","last_became_active":"2024-09-21T17:45:32.286103+0000","last_became_peered":"2024-09-21T17:45:32.286103+0000","last_unstale":"2024-09-21T17:45:57.652146+0000","last_undegraded":"2024-09-21T17:45:57.652146+0000","last_fullsized":"2024-09-21T17:45:57.652146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:27:43.912701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156548+0000","last_change":"2024-09-21T17:45:34.311878+0000","last_active":"2024-09-21T17:45:57.156548+0000","last_peered":"2024-09-21T17:45:57.156548+0000","last_clean":"2024-09-21T17:45:57.156548+0000","last_became_active":"2024-09-21T17:45:34.311610+0000","last_became_peered":"2024-09-21T17:45:34.311610+0000","last_unstale":"2024-09-21T17:45:57.156548+0000","last_undegraded":"2024-09-21T17:45:57.156548+0000","last_fullsized":"2024-09-21T17:45:57.156548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:56:48.850235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"60'12","reported_seq":44,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155642+0000","last_change":"2024-09-21T17:45:30.276708+0000","last_active":"2024-09-21T17:45:57.155642+0000","last_peered":"2024-09-21T17:45:57.155642+0000","last_clean":"2024-09-21T17:45:57.155642+0000","last_became_active":"2024-09-21T17:45:30.276345+0000","last_became_peered":"2024-09-21T17:45:30.276345+0000","last_unstale":"2024-09-21T17:45:57.155642+0000","last_undegraded":"2024-09-21T17:45:57.155642+0000","last_fullsized":"2024-09-21T17:45:57.155642+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:56.532126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"53'1","reported_seq":36,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155048+0000","last_change":"2024-09-21T17:45:28.271893+0000","last_active":"2024-09-21T17:45:57.155048+0000","last_peered":"2024-09-21T17:45:57.155048+0000","last_clean":"2024-09-21T17:45:57.155048+0000","last_became_active":"2024-09-21T17:45:28.271601+0000","last_became_peered":"2024-09-21T17:45:28.271601+0000","last_unstale":"2024-09-21T17:45:57.155048+0000","last_undegraded":"2024-09-21T17:45:57.155048+0000","last_fullsized":"2024-09-21T17:45:57.155048+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:52:16.898385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"60'5","reported_seq":81,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:11.575414+0000","last_change":"2024-09-21T17:45:30.494861+0000","last_active":"2024-09-21T17:46:11.575414+0000","last_peered":"2024-09-21T17:46:11.575414+0000","last_clean":"2024-09-21T17:46:11.575414+0000","last_became_active":"2024-09-21T17:45:27.257275+0000","last_became_peered":"2024-09-21T17:45:27.257275+0000","last_unstale":"2024-09-21T17:46:11.575414+0000","last_undegraded":"2024-09-21T17:46:11.575414+0000","last_fullsized":"2024-09-21T17:46:11.575414+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:26.239001+0000","last_clean_scrub_stamp":"2024-09-21T17:45:26.239001+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:29:47.428273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000562923,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":35,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575942+0000","last_change":"2024-09-21T17:45:32.293417+0000","last_active":"2024-09-21T17:45:57.575942+0000","last_peered":"2024-09-21T17:45:57.575942+0000","last_clean":"2024-09-21T17:45:57.575942+0000","last_became_active":"2024-09-21T17:45:32.293031+0000","last_became_peered":"2024-09-21T17:45:32.293031+0000","last_unstale":"2024-09-21T17:45:57.575942+0000","last_undegraded":"2024-09-21T17:45:57.575942+0000","last_fullsized":"2024-09-21T17:45:57.575942+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:45:25.106260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156790+0000","last_change":"2024-09-21T17:45:34.308762+0000","last_active":"2024-09-21T17:45:57.156790+0000","last_peered":"2024-09-21T17:45:57.156790+0000","last_clean":"2024-09-21T17:45:57.156790+0000","last_became_active":"2024-09-21T17:45:34.308439+0000","last_became_peered":"2024-09-21T17:45:34.308439+0000","last_unstale":"2024-09-21T17:45:57.156790+0000","last_undegraded":"2024-09-21T17:45:57.156790+0000","last_fullsized":"2024-09-21T17:45:57.156790+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:30:18.618695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'16","reported_seq":57,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324931+0000","last_change":"2024-09-21T17:45:30.494644+0000","last_active":"2024-09-21T17:46:03.324931+0000","last_peered":"2024-09-21T17:46:03.324931+0000","last_clean":"2024-09-21T17:46:03.324931+0000","last_became_active":"2024-09-21T17:45:30.494327+0000","last_became_peered":"2024-09-21T17:45:30.494327+0000","last_unstale":"2024-09-21T17:46:03.324931+0000","last_undegraded":"2024-09-21T17:46:03.324931+0000","last_fullsized":"2024-09-21T17:46:03.324931+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:43:58.804985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325941+0000","last_change":"2024-09-21T17:45:28.265612+0000","last_active":"2024-09-21T17:45:58.325941+0000","last_peered":"2024-09-21T17:45:58.325941+0000","last_clean":"2024-09-21T17:45:58.325941+0000","last_became_active":"2024-09-21T17:45:28.265334+0000","last_became_peered":"2024-09-21T17:45:28.265334+0000","last_unstale":"2024-09-21T17:45:58.325941+0000","last_undegraded":"2024-09-21T17:45:58.325941+0000","last_fullsized":"2024-09-21T17:45:58.325941+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:11:19.230410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"62'79","reported_seq":67,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:59.632451+0000","last_change":"2024-09-21T17:45:20.073246+0000","last_active":"2024-09-21T17:45:59.632451+0000","last_peered":"2024-09-21T17:45:59.632451+0000","last_clean":"2024-09-21T17:45:59.632451+0000","last_became_active":"2024-09-21T17:45:20.066853+0000","last_became_peered":"2024-09-21T17:45:20.066853+0000","last_unstale":"2024-09-21T17:45:59.632451+0000","last_undegraded":"2024-09-21T17:45:59.632451+0000","last_fullsized":"2024-09-21T17:45:59.632451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:43:17.508151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:43:17.508151+0000","last_clean_scrub_stamp":"2024-09-21T17:43:17.508151+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:06.821130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156354+0000","last_change":"2024-09-21T17:45:32.290229+0000","last_active":"2024-09-21T17:45:57.156354+0000","last_peered":"2024-09-21T17:45:57.156354+0000","last_clean":"2024-09-21T17:45:57.156354+0000","last_became_active":"2024-09-21T17:45:32.289796+0000","last_became_peered":"2024-09-21T17:45:32.289796+0000","last_unstale":"2024-09-21T17:45:57.156354+0000","last_undegraded":"2024-09-21T17:45:57.156354+0000","last_fullsized":"2024-09-21T17:45:57.156354+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:14:50.966110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575777+0000","last_change":"2024-09-21T17:45:34.311673+0000","last_active":"2024-09-21T17:45:57.575777+0000","last_peered":"2024-09-21T17:45:57.575777+0000","last_clean":"2024-09-21T17:45:57.575777+0000","last_became_active":"2024-09-21T17:45:34.311395+0000","last_became_peered":"2024-09-21T17:45:34.311395+0000","last_unstale":"2024-09-21T17:45:57.575777+0000","last_undegraded":"2024-09-21T17:45:57.575777+0000","last_fullsized":"2024-09-21T17:45:57.575777+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:22:53.099080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"60'11","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795768+0000","last_change":"2024-09-21T17:45:30.278416+0000","last_active":"2024-09-21T17:45:57.795768+0000","last_peered":"2024-09-21T17:45:57.795768+0000","last_clean":"2024-09-21T17:45:57.795768+0000","last_became_active":"2024-09-21T17:45:30.277995+0000","last_became_peered":"2024-09-21T17:45:30.277995+0000","last_unstale":"2024-09-21T17:45:57.795768+0000","last_undegraded":"2024-09-21T17:45:57.795768+0000","last_fullsized":"2024-09-21T17:45:57.795768+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:11:45.100985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795278+0000","last_change":"2024-09-21T17:45:28.264947+0000","last_active":"2024-09-21T17:45:57.795278+0000","last_peered":"2024-09-21T17:45:57.795278+0000","last_clean":"2024-09-21T17:45:57.795278+0000","last_became_active":"2024-09-21T17:45:28.264639+0000","last_became_peered":"2024-09-21T17:45:28.264639+0000","last_unstale":"2024-09-21T17:45:57.795278+0000","last_undegraded":"2024-09-21T17:45:57.795278+0000","last_fullsized":"2024-09-21T17:45:57.795278+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:49:23.684529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575750+0000","last_change":"2024-09-21T17:45:32.290382+0000","last_active":"2024-09-21T17:45:57.575750+0000","last_peered":"2024-09-21T17:45:57.575750+0000","last_clean":"2024-09-21T17:45:57.575750+0000","last_became_active":"2024-09-21T17:45:32.290111+0000","last_became_peered":"2024-09-21T17:45:32.290111+0000","last_unstale":"2024-09-21T17:45:57.575750+0000","last_undegraded":"2024-09-21T17:45:57.575750+0000","last_fullsized":"2024-09-21T17:45:57.575750+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:51:03.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325254+0000","last_change":"2024-09-21T17:45:34.313097+0000","last_active":"2024-09-21T17:45:58.325254+0000","last_peered":"2024-09-21T17:45:58.325254+0000","last_clean":"2024-09-21T17:45:58.325254+0000","last_became_active":"2024-09-21T17:45:34.312791+0000","last_became_peered":"2024-09-21T17:45:34.312791+0000","last_unstale":"2024-09-21T17:45:58.325254+0000","last_undegraded":"2024-09-21T17:45:58.325254+0000","last_fullsized":"2024-09-21T17:45:58.325254+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:42:46.665144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"60'17","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795648+0000","last_change":"2024-09-21T17:45:30.277108+0000","last_active":"2024-09-21T17:45:57.795648+0000","last_peered":"2024-09-21T17:45:57.795648+0000","last_clean":"2024-09-21T17:45:57.795648+0000","last_became_active":"2024-09-21T17:45:30.276746+0000","last_became_peered":"2024-09-21T17:45:30.276746+0000","last_unstale":"2024-09-21T17:45:57.795648+0000","last_undegraded":"2024-09-21T17:45:57.795648+0000","last_fullsized":"2024-09-21T17:45:57.795648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:22:59.904046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.229088+0000","last_change":"2024-09-21T17:45:28.263847+0000","last_active":"2024-09-21T17:45:57.229088+0000","last_peered":"2024-09-21T17:45:57.229088+0000","last_clean":"2024-09-21T17:45:57.229088+0000","last_became_active":"2024-09-21T17:45:28.263596+0000","last_became_peered":"2024-09-21T17:45:28.263596+0000","last_unstale":"2024-09-21T17:45:57.229088+0000","last_undegraded":"2024-09-21T17:45:57.229088+0000","last_fullsized":"2024-09-21T17:45:57.229088+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:09:26.387310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156888+0000","last_change":"2024-09-21T17:45:32.293757+0000","last_active":"2024-09-21T17:45:57.156888+0000","last_peered":"2024-09-21T17:45:57.156888+0000","last_clean":"2024-09-21T17:45:57.156888+0000","last_became_active":"2024-09-21T17:45:32.293429+0000","last_became_peered":"2024-09-21T17:45:32.293429+0000","last_unstale":"2024-09-21T17:45:57.156888+0000","last_undegraded":"2024-09-21T17:45:57.156888+0000","last_fullsized":"2024-09-21T17:45:57.156888+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:33:46.043985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.652350+0000","last_change":"2024-09-21T17:45:34.308095+0000","last_active":"2024-09-21T17:45:57.652350+0000","last_peered":"2024-09-21T17:45:57.652350+0000","last_clean":"2024-09-21T17:45:57.652350+0000","last_became_active":"2024-09-21T17:45:34.307752+0000","last_became_peered":"2024-09-21T17:45:34.307752+0000","last_unstale":"2024-09-21T17:45:57.652350+0000","last_undegraded":"2024-09-21T17:45:57.652350+0000","last_fullsized":"2024-09-21T17:45:57.652350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:20:20.111261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"60'10","reported_seq":41,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795278+0000","last_change":"2024-09-21T17:45:30.287057+0000","last_active":"2024-09-21T17:45:57.795278+0000","last_peered":"2024-09-21T17:45:57.795278+0000","last_clean":"2024-09-21T17:45:57.795278+0000","last_became_active":"2024-09-21T17:45:30.286638+0000","last_became_peered":"2024-09-21T17:45:30.286638+0000","last_unstale":"2024-09-21T17:45:57.795278+0000","last_undegraded":"2024-09-21T17:45:57.795278+0000","last_fullsized":"2024-09-21T17:45:57.795278+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:29:25.480225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326089+0000","last_change":"2024-09-21T17:45:28.268980+0000","last_active":"2024-09-21T17:45:58.326089+0000","last_peered":"2024-09-21T17:45:58.326089+0000","last_clean":"2024-09-21T17:45:58.326089+0000","last_became_active":"2024-09-21T17:45:28.268654+0000","last_became_peered":"2024-09-21T17:45:28.268654+0000","last_unstale":"2024-09-21T17:45:58.326089+0000","last_undegraded":"2024-09-21T17:45:58.326089+0000","last_fullsized":"2024-09-21T17:45:58.326089+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:29:49.767876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324606+0000","last_change":"2024-09-21T17:45:32.289361+0000","last_active":"2024-09-21T17:46:03.324606+0000","last_peered":"2024-09-21T17:46:03.324606+0000","last_clean":"2024-09-21T17:46:03.324606+0000","last_became_active":"2024-09-21T17:45:32.289039+0000","last_became_peered":"2024-09-21T17:45:32.289039+0000","last_unstale":"2024-09-21T17:46:03.324606+0000","last_undegraded":"2024-09-21T17:46:03.324606+0000","last_fullsized":"2024-09-21T17:46:03.324606+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:24.074394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795598+0000","last_change":"2024-09-21T17:45:34.302478+0000","last_active":"2024-09-21T17:45:57.795598+0000","last_peered":"2024-09-21T17:45:57.795598+0000","last_clean":"2024-09-21T17:45:57.795598+0000","last_became_active":"2024-09-21T17:45:34.302204+0000","last_became_peered":"2024-09-21T17:45:34.302204+0000","last_unstale":"2024-09-21T17:45:57.795598+0000","last_undegraded":"2024-09-21T17:45:57.795598+0000","last_fullsized":"2024-09-21T17:45:57.795598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:46.618015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155672+0000","last_change":"2024-09-21T17:45:30.274673+0000","last_active":"2024-09-21T17:45:57.155672+0000","last_peered":"2024-09-21T17:45:57.155672+0000","last_clean":"2024-09-21T17:45:57.155672+0000","last_became_active":"2024-09-21T17:45:30.274278+0000","last_became_peered":"2024-09-21T17:45:30.274278+0000","last_unstale":"2024-09-21T17:45:57.155672+0000","last_undegraded":"2024-09-21T17:45:57.155672+0000","last_fullsized":"2024-09-21T17:45:57.155672+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:18:43.460503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575561+0000","last_change":"2024-09-21T17:45:28.268066+0000","last_active":"2024-09-21T17:45:57.575561+0000","last_peered":"2024-09-21T17:45:57.575561+0000","last_clean":"2024-09-21T17:45:57.575561+0000","last_became_active":"2024-09-21T17:45:28.267782+0000","last_became_peered":"2024-09-21T17:45:28.267782+0000","last_unstale":"2024-09-21T17:45:57.575561+0000","last_undegraded":"2024-09-21T17:45:57.575561+0000","last_fullsized":"2024-09-21T17:45:57.575561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:54:28.509317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.651261+0000","last_change":"2024-09-21T17:45:32.287615+0000","last_active":"2024-09-21T17:45:57.651261+0000","last_peered":"2024-09-21T17:45:57.651261+0000","last_clean":"2024-09-21T17:45:57.651261+0000","last_became_active":"2024-09-21T17:45:32.287271+0000","last_became_peered":"2024-09-21T17:45:32.287271+0000","last_unstale":"2024-09-21T17:45:57.651261+0000","last_undegraded":"2024-09-21T17:45:57.651261+0000","last_fullsized":"2024-09-21T17:45:57.651261+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:53.919101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.154974+0000","last_change":"2024-09-21T17:45:34.305557+0000","last_active":"2024-09-21T17:45:57.154974+0000","last_peered":"2024-09-21T17:45:57.154974+0000","last_clean":"2024-09-21T17:45:57.154974+0000","last_became_active":"2024-09-21T17:45:34.305243+0000","last_became_peered":"2024-09-21T17:45:34.305243+0000","last_unstale":"2024-09-21T17:45:57.154974+0000","last_undegraded":"2024-09-21T17:45:57.154974+0000","last_fullsized":"2024-09-21T17:45:57.154974+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:32.515860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'19","reported_seq":57,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.228848+0000","last_change":"2024-09-21T17:45:30.493465+0000","last_active":"2024-09-21T17:45:57.228848+0000","last_peered":"2024-09-21T17:45:57.228848+0000","last_clean":"2024-09-21T17:45:57.228848+0000","last_became_active":"2024-09-21T17:45:30.493151+0000","last_became_peered":"2024-09-21T17:45:30.493151+0000","last_unstale":"2024-09-21T17:45:57.228848+0000","last_undegraded":"2024-09-21T17:45:57.228848+0000","last_fullsized":"2024-09-21T17:45:57.228848+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:10.871178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156818+0000","last_change":"2024-09-21T17:45:28.264453+0000","last_active":"2024-09-21T17:45:57.156818+0000","last_peered":"2024-09-21T17:45:57.156818+0000","last_clean":"2024-09-21T17:45:57.156818+0000","last_became_active":"2024-09-21T17:45:28.264164+0000","last_became_peered":"2024-09-21T17:45:28.264164+0000","last_unstale":"2024-09-21T17:45:57.156818+0000","last_undegraded":"2024-09-21T17:45:57.156818+0000","last_fullsized":"2024-09-21T17:45:57.156818+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:27.470221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.651342+0000","last_change":"2024-09-21T17:45:32.295370+0000","last_active":"2024-09-21T17:45:57.651342+0000","last_peered":"2024-09-21T17:45:57.651342+0000","last_clean":"2024-09-21T17:45:57.651342+0000","last_became_active":"2024-09-21T17:45:32.294790+0000","last_became_peered":"2024-09-21T17:45:32.294790+0000","last_unstale":"2024-09-21T17:45:57.651342+0000","last_undegraded":"2024-09-21T17:45:57.651342+0000","last_fullsized":"2024-09-21T17:45:57.651342+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:59:32.941690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156708+0000","last_change":"2024-09-21T17:45:34.313206+0000","last_active":"2024-09-21T17:45:57.156708+0000","last_peered":"2024-09-21T17:45:57.156708+0000","last_clean":"2024-09-21T17:45:57.156708+0000","last_became_active":"2024-09-21T17:45:34.312903+0000","last_became_peered":"2024-09-21T17:45:34.312903+0000","last_unstale":"2024-09-21T17:45:57.156708+0000","last_undegraded":"2024-09-21T17:45:57.156708+0000","last_fullsized":"2024-09-21T17:45:57.156708+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:33:55.926914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"60'12","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795069+0000","last_change":"2024-09-21T17:45:30.283980+0000","last_active":"2024-09-21T17:45:57.795069+0000","last_peered":"2024-09-21T17:45:57.795069+0000","last_clean":"2024-09-21T17:45:57.795069+0000","last_became_active":"2024-09-21T17:45:30.283670+0000","last_became_peered":"2024-09-21T17:45:30.283670+0000","last_unstale":"2024-09-21T17:45:57.795069+0000","last_undegraded":"2024-09-21T17:45:57.795069+0000","last_fullsized":"2024-09-21T17:45:57.795069+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:47:44.013632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.157026+0000","last_change":"2024-09-21T17:45:28.266940+0000","last_active":"2024-09-21T17:45:57.157026+0000","last_peered":"2024-09-21T17:45:57.157026+0000","last_clean":"2024-09-21T17:45:57.157026+0000","last_became_active":"2024-09-21T17:45:28.266635+0000","last_became_peered":"2024-09-21T17:45:28.266635+0000","last_unstale":"2024-09-21T17:45:57.157026+0000","last_undegraded":"2024-09-21T17:45:57.157026+0000","last_fullsized":"2024-09-21T17:45:57.157026+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:34:21.294717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.650958+0000","last_change":"2024-09-21T17:45:32.294294+0000","last_active":"2024-09-21T17:45:57.650958+0000","last_peered":"2024-09-21T17:45:57.650958+0000","last_clean":"2024-09-21T17:45:57.650958+0000","last_became_active":"2024-09-21T17:45:32.293955+0000","last_became_peered":"2024-09-21T17:45:32.293955+0000","last_unstale":"2024-09-21T17:45:57.650958+0000","last_undegraded":"2024-09-21T17:45:57.650958+0000","last_fullsized":"2024-09-21T17:45:57.650958+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:12:07.324972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325002+0000","last_change":"2024-09-21T17:45:34.313959+0000","last_active":"2024-09-21T17:45:58.325002+0000","last_peered":"2024-09-21T17:45:58.325002+0000","last_clean":"2024-09-21T17:45:58.325002+0000","last_became_active":"2024-09-21T17:45:34.313497+0000","last_became_peered":"2024-09-21T17:45:34.313497+0000","last_unstale":"2024-09-21T17:45:58.325002+0000","last_undegraded":"2024-09-21T17:45:58.325002+0000","last_fullsized":"2024-09-21T17:45:58.325002+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:06.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"60'15","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575049+0000","last_change":"2024-09-21T17:45:30.496302+0000","last_active":"2024-09-21T17:45:57.575049+0000","last_peered":"2024-09-21T17:45:57.575049+0000","last_clean":"2024-09-21T17:45:57.575049+0000","last_became_active":"2024-09-21T17:45:30.495921+0000","last_became_peered":"2024-09-21T17:45:30.495921+0000","last_unstale":"2024-09-21T17:45:57.575049+0000","last_undegraded":"2024-09-21T17:45:57.575049+0000","last_fullsized":"2024-09-21T17:45:57.575049+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:11:26.947164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"53'3","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156994+0000","last_change":"2024-09-21T17:45:28.271676+0000","last_active":"2024-09-21T17:45:57.156994+0000","last_peered":"2024-09-21T17:45:57.156994+0000","last_clean":"2024-09-21T17:45:57.156994+0000","last_became_active":"2024-09-21T17:45:28.271335+0000","last_became_peered":"2024-09-21T17:45:28.271335+0000","last_unstale":"2024-09-21T17:45:57.156994+0000","last_undegraded":"2024-09-21T17:45:57.156994+0000","last_fullsized":"2024-09-21T17:45:57.156994+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:17:58.993202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324857+0000","last_change":"2024-09-21T17:45:32.290446+0000","last_active":"2024-09-21T17:46:03.324857+0000","last_peered":"2024-09-21T17:46:03.324857+0000","last_clean":"2024-09-21T17:46:03.324857+0000","last_became_active":"2024-09-21T17:45:32.290143+0000","last_became_peered":"2024-09-21T17:45:32.290143+0000","last_unstale":"2024-09-21T17:46:03.324857+0000","last_undegraded":"2024-09-21T17:46:03.324857+0000","last_fullsized":"2024-09-21T17:46:03.324857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:31.200568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575172+0000","last_change":"2024-09-21T17:45:34.305158+0000","last_active":"2024-09-21T17:45:57.575172+0000","last_peered":"2024-09-21T17:45:57.575172+0000","last_clean":"2024-09-21T17:45:57.575172+0000","last_became_active":"2024-09-21T17:45:34.304833+0000","last_became_peered":"2024-09-21T17:45:34.304833+0000","last_unstale":"2024-09-21T17:45:57.575172+0000","last_undegraded":"2024-09-21T17:45:57.575172+0000","last_fullsized":"2024-09-21T17:45:57.575172+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:56.803738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.228834+0000","last_change":"2024-09-21T17:45:28.271218+0000","last_active":"2024-09-21T17:45:57.228834+0000","last_peered":"2024-09-21T17:45:57.228834+0000","last_clean":"2024-09-21T17:45:57.228834+0000","last_became_active":"2024-09-21T17:45:28.270933+0000","last_became_peered":"2024-09-21T17:45:28.270933+0000","last_unstale":"2024-09-21T17:45:57.228834+0000","last_undegraded":"2024-09-21T17:45:57.228834+0000","last_fullsized":"2024-09-21T17:45:57.228834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:43:27.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"60'6","reported_seq":35,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326637+0000","last_change":"2024-09-21T17:45:30.496433+0000","last_active":"2024-09-21T17:45:58.326637+0000","last_peered":"2024-09-21T17:45:58.326637+0000","last_clean":"2024-09-21T17:45:58.326637+0000","last_became_active":"2024-09-21T17:45:30.495713+0000","last_became_peered":"2024-09-21T17:45:30.495713+0000","last_unstale":"2024-09-21T17:45:58.326637+0000","last_undegraded":"2024-09-21T17:45:58.326637+0000","last_fullsized":"2024-09-21T17:45:58.326637+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:44:08.216902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575713+0000","last_change":"2024-09-21T17:45:32.294282+0000","last_active":"2024-09-21T17:45:57.575713+0000","last_peered":"2024-09-21T17:45:57.575713+0000","last_clean":"2024-09-21T17:45:57.575713+0000","last_became_active":"2024-09-21T17:45:32.293972+0000","last_became_peered":"2024-09-21T17:45:32.293972+0000","last_unstale":"2024-09-21T17:45:57.575713+0000","last_undegraded":"2024-09-21T17:45:57.575713+0000","last_fullsized":"2024-09-21T17:45:57.575713+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:17:47.265533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156233+0000","last_change":"2024-09-21T17:45:34.308499+0000","last_active":"2024-09-21T17:45:57.156233+0000","last_peered":"2024-09-21T17:45:57.156233+0000","last_clean":"2024-09-21T17:45:57.156233+0000","last_became_active":"2024-09-21T17:45:34.308202+0000","last_became_peered":"2024-09-21T17:45:34.308202+0000","last_unstale":"2024-09-21T17:45:57.156233+0000","last_undegraded":"2024-09-21T17:45:57.156233+0000","last_fullsized":"2024-09-21T17:45:57.156233+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:21:30.379231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155702+0000","last_change":"2024-09-21T17:45:30.494488+0000","last_active":"2024-09-21T17:45:57.155702+0000","last_peered":"2024-09-21T17:45:57.155702+0000","last_clean":"2024-09-21T17:45:57.155702+0000","last_became_active":"2024-09-21T17:45:30.494181+0000","last_became_peered":"2024-09-21T17:45:30.494181+0000","last_unstale":"2024-09-21T17:45:57.155702+0000","last_undegraded":"2024-09-21T17:45:57.155702+0000","last_fullsized":"2024-09-21T17:45:57.155702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:02:45.248188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156390+0000","last_change":"2024-09-21T17:45:28.266862+0000","last_active":"2024-09-21T17:45:57.156390+0000","last_peered":"2024-09-21T17:45:57.156390+0000","last_clean":"2024-09-21T17:45:57.156390+0000","last_became_active":"2024-09-21T17:45:28.266464+0000","last_became_peered":"2024-09-21T17:45:28.266464+0000","last_unstale":"2024-09-21T17:45:57.156390+0000","last_undegraded":"2024-09-21T17:45:57.156390+0000","last_fullsized":"2024-09-21T17:45:57.156390+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:07:34.333645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326637+0000","last_change":"2024-09-21T17:45:32.288913+0000","last_active":"2024-09-21T17:45:58.326637+0000","last_peered":"2024-09-21T17:45:58.326637+0000","last_clean":"2024-09-21T17:45:58.326637+0000","last_became_active":"2024-09-21T17:45:32.288526+0000","last_became_peered":"2024-09-21T17:45:32.288526+0000","last_unstale":"2024-09-21T17:45:58.326637+0000","last_undegraded":"2024-09-21T17:45:58.326637+0000","last_fullsized":"2024-09-21T17:45:58.326637+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:02:22.497575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.651266+0000","last_change":"2024-09-21T17:45:34.309164+0000","last_active":"2024-09-21T17:45:57.651266+0000","last_peered":"2024-09-21T17:45:57.651266+0000","last_clean":"2024-09-21T17:45:57.651266+0000","last_became_active":"2024-09-21T17:45:34.308870+0000","last_became_peered":"2024-09-21T17:45:34.308870+0000","last_unstale":"2024-09-21T17:45:57.651266+0000","last_undegraded":"2024-09-21T17:45:57.651266+0000","last_fullsized":"2024-09-21T17:45:57.651266+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:36:10.419374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575761+0000","last_change":"2024-09-21T17:45:30.497013+0000","last_active":"2024-09-21T17:45:57.575761+0000","last_peered":"2024-09-21T17:45:57.575761+0000","last_clean":"2024-09-21T17:45:57.575761+0000","last_became_active":"2024-09-21T17:45:30.496696+0000","last_became_peered":"2024-09-21T17:45:30.496696+0000","last_unstale":"2024-09-21T17:45:57.575761+0000","last_undegraded":"2024-09-21T17:45:57.575761+0000","last_fullsized":"2024-09-21T17:45:57.575761+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:38:09.683947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155220+0000","last_change":"2024-09-21T17:45:28.268661+0000","last_active":"2024-09-21T17:45:57.155220+0000","last_peered":"2024-09-21T17:45:57.155220+0000","last_clean":"2024-09-21T17:45:57.155220+0000","last_became_active":"2024-09-21T17:45:28.268377+0000","last_became_peered":"2024-09-21T17:45:28.268377+0000","last_unstale":"2024-09-21T17:45:57.155220+0000","last_undegraded":"2024-09-21T17:45:57.155220+0000","last_fullsized":"2024-09-21T17:45:57.155220+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:52:52.298239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324660+0000","last_change":"2024-09-21T17:45:32.289519+0000","last_active":"2024-09-21T17:46:03.324660+0000","last_peered":"2024-09-21T17:46:03.324660+0000","last_clean":"2024-09-21T17:46:03.324660+0000","last_became_active":"2024-09-21T17:45:32.289209+0000","last_became_peered":"2024-09-21T17:45:32.289209+0000","last_unstale":"2024-09-21T17:46:03.324660+0000","last_undegraded":"2024-09-21T17:46:03.324660+0000","last_fullsized":"2024-09-21T17:46:03.324660+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:32:37.669483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795775+0000","last_change":"2024-09-21T17:45:34.306879+0000","last_active":"2024-09-21T17:45:57.795775+0000","last_peered":"2024-09-21T17:45:57.795775+0000","last_clean":"2024-09-21T17:45:57.795775+0000","last_became_active":"2024-09-21T17:45:34.306603+0000","last_became_peered":"2024-09-21T17:45:34.306603+0000","last_unstale":"2024-09-21T17:45:57.795775+0000","last_undegraded":"2024-09-21T17:45:57.795775+0000","last_fullsized":"2024-09-21T17:45:57.795775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:02:26.086368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"60'10","reported_seq":41,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.326234+0000","last_change":"2024-09-21T17:45:30.495950+0000","last_active":"2024-09-21T17:45:58.326234+0000","last_peered":"2024-09-21T17:45:58.326234+0000","last_clean":"2024-09-21T17:45:58.326234+0000","last_became_active":"2024-09-21T17:45:30.495562+0000","last_became_peered":"2024-09-21T17:45:30.495562+0000","last_unstale":"2024-09-21T17:45:58.326234+0000","last_undegraded":"2024-09-21T17:45:58.326234+0000","last_fullsized":"2024-09-21T17:45:58.326234+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:38:17.479053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156510+0000","last_change":"2024-09-21T17:45:28.266511+0000","last_active":"2024-09-21T17:45:57.156510+0000","last_peered":"2024-09-21T17:45:57.156510+0000","last_clean":"2024-09-21T17:45:57.156510+0000","last_became_active":"2024-09-21T17:45:28.266233+0000","last_became_peered":"2024-09-21T17:45:28.266233+0000","last_unstale":"2024-09-21T17:45:57.156510+0000","last_undegraded":"2024-09-21T17:45:57.156510+0000","last_fullsized":"2024-09-21T17:45:57.156510+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:46.384134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"60'8","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:46:03.324842+0000","last_change":"2024-09-21T17:45:32.293535+0000","last_active":"2024-09-21T17:46:03.324842+0000","last_peered":"2024-09-21T17:46:03.324842+0000","last_clean":"2024-09-21T17:46:03.324842+0000","last_became_active":"2024-09-21T17:45:32.293133+0000","last_became_peered":"2024-09-21T17:45:32.293133+0000","last_unstale":"2024-09-21T17:46:03.324842+0000","last_undegraded":"2024-09-21T17:46:03.324842+0000","last_fullsized":"2024-09-21T17:46:03.324842+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:26.880168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155362+0000","last_change":"2024-09-21T17:45:34.309013+0000","last_active":"2024-09-21T17:45:57.155362+0000","last_peered":"2024-09-21T17:45:57.155362+0000","last_clean":"2024-09-21T17:45:57.155362+0000","last_became_active":"2024-09-21T17:45:34.308453+0000","last_became_peered":"2024-09-21T17:45:34.308453+0000","last_unstale":"2024-09-21T17:45:57.155362+0000","last_undegraded":"2024-09-21T17:45:57.155362+0000","last_fullsized":"2024-09-21T17:45:57.155362+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:47.619623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'11","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795177+0000","last_change":"2024-09-21T17:45:30.278097+0000","last_active":"2024-09-21T17:45:57.795177+0000","last_peered":"2024-09-21T17:45:57.795177+0000","last_clean":"2024-09-21T17:45:57.795177+0000","last_became_active":"2024-09-21T17:45:30.277749+0000","last_became_peered":"2024-09-21T17:45:30.277749+0000","last_unstale":"2024-09-21T17:45:57.795177+0000","last_undegraded":"2024-09-21T17:45:57.795177+0000","last_fullsized":"2024-09-21T17:45:57.795177+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:24:46.172699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.795466+0000","last_change":"2024-09-21T17:45:28.266150+0000","last_active":"2024-09-21T17:45:57.795466+0000","last_peered":"2024-09-21T17:45:57.795466+0000","last_clean":"2024-09-21T17:45:57.795466+0000","last_became_active":"2024-09-21T17:45:28.265790+0000","last_became_peered":"2024-09-21T17:45:28.265790+0000","last_unstale":"2024-09-21T17:45:57.795466+0000","last_undegraded":"2024-09-21T17:45:57.795466+0000","last_fullsized":"2024-09-21T17:45:57.795466+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:13.427658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156560+0000","last_change":"2024-09-21T17:45:32.290633+0000","last_active":"2024-09-21T17:45:57.156560+0000","last_peered":"2024-09-21T17:45:57.156560+0000","last_clean":"2024-09-21T17:45:57.156560+0000","last_became_active":"2024-09-21T17:45:32.290227+0000","last_became_peered":"2024-09-21T17:45:32.290227+0000","last_unstale":"2024-09-21T17:45:57.156560+0000","last_undegraded":"2024-09-21T17:45:57.156560+0000","last_fullsized":"2024-09-21T17:45:57.156560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:10.286217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.324741+0000","last_change":"2024-09-21T17:45:34.312510+0000","last_active":"2024-09-21T17:45:58.324741+0000","last_peered":"2024-09-21T17:45:58.324741+0000","last_clean":"2024-09-21T17:45:58.324741+0000","last_became_active":"2024-09-21T17:45:34.311165+0000","last_became_peered":"2024-09-21T17:45:34.311165+0000","last_unstale":"2024-09-21T17:45:58.324741+0000","last_undegraded":"2024-09-21T17:45:58.324741+0000","last_fullsized":"2024-09-21T17:45:58.324741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:39:08.312079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"60'9","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156925+0000","last_change":"2024-09-21T17:45:30.277998+0000","last_active":"2024-09-21T17:45:57.156925+0000","last_peered":"2024-09-21T17:45:57.156925+0000","last_clean":"2024-09-21T17:45:57.156925+0000","last_became_active":"2024-09-21T17:45:30.277710+0000","last_became_peered":"2024-09-21T17:45:30.277710+0000","last_unstale":"2024-09-21T17:45:57.156925+0000","last_undegraded":"2024-09-21T17:45:57.156925+0000","last_fullsized":"2024-09-21T17:45:57.156925+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:24:40.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156737+0000","last_change":"2024-09-21T17:45:28.267838+0000","last_active":"2024-09-21T17:45:57.156737+0000","last_peered":"2024-09-21T17:45:57.156737+0000","last_clean":"2024-09-21T17:45:57.156737+0000","last_became_active":"2024-09-21T17:45:28.267556+0000","last_became_peered":"2024-09-21T17:45:28.267556+0000","last_unstale":"2024-09-21T17:45:57.156737+0000","last_undegraded":"2024-09-21T17:45:57.156737+0000","last_fullsized":"2024-09-21T17:45:57.156737+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:07:50.187884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325968+0000","last_change":"2024-09-21T17:45:32.298260+0000","last_active":"2024-09-21T17:45:58.325968+0000","last_peered":"2024-09-21T17:45:58.325968+0000","last_clean":"2024-09-21T17:45:58.325968+0000","last_became_active":"2024-09-21T17:45:32.297834+0000","last_became_peered":"2024-09-21T17:45:32.297834+0000","last_unstale":"2024-09-21T17:45:58.325968+0000","last_undegraded":"2024-09-21T17:45:58.325968+0000","last_fullsized":"2024-09-21T17:45:58.325968+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:29.848063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.154865+0000","last_change":"2024-09-21T17:45:34.308884+0000","last_active":"2024-09-21T17:45:57.154865+0000","last_peered":"2024-09-21T17:45:57.154865+0000","last_clean":"2024-09-21T17:45:57.154865+0000","last_became_active":"2024-09-21T17:45:34.308515+0000","last_became_peered":"2024-09-21T17:45:34.308515+0000","last_unstale":"2024-09-21T17:45:57.154865+0000","last_undegraded":"2024-09-21T17:45:57.154865+0000","last_fullsized":"2024-09-21T17:45:57.154865+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:03:29.453060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'11","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325602+0000","last_change":"2024-09-21T17:45:30.496060+0000","last_active":"2024-09-21T17:45:58.325602+0000","last_peered":"2024-09-21T17:45:58.325602+0000","last_clean":"2024-09-21T17:45:58.325602+0000","last_became_active":"2024-09-21T17:45:30.495606+0000","last_became_peered":"2024-09-21T17:45:30.495606+0000","last_unstale":"2024-09-21T17:45:58.325602+0000","last_undegraded":"2024-09-21T17:45:58.325602+0000","last_fullsized":"2024-09-21T17:45:58.325602+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:34:48.258242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.575747+0000","last_change":"2024-09-21T17:45:28.266056+0000","last_active":"2024-09-21T17:45:57.575747+0000","last_peered":"2024-09-21T17:45:57.575747+0000","last_clean":"2024-09-21T17:45:57.575747+0000","last_became_active":"2024-09-21T17:45:28.265719+0000","last_became_peered":"2024-09-21T17:45:28.265719+0000","last_unstale":"2024-09-21T17:45:57.575747+0000","last_undegraded":"2024-09-21T17:45:57.575747+0000","last_fullsized":"2024-09-21T17:45:57.575747+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:26:11.119353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155962+0000","last_change":"2024-09-21T17:45:32.291307+0000","last_active":"2024-09-21T17:45:57.155962+0000","last_peered":"2024-09-21T17:45:57.155962+0000","last_clean":"2024-09-21T17:45:57.155962+0000","last_became_active":"2024-09-21T17:45:32.290976+0000","last_became_peered":"2024-09-21T17:45:32.290976+0000","last_unstale":"2024-09-21T17:45:57.155962+0000","last_undegraded":"2024-09-21T17:45:57.155962+0000","last_fullsized":"2024-09-21T17:45:57.155962+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:28:22.935140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.324894+0000","last_change":"2024-09-21T17:45:34.306620+0000","last_active":"2024-09-21T17:45:58.324894+0000","last_peered":"2024-09-21T17:45:58.324894+0000","last_clean":"2024-09-21T17:45:58.324894+0000","last_became_active":"2024-09-21T17:45:34.305506+0000","last_became_peered":"2024-09-21T17:45:34.305506+0000","last_unstale":"2024-09-21T17:45:58.324894+0000","last_undegraded":"2024-09-21T17:45:58.324894+0000","last_fullsized":"2024-09-21T17:45:58.324894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:05:55.806569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"60'4","reported_seq":32,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325323+0000","last_change":"2024-09-21T17:45:30.283382+0000","last_active":"2024-09-21T17:45:58.325323+0000","last_peered":"2024-09-21T17:45:58.325323+0000","last_clean":"2024-09-21T17:45:58.325323+0000","last_became_active":"2024-09-21T17:45:30.283069+0000","last_became_peered":"2024-09-21T17:45:30.283069+0000","last_unstale":"2024-09-21T17:45:58.325323+0000","last_undegraded":"2024-09-21T17:45:58.325323+0000","last_fullsized":"2024-09-21T17:45:58.325323+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:51:20.470738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155651+0000","last_change":"2024-09-21T17:45:28.269616+0000","last_active":"2024-09-21T17:45:57.155651+0000","last_peered":"2024-09-21T17:45:57.155651+0000","last_clean":"2024-09-21T17:45:57.155651+0000","last_became_active":"2024-09-21T17:45:28.269096+0000","last_became_peered":"2024-09-21T17:45:28.269096+0000","last_unstale":"2024-09-21T17:45:57.155651+0000","last_undegraded":"2024-09-21T17:45:57.155651+0000","last_fullsized":"2024-09-21T17:45:57.155651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:40:35.598001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.228744+0000","last_change":"2024-09-21T17:45:32.286968+0000","last_active":"2024-09-21T17:45:57.228744+0000","last_peered":"2024-09-21T17:45:57.228744+0000","last_clean":"2024-09-21T17:45:57.228744+0000","last_became_active":"2024-09-21T17:45:32.286653+0000","last_became_peered":"2024-09-21T17:45:32.286653+0000","last_unstale":"2024-09-21T17:45:57.228744+0000","last_undegraded":"2024-09-21T17:45:57.228744+0000","last_fullsized":"2024-09-21T17:45:57.228744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:22:35.713004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156096+0000","last_change":"2024-09-21T17:45:34.312066+0000","last_active":"2024-09-21T17:45:57.156096+0000","last_peered":"2024-09-21T17:45:57.156096+0000","last_clean":"2024-09-21T17:45:57.156096+0000","last_became_active":"2024-09-21T17:45:34.311175+0000","last_became_peered":"2024-09-21T17:45:34.311175+0000","last_unstale":"2024-09-21T17:45:57.156096+0000","last_undegraded":"2024-09-21T17:45:57.156096+0000","last_fullsized":"2024-09-21T17:45:57.156096+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:15.424875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.156837+0000","last_change":"2024-09-21T17:45:34.299079+0000","last_active":"2024-09-21T17:45:57.156837+0000","last_peered":"2024-09-21T17:45:57.156837+0000","last_clean":"2024-09-21T17:45:57.156837+0000","last_became_active":"2024-09-21T17:45:34.298773+0000","last_became_peered":"2024-09-21T17:45:34.298773+0000","last_unstale":"2024-09-21T17:45:57.156837+0000","last_undegraded":"2024-09-21T17:45:57.156837+0000","last_fullsized":"2024-09-21T17:45:57.156837+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:33.281224+0000","last_clean_scrub_stamp":"2024-09-21T17:45:33.281224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:17:46.580007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:58.325774+0000","last_change":"2024-09-21T17:45:28.272421+0000","last_active":"2024-09-21T17:45:58.325774+0000","last_peered":"2024-09-21T17:45:58.325774+0000","last_clean":"2024-09-21T17:45:58.325774+0000","last_became_active":"2024-09-21T17:45:28.272083+0000","last_became_peered":"2024-09-21T17:45:28.272083+0000","last_unstale":"2024-09-21T17:45:58.325774+0000","last_undegraded":"2024-09-21T17:45:58.325774+0000","last_fullsized":"2024-09-21T17:45:58.325774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:27.245430+0000","last_clean_scrub_stamp":"2024-09-21T17:45:27.245430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:14.195969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"60'11","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.229298+0000","last_change":"2024-09-21T17:45:30.280021+0000","last_active":"2024-09-21T17:45:57.229298+0000","last_peered":"2024-09-21T17:45:57.229298+0000","last_clean":"2024-09-21T17:45:57.229298+0000","last_became_active":"2024-09-21T17:45:30.279657+0000","last_became_peered":"2024-09-21T17:45:30.279657+0000","last_unstale":"2024-09-21T17:45:57.229298+0000","last_undegraded":"2024-09-21T17:45:57.229298+0000","last_fullsized":"2024-09-21T17:45:57.229298+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:29.252593+0000","last_clean_scrub_stamp":"2024-09-21T17:45:29.252593+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:54:20.562355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-21T17:45:57.155536+0000","last_change":"2024-09-21T17:45:32.297148+0000","last_active":"2024-09-21T17:45:57.155536+0000","last_peered":"2024-09-21T17:45:57.155536+0000","last_clean":"2024-09-21T17:45:57.155536+0000","last_became_active":"2024-09-21T17:45:32.296725+0000","last_became_peered":"2024-09-21T17:45:32.296725+0000","last_unstale":"2024-09-21T17:45:57.155536+0000","last_undegraded":"2024-09-21T17:45:57.155536+0000","last_fullsized":"2024-09-21T17:45:57.155536+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T17:45:31.265347+0000","last_clean_scrub_stamp":"2024-09-21T17:45:31.265347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:30.516539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":35,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430219,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28224,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716928,"statfs":{"total":95995035648,"available":95966134272,"internally_reserved":0,"allocated":1228800,"data_stored":828781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28200,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716952,"statfs":{"total":95995035648,"available":95966158848,"internally_reserved":0,"allocated":1204224,"data_stored":827260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822679,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27624,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717528,"statfs":{"total":95995035648,"available":95966748672,"internally_reserved":0,"allocated":610304,"data_stored":237238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018907,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713336,"statfs":{"total":95995035648,"available":95962456064,"internally_reserved":0,"allocated":643072,"data_stored":238913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182433,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717488,"statfs":{"total":95995035648,"available":95966707712,"internally_reserved":0,"allocated":651264,"data_stored":238776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411366,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31776,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713376,"statfs":{"total":95995035648,"available":95962497024,"internally_reserved":0,"allocated":602112,"data_stored":237027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717468,"statfs":{"total":95995035648,"available":95966687232,"internally_reserved":0,"allocated":671744,"data_stored":238664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738414,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32392,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712760,"statfs":{"total":95995035648,"available":95961866240,"internally_reserved":0,"allocated":1232896,"data_stored":829470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T17:46:16.351 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T17:46:16.351 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T17:46:16.351 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T17:46:16.352 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe shell --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 -- ceph health --format=json 2024-09-21T17:46:16.604 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T17:46:16.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:16 smithi042 ceph-mon[29361]: pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T17:46:16.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:16 smithi042 ceph-mon[29361]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T17:46:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:16 smithi042 ceph-mon[38309]: pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T17:46:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:16 smithi042 ceph-mon[38309]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T17:46:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:16 smithi162 ceph-mon[32106]: pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T17:46:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:16 smithi162 ceph-mon[32106]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T17:46:17.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.221+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1208714686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26b81087b0 msgr2=0x7f26b8108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.221+0000 7f26bdb9f640 1 --2- 172.21.15.42:0/1208714686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26b81087b0 0x7f26b8108bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009900 tx=0x7f26ac02a3f0 comp rx=0 tx=0).stop 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.221+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1208714686 shutdown_connections 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.221+0000 7f26bdb9f640 1 --2- 172.21.15.42:0/1208714686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b8109130 0x7f26b810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.221+0000 7f26bdb9f640 1 --2- 172.21.15.42:0/1208714686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26b81087b0 0x7f26b8108bf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.221+0000 7f26bdb9f640 1 --2- 172.21.15.42:0/1208714686 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f26b8102da0 0x7f26b8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.221+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1208714686 >> 172.21.15.42:0/1208714686 conn(0x7f26b80fe810 msgr2=0x7f26b8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.221+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1208714686 shutdown_connections 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.221+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1208714686 wait complete. 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26bdb9f640 1 Processor -- start 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26bdb9f640 1 -- start start 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26bdb9f640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f26b8102da0 0x7f26b8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26bdb9f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b81087b0 0x7f26b8198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:17.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26bdb9f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26b8109130 0x7f26b819e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26bdb9f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26b8112490 con 0x7f26b8109130 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26bdb9f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26b8112310 con 0x7f26b81087b0 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26bdb9f640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f26b8112610 con 0x7f26b8102da0 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26b77fe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f26b8102da0 0x7f26b8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26b7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26b8109130 0x7f26b819e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26b77fe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f26b8102da0 0x7f26b8198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:33208/0 (socket says 172.21.15.42:33208) 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.222+0000 7f26b77fe640 1 -- 172.21.15.42:0/1033875637 learned_addr learned my addr 172.21.15.42:0/1033875637 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26b6ffd640 1 --2- 172.21.15.42:0/1033875637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b81087b0 0x7f26b8198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26b77fe640 1 -- 172.21.15.42:0/1033875637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b81087b0 msgr2=0x7f26b8198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26b77fe640 1 --2- 172.21.15.42:0/1033875637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b81087b0 0x7f26b8198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26b77fe640 1 -- 172.21.15.42:0/1033875637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26b8109130 msgr2=0x7f26b819e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26b77fe640 1 --2- 172.21.15.42:0/1033875637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26b8109130 0x7f26b819e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26b77fe640 1 -- 172.21.15.42:0/1033875637 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b819ea50 con 0x7f26b8102da0 2024-09-21T17:46:17.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26b77fe640 1 --2- 172.21.15.42:0/1033875637 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f26b8102da0 0x7f26b8198a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26a800ea60 tx=0x7f26a800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26b4ff9640 1 -- 172.21.15.42:0/1033875637 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a800cde0 con 0x7f26b8102da0 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26b4ff9640 1 -- 172.21.15.42:0/1033875637 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f26a80035f0 con 0x7f26b8102da0 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26b4ff9640 1 -- 172.21.15.42:0/1033875637 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a80044a0 con 0x7f26b8102da0 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1033875637 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b819ed40 con 0x7f26b8102da0 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.223+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1033875637 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b8075550 con 0x7f26b8102da0 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.224+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1033875637 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b8104050 con 0x7f26b8102da0 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.225+0000 7f26b4ff9640 1 -- 172.21.15.42:0/1033875637 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f26a8004000 con 0x7f26b8102da0 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.225+0000 7f26b4ff9640 1 --2- 172.21.15.42:0/1033875637 >> v2:172.21.15.42:6800/36970769 conn(0x7f26a007b110 0x7f26a007d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.225+0000 7f26b6ffd640 1 --2- 172.21.15.42:0/1033875637 >> v2:172.21.15.42:6800/36970769 conn(0x7f26a007b110 0x7f26a007d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.226+0000 7f26b4ff9640 1 -- 172.21.15.42:0/1033875637 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 6172+0+0 (secure 0 0 0) 0x7f26a809e6a0 con 0x7f26b8102da0 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.226+0000 7f26b6ffd640 1 --2- 172.21.15.42:0/1033875637 >> v2:172.21.15.42:6800/36970769 conn(0x7f26a007b110 0x7f26a007d5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f26ac031440 tx=0x7f26ac0095f0 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T17:46:17.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.230+0000 7f26b4ff9640 1 -- 172.21.15.42:0/1033875637 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f26a8069d10 con 0x7f26b8102da0 2024-09-21T17:46:17.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.458+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1033875637 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26b8199b70 con 0x7f26b8102da0 2024-09-21T17:46:17.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.459+0000 7f26b4ff9640 1 -- 172.21.15.42:0/1033875637 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f26a806ebc0 con 0x7f26b8102da0 2024-09-21T17:46:17.461 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T17:46:17.461 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T17:46:17.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1033875637 >> v2:172.21.15.42:6800/36970769 conn(0x7f26a007b110 msgr2=0x7f26a007d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:17.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 --2- 172.21.15.42:0/1033875637 >> v2:172.21.15.42:6800/36970769 conn(0x7f26a007b110 0x7f26a007d5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f26ac031440 tx=0x7f26ac0095f0 comp rx=0 tx=0).stop 2024-09-21T17:46:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1033875637 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f26b8102da0 msgr2=0x7f26b8198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T17:46:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 --2- 172.21.15.42:0/1033875637 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f26b8102da0 0x7f26b8198a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26a800ea60 tx=0x7f26a800ef20 comp rx=0 tx=0).stop 2024-09-21T17:46:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1033875637 shutdown_connections 2024-09-21T17:46:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 --2- 172.21.15.42:0/1033875637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26b8109130 0x7f26b819e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 --2- 172.21.15.42:0/1033875637 >> v2:172.21.15.42:6800/36970769 conn(0x7f26a007b110 0x7f26a007d5d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 --2- 172.21.15.42:0/1033875637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b81087b0 0x7f26b8198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 --2- 172.21.15.42:0/1033875637 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f26b8102da0 0x7f26b8198a40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T17:46:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1033875637 >> 172.21.15.42:0/1033875637 conn(0x7f26b80fe810 msgr2=0x7f26b8100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T17:46:17.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1033875637 shutdown_connections 2024-09-21T17:46:17.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T17:46:17.461+0000 7f26bdb9f640 1 -- 172.21.15.42:0/1033875637 wait complete. 2024-09-21T17:46:17.761 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1033875637' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T17:46:17.761 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1033875637' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T17:46:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1033875637' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T17:46:18.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:18 smithi042 ceph-mon[29361]: pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:18 smithi042 ceph-mon[38309]: pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:18 smithi162 ceph-mon[32106]: pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:18.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:46:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:46:19.215 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T17:46:19.216 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T17:46:19.216 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T17:46:19.238 INFO:tasks.workunit:Pulling workunits from ref 0ecbb435437226bc091a0c2d4549ba25bf724efe 2024-09-21T17:46:19.239 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T17:46:19.239 DEBUG:teuthology.orchestra.run.smithi042:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T17:46:19.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T17:46:19.257 INFO:teuthology.orchestra.run.smithi042.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-21T17:46:19.258 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-21T17:46:19.313 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-21T17:46:19.313 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-21T17:46:19.369 INFO:tasks.workunit:timeout=3h 2024-09-21T17:46:19.369 INFO:tasks.workunit:cleanup=True 2024-09-21T17:46:19.370 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0ecbb435437226bc091a0c2d4549ba25bf724efe 2024-09-21T17:46:19.426 INFO:tasks.workunit.client.0.smithi042.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T17:46:20.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:20.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:20 smithi042 ceph-mon[29361]: pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:20.788 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:20.788 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:20 smithi042 ceph-mon[38309]: pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:20 smithi162 ceph-mon[32106]: pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:22 smithi162 ceph-mon[32106]: pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:22.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:22 smithi042 ceph-mon[29361]: pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:22.841 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:22 smithi042 ceph-mon[38309]: pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:23.164 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 systemd[1]: Starting Ceph alertmanager.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:46:23.517 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 podman[69618]: 2024-09-21 17:46:23.135025732 +0000 UTC m=+0.016517058 image pull 11f11916f8cdfb17c1da74b20deb2075d778357b4d60474d82453303f8d461f5 quay.io/prometheus/alertmanager:v0.27.0 2024-09-21T17:46:23.517 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 podman[69618]: 2024-09-21 17:46:23.243200694 +0000 UTC m=+0.124692011 volume create e32c21cbc04ad3aa1e420793f8ed3cea9b09266c7df5766094b186415c8c6aca 2024-09-21T17:46:23.518 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 podman[69618]: 2024-09-21 17:46:23.351999232 +0000 UTC m=+0.233490591 container create 8d5f9f23b496a48d373072079c5f6d67a4727ff9228143e93aa215f5ead8a23e (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:23.879 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 podman[69618]: 2024-09-21 17:46:23.613215287 +0000 UTC m=+0.494706617 container init 8d5f9f23b496a48d373072079c5f6d67a4727ff9228143e93aa215f5ead8a23e (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:23.879 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 podman[69618]: 2024-09-21 17:46:23.616146145 +0000 UTC m=+0.497637462 container start 8d5f9f23b496a48d373072079c5f6d67a4727ff9228143e93aa215f5ead8a23e (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:23.879 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:23.626Z caller=main.go:181 level=info msg="Starting Alertmanager" version="(version=0.27.0, branch=HEAD, revision=0aa3c2aad14cff039931923ab16b26b7481783b5)" 2024-09-21T17:46:23.879 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:23.627Z caller=main.go:182 level=info build_context="(go=go1.21.7, platform=linux/amd64, user=root@22cd11f671e9, date=20240228-11:51:20, tags=netgo)" 2024-09-21T17:46:23.879 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:23.628Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.42 port=9094 2024-09-21T17:46:23.879 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:23.629Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-21T17:46:23.879 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:23.651Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T17:46:23.879 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:23.651Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T17:46:23.879 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:23.652Z caller=main.go:394 level=info component=configuration msg="skipping creation of receiver not referenced by any route" receiver=custom-receiver 2024-09-21T17:46:23.880 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:23.653Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9093 2024-09-21T17:46:23.880 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:23.653Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-21T17:46:23.880 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 bash[69618]: 8d5f9f23b496a48d373072079c5f6d67a4727ff9228143e93aa215f5ead8a23e 2024-09-21T17:46:23.880 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:23 smithi042 systemd[1]: Started Ceph alertmanager.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:46:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:46:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:46:24.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[29361]: pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:24.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-21T17:46:24.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.537 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:46:24.537 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[38309]: pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:24.537 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.537 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.537 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.537 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.538 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.538 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.538 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-21T17:46:24.538 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.538 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:46:24.538 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:24] ENGINE Bus STOPPING 2024-09-21T17:46:24.538 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:24] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T17:46:24.539 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:24] ENGINE Bus STOPPED 2024-09-21T17:46:24.539 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:24] ENGINE Bus STARTING 2024-09-21T17:46:24.539 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:24] ENGINE Serving on http://:::9283 2024-09-21T17:46:24.539 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:24] ENGINE Bus STARTED 2024-09-21T17:46:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:24 smithi162 ceph-mon[32106]: pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-21T17:46:24.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:24.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:46:25.816 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:25 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:25.629Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00074213s 2024-09-21T17:46:25.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:25 smithi042 ceph-mon[29361]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T17:46:25.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:25 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T17:46:25.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:25 smithi042 ceph-mon[29361]: Deploying daemon grafana.a on smithi162 2024-09-21T17:46:25.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:25 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:46:25.817 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:25 smithi042 ceph-mon[38309]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T17:46:25.817 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:25 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T17:46:25.817 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:25 smithi042 ceph-mon[38309]: Deploying daemon grafana.a on smithi162 2024-09-21T17:46:25.817 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:25 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:46:25.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:25 smithi162 ceph-mon[32106]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T17:46:25.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:25 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T17:46:25.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:25 smithi162 ceph-mon[32106]: Deploying daemon grafana.a on smithi162 2024-09-21T17:46:25.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:25 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:46:26.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:26 smithi162 ceph-mon[32106]: pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:26.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:26 smithi042 ceph-mon[29361]: pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:26.828 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:26 smithi042 ceph-mon[38309]: pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:27 smithi162 ceph-mon[32106]: pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:27 smithi042 ceph-mon[29361]: pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:27 smithi042 ceph-mon[38309]: pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:28.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:46:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:46:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:28.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:29 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:29 smithi042 ceph-mon[29361]: pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:29 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:29 smithi042 ceph-mon[38309]: pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:29 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:29 smithi162 ceph-mon[32106]: pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:32.427 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:32 smithi162 ceph-mon[32106]: pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:32 smithi042 ceph-mon[29361]: pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:32 smithi042 ceph-mon[38309]: pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:33.914 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:33.633Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.004706947s 2024-09-21T17:46:33.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:46:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:46:34.040 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:33 smithi162 systemd[1]: Starting Ceph grafana.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:46:34.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-mon[32106]: pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:34.326 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 podman[59645]: 2024-09-21 17:46:33.94133 +0000 UTC m=+0.016628829 image pull 5aad1d7cf004c80a4acb170e1c80fb85781b022f00f08c6bcd22608882b4c748 quay.io/ceph/grafana:10.4.8 2024-09-21T17:46:34.326 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 podman[59645]: 2024-09-21 17:46:34.071761067 +0000 UTC m=+0.147059884 container create 071d550bb132596bf7ef8acb676cb91a672047bd804e54c4306ef7dc7928d8c2 (image=quay.io/ceph/grafana:10.4.8, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T17:46:34.326 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 podman[59645]: 2024-09-21 17:46:34.282428393 +0000 UTC m=+0.357727223 container init 071d550bb132596bf7ef8acb676cb91a672047bd804e54c4306ef7dc7928d8c2 (image=quay.io/ceph/grafana:10.4.8, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T17:46:34.326 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 podman[59645]: 2024-09-21 17:46:34.285309591 +0000 UTC m=+0.360608416 container start 071d550bb132596bf7ef8acb676cb91a672047bd804e54c4306ef7dc7928d8c2 (image=quay.io/ceph/grafana:10.4.8, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T17:46:34.586 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.401973829Z level=info msg="Starting Grafana" version=10.4.8 commit=8c384b71bde142a25ddc01ed5a183ca572b2b7f7 branch=v10.4.x compiled=2024-09-21T17:46:34Z 2024-09-21T17:46:34.586 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.40220593Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-09-21T17:46:34.586 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402214862Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-09-21T17:46:34.586 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402221354Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-09-21T17:46:34.586 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402225999Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-09-21T17:46:34.586 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.40223108Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-09-21T17:46:34.586 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402235784Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-09-21T17:46:34.586 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402240722Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402245459Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402250026Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402254679Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402259212Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402268089Z level=info msg=Target target=[all] 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402275965Z level=info msg="Path Home" path=/usr/share/grafana 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402279499Z level=info msg="Path Data" path=/var/lib/grafana 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402282905Z level=info msg="Path Logs" path=/var/log/grafana 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402286243Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402289822Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=settings t=2024-09-21T17:46:34.402293321Z level=info msg="App mode production" 2024-09-21T17:46:34.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore t=2024-09-21T17:46:34.402595157Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-09-21T17:46:34.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore t=2024-09-21T17:46:34.402611445Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-21T17:46:34.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.403042871Z level=info msg="Starting DB migrations" 2024-09-21T17:46:34.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.403886174Z level=info msg="Executing migration" id="create migration_log table" 2024-09-21T17:46:34.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.404642992Z level=info msg="Migration successfully executed" id="create migration_log table" duration=756.532µs 2024-09-21T17:46:34.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.405114457Z level=info msg="Executing migration" id="create user table" 2024-09-21T17:46:34.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.405660741Z level=info msg="Migration successfully executed" id="create user table" duration=545.975µs 2024-09-21T17:46:34.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.40606652Z level=info msg="Executing migration" id="add unique index user.login" 2024-09-21T17:46:34.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.406580149Z level=info msg="Migration successfully executed" id="add unique index user.login" duration=515.571µs 2024-09-21T17:46:34.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.406986536Z level=info msg="Executing migration" id="add unique index user.email" 2024-09-21T17:46:34.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.407449203Z level=info msg="Migration successfully executed" id="add unique index user.email" duration=462.529µs 2024-09-21T17:46:34.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.407826151Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-09-21T17:46:34.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.408316328Z level=info msg="Migration successfully executed" id="drop index UQE_user_login - v1" duration=490.18µs 2024-09-21T17:46:34.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.408806436Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-09-21T17:46:34.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.409261213Z level=info msg="Migration successfully executed" id="drop index UQE_user_email - v1" duration=454.717µs 2024-09-21T17:46:34.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.409615655Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-09-21T17:46:34.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.411204683Z level=info msg="Migration successfully executed" id="Rename table user to user_v1 - v1" duration=1.588825ms 2024-09-21T17:46:34.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.411613417Z level=info msg="Executing migration" id="create user table v2" 2024-09-21T17:46:34.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.412176111Z level=info msg="Migration successfully executed" id="create user table v2" duration=562.78µs 2024-09-21T17:46:34.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.412547105Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-09-21T17:46:34.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.413012802Z level=info msg="Migration successfully executed" id="create index UQE_user_login - v2" duration=465.378µs 2024-09-21T17:46:34.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.413362495Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-09-21T17:46:34.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.413807324Z level=info msg="Migration successfully executed" id="create index UQE_user_email - v2" duration=444.735µs 2024-09-21T17:46:34.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.414229548Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-09-21T17:46:34.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.41453055Z level=info msg="Migration successfully executed" id="copy data_source v1 to v2" duration=302.778µs 2024-09-21T17:46:34.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.414868836Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-09-21T17:46:34.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.415253651Z level=info msg="Migration successfully executed" id="Drop old table user_v1" duration=384.708µs 2024-09-21T17:46:34.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.415597011Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.416320209Z level=info msg="Migration successfully executed" id="Add column help_flags1 to user table" duration=724.692µs 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.41667028Z level=info msg="Executing migration" id="Update user table charset" 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.416690213Z level=info msg="Migration successfully executed" id="Update user table charset" duration=19.918µs 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.417114081Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.417810901Z level=info msg="Migration successfully executed" id="Add last_seen_at column to user" duration=696.539µs 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.418166471Z level=info msg="Executing migration" id="Add missing user data" 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.41830605Z level=info msg="Migration successfully executed" id="Add missing user data" duration=139.464µs 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.418704752Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.419419089Z level=info msg="Migration successfully executed" id="Add is_disabled column to user" duration=713.878µs 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.419768192Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.420231533Z level=info msg="Migration successfully executed" id="Add index user.login/user.email" duration=463.037µs 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.420576384Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.421315532Z level=info msg="Migration successfully executed" id="Add is_service_account column to user" duration=739.017µs 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.421661009Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-09-21T17:46:34.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.426831024Z level=info msg="Migration successfully executed" id="Update is_service_account column to nullable" duration=5.169455ms 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.427200312Z level=info msg="Executing migration" id="Add uid column to user" 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.427930733Z level=info msg="Migration successfully executed" id="Add uid column to user" duration=730.127µs 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.428276793Z level=info msg="Executing migration" id="Update uid column values for users" 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.4288301Z level=info msg="Migration successfully executed" id="Update uid column values for users" duration=140.352µs 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.429456273Z level=info msg="Executing migration" id="Add unique index user_uid" 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.430351722Z level=info msg="Migration successfully executed" id="Add unique index user_uid" duration=895.812µs 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.430939265Z level=info msg="Executing migration" id="update login field with orgid to allow for multiple service accounts with same name across orgs" 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.431200429Z level=info msg="Migration successfully executed" id="update login field with orgid to allow for multiple service accounts with same name across orgs" duration=261.715µs 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.431661928Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.432236418Z level=info msg="Migration successfully executed" id="create temp user table v1-7" duration=574.253µs 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.432739292Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.433227097Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_email - v1-7" duration=488.08µs 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.43359205Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-09-21T17:46:34.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.434060587Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_org_id - v1-7" duration=468.252µs 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.434456599Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.434924559Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_code - v1-7" duration=467.831µs 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.435290099Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.435750775Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_status - v1-7" duration=459.38µs 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.436117755Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.436135304Z level=info msg="Migration successfully executed" id="Update temp_user table charset" duration=17.648µs 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.43657446Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.437048019Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_email - v1" duration=473.482µs 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.437400349Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.437869325Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_org_id - v1" duration=468.78µs 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.438235053Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.438688431Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_code - v1" duration=453.173µs 2024-09-21T17:46:34.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.440084233Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.440543359Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_status - v1" duration=459.003µs 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.440916515Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.442951706Z level=info msg="Migration successfully executed" id="Rename table temp_user to temp_user_tmp_qwerty - v1" duration=2.034672ms 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.443319083Z level=info msg="Executing migration" id="create temp_user v2" 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.443868917Z level=info msg="Migration successfully executed" id="create temp_user v2" duration=548.735µs 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.444266336Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.444752279Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_email - v2" duration=485.86µs 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.445125899Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.445609389Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_org_id - v2" duration=483.34µs 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.445997513Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.44648886Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_code - v2" duration=490.481µs 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.448729078Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-09-21T17:46:34.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.449248356Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_status - v2" duration=503.421µs 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.449639391Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.449928705Z level=info msg="Migration successfully executed" id="copy temp_user v1 to v2" duration=289.111µs 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.450300558Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.450678774Z level=info msg="Migration successfully executed" id="drop temp_user_tmp_qwerty" duration=378.047µs 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.451025937Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.45128716Z level=info msg="Migration successfully executed" id="Set created for temp users that will otherwise prematurely expire" duration=261.066µs 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.451708751Z level=info msg="Executing migration" id="create star table" 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.452165999Z level=info msg="Migration successfully executed" id="create star table" duration=455.989µs 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.452551738Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.453040458Z level=info msg="Migration successfully executed" id="add unique index star.user_id_dashboard_id" duration=487.425µs 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.45345017Z level=info msg="Executing migration" id="create org table v1" 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.453954164Z level=info msg="Migration successfully executed" id="create org table v1" duration=503.767µs 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.454308231Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-09-21T17:46:34.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.454777187Z level=info msg="Migration successfully executed" id="create index UQE_org_name - v1" duration=468.854µs 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.455148235Z level=info msg="Executing migration" id="create org_user table v1" 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.455628358Z level=info msg="Migration successfully executed" id="create org_user table v1" duration=479.893µs 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.45603132Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.456540962Z level=info msg="Migration successfully executed" id="create index IDX_org_user_org_id - v1" duration=509.648µs 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.458591975Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.459090216Z level=info msg="Migration successfully executed" id="create index UQE_org_user_org_id_user_id - v1" duration=497.949µs 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.461072826Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.461540757Z level=info msg="Migration successfully executed" id="create index IDX_org_user_user_id - v1" duration=467.59µs 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.463713515Z level=info msg="Executing migration" id="Update org table charset" 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.463745637Z level=info msg="Migration successfully executed" id="Update org table charset" duration=32.937µs 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.46640603Z level=info msg="Executing migration" id="Update org_user table charset" 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.466445513Z level=info msg="Migration successfully executed" id="Update org_user table charset" duration=40.59µs 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.46892153Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-09-21T17:46:34.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.469028626Z level=info msg="Migration successfully executed" id="Migrate all Read Only Viewers to Viewers" duration=106.284µs 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.471721165Z level=info msg="Executing migration" id="create dashboard table" 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.472223828Z level=info msg="Migration successfully executed" id="create dashboard table" duration=502.382µs 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.47403569Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.474551544Z level=info msg="Migration successfully executed" id="add index dashboard.account_id" duration=516.423µs 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.474924024Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.475443315Z level=info msg="Migration successfully executed" id="add unique index dashboard_account_id_slug" duration=519.569µs 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.475811227Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.476236462Z level=info msg="Migration successfully executed" id="create dashboard_tag table" duration=424.977µs 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.476647943Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.477126196Z level=info msg="Migration successfully executed" id="add unique index dashboard_tag.dasboard_id_term" duration=478.008µs 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.477498636Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.477957182Z level=info msg="Migration successfully executed" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" duration=458.433µs 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.478311001Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-09-21T17:46:34.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.481747745Z level=info msg="Migration successfully executed" id="Rename table dashboard to dashboard_v1 - v1" duration=3.436277ms 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.482111624Z level=info msg="Executing migration" id="create dashboard v2" 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.482596248Z level=info msg="Migration successfully executed" id="create dashboard v2" duration=484.28µs 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.482956686Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.483417054Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_org_id - v2" duration=460.283µs 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.483778837Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.484276183Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_org_id_slug - v2" duration=497.122µs 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.484629942Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.484847667Z level=info msg="Migration successfully executed" id="copy dashboard v1 to v2" duration=217.67µs 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.485451921Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.486095658Z level=info msg="Migration successfully executed" id="drop table dashboard_v1" duration=643.991µs 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.486449288Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.486492307Z level=info msg="Migration successfully executed" id="alter dashboard.data to mediumtext v1" duration=42.614µs 2024-09-21T17:46:34.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.487289103Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.488390281Z level=info msg="Migration successfully executed" id="Add column updated_by in dashboard - v2" duration=1.100778ms 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.488771854Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.48994731Z level=info msg="Migration successfully executed" id="Add column created_by in dashboard - v2" duration=1.175095ms 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.490420765Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.491541591Z level=info msg="Migration successfully executed" id="Add column gnetId in dashboard" duration=1.120547ms 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.491927469Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.492429999Z level=info msg="Migration successfully executed" id="Add index for gnetId in dashboard" duration=502.318µs 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.49280718Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.493929297Z level=info msg="Migration successfully executed" id="Add column plugin_id in dashboard" duration=1.121635ms 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.495498569Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.49611786Z level=info msg="Migration successfully executed" id="Add index for plugin_id in dashboard" duration=619.989µs 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.498177372Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.498664188Z level=info msg="Migration successfully executed" id="Add index for dashboard_id in dashboard_tag" duration=486.676µs 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.500843541Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.500859619Z level=info msg="Migration successfully executed" id="Update dashboard table charset" duration=16.768µs 2024-09-21T17:46:34.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.503638711Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.503670326Z level=info msg="Migration successfully executed" id="Update dashboard_tag table charset" duration=32.143µs 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.504255586Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.50548062Z level=info msg="Migration successfully executed" id="Add column folder_id in dashboard" duration=1.224871ms 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.505848345Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.507023593Z level=info msg="Migration successfully executed" id="Add column isFolder in dashboard" duration=1.173956ms 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.507369658Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.508534741Z level=info msg="Migration successfully executed" id="Add column has_acl in dashboard" duration=1.164888ms 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.508914228Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.510080507Z level=info msg="Migration successfully executed" id="Add column uid in dashboard" duration=1.165957ms 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.510418105Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.510563996Z level=info msg="Migration successfully executed" id="Update uid column values in dashboard" duration=143.877µs 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.511232982Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.511698252Z level=info msg="Migration successfully executed" id="Add unique index dashboard_org_id_uid" duration=464.092µs 2024-09-21T17:46:34.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.512056705Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.512515928Z level=info msg="Migration successfully executed" id="Remove unique index org_id_slug" duration=459.084µs 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.512853372Z level=info msg="Executing migration" id="Update dashboard title length" 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.51286788Z level=info msg="Migration successfully executed" id="Update dashboard title length" duration=14.877µs 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.513727519Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.514217547Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_title_folder_id" duration=489.709µs 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.514579231Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.515039063Z level=info msg="Migration successfully executed" id="create dashboard_provisioning" duration=459.631µs 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.515414344Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.518486076Z level=info msg="Migration successfully executed" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" duration=3.071575ms 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.51885269Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.519300771Z level=info msg="Migration successfully executed" id="create dashboard_provisioning v2" duration=447.041µs 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.519702545Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.520184054Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_provisioning_dashboard_id - v2" duration=480.95µs 2024-09-21T17:46:34.602 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.520552936Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.521055946Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" duration=501.798µs 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.521408312Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.521616636Z level=info msg="Migration successfully executed" id="copy dashboard_provisioning v1 to v2" duration=208.208µs 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.522245104Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.522615328Z level=info msg="Migration successfully executed" id="drop dashboard_provisioning_tmp_qwerty" duration=371.041µs 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.523029363Z level=info msg="Executing migration" id="Add check_sum column" 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.524241526Z level=info msg="Migration successfully executed" id="Add check_sum column" duration=1.211014ms 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.524595412Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.52506225Z level=info msg="Migration successfully executed" id="Add index for dashboard_title" duration=466.588µs 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.525437044Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.525545246Z level=info msg="Migration successfully executed" id="delete tags for deleted dashboards" duration=108.223µs 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.526290348Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-09-21T17:46:34.603 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.526395395Z level=info msg="Migration successfully executed" id="delete stars for deleted dashboards" duration=105.144µs 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.527287195Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.527883538Z level=info msg="Migration successfully executed" id="Add index for dashboard_is_folder" duration=598.745µs 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.528253911Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.529585655Z level=info msg="Migration successfully executed" id="Add isPublic for dashboard" duration=1.331753ms 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.52997303Z level=info msg="Executing migration" id="create data_source table" 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.530585006Z level=info msg="Migration successfully executed" id="create data_source table" duration=610.675µs 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.530978514Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.531471215Z level=info msg="Migration successfully executed" id="add index data_source.account_id" duration=492.431µs 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.531831157Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.532348967Z level=info msg="Migration successfully executed" id="add unique index data_source.account_id_name" duration=517.607µs 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.532692717Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.533196457Z level=info msg="Migration successfully executed" id="drop index IDX_data_source_account_id - v1" duration=503.597µs 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.583674265Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.58431646Z level=info msg="Migration successfully executed" id="drop index UQE_data_source_account_id_name - v1" duration=645.122µs 2024-09-21T17:46:34.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.584679241Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-09-21T17:46:34.605 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.5882148Z level=info msg="Migration successfully executed" id="Rename table data_source to data_source_v1 - v1" duration=3.535168ms 2024-09-21T17:46:34.605 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.588600418Z level=info msg="Executing migration" id="create data_source table v2" 2024-09-21T17:46:34.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:34 smithi042 ceph-mon[29361]: pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:34.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:34 smithi042 ceph-mon[38309]: pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:34.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.589203536Z level=info msg="Migration successfully executed" id="create data_source table v2" duration=602.657µs 2024-09-21T17:46:34.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.589600608Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-09-21T17:46:34.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.590145863Z level=info msg="Migration successfully executed" id="create index IDX_data_source_org_id - v2" duration=545.028µs 2024-09-21T17:46:34.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.590502016Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-09-21T17:46:34.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.591044022Z level=info msg="Migration successfully executed" id="create index UQE_data_source_org_id_name - v2" duration=541.759µs 2024-09-21T17:46:34.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.591410714Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-09-21T17:46:34.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.59179509Z level=info msg="Migration successfully executed" id="Drop old table data_source_v1 #2" duration=383.982µs 2024-09-21T17:46:34.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.592243134Z level=info msg="Executing migration" id="Add column with_credentials" 2024-09-21T17:46:34.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.593671985Z level=info msg="Migration successfully executed" id="Add column with_credentials" duration=1.4286ms 2024-09-21T17:46:34.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.594053666Z level=info msg="Executing migration" id="Add secure json data column" 2024-09-21T17:46:34.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.595485909Z level=info msg="Migration successfully executed" id="Add secure json data column" duration=1.431943ms 2024-09-21T17:46:34.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.59589651Z level=info msg="Executing migration" id="Update data_source table charset" 2024-09-21T17:46:34.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.59591636Z level=info msg="Migration successfully executed" id="Update data_source table charset" duration=19.776µs 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.598761891Z level=info msg="Executing migration" id="Update initial version to 1" 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.598918495Z level=info msg="Migration successfully executed" id="Update initial version to 1" duration=156.596µs 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.601515403Z level=info msg="Executing migration" id="Add read_only data column" 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.602910883Z level=info msg="Migration successfully executed" id="Add read_only data column" duration=1.395077ms 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.604423293Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.604561249Z level=info msg="Migration successfully executed" id="Migrate logging ds to loki ds" duration=137.907µs 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.60728094Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.607409912Z level=info msg="Migration successfully executed" id="Update json_data with nulls" duration=128.913µs 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.610065985Z level=info msg="Executing migration" id="Add uid column" 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.611489347Z level=info msg="Migration successfully executed" id="Add uid column" duration=1.421882ms 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.612812652Z level=info msg="Executing migration" id="Update uid value" 2024-09-21T17:46:34.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.612960258Z level=info msg="Migration successfully executed" id="Update uid value" duration=148.681µs 2024-09-21T17:46:34.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.615423998Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-09-21T17:46:34.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.615949548Z level=info msg="Migration successfully executed" id="Add unique index datasource_org_id_uid" duration=525.154µs 2024-09-21T17:46:34.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.618385686Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-09-21T17:46:34.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.619022695Z level=info msg="Migration successfully executed" id="add unique index datasource_org_id_is_default" duration=640.891µs 2024-09-21T17:46:34.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.621251017Z level=info msg="Executing migration" id="create api_key table" 2024-09-21T17:46:34.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.621787657Z level=info msg="Migration successfully executed" id="create api_key table" duration=536.393µs 2024-09-21T17:46:34.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.624119288Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-09-21T17:46:34.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.624669444Z level=info msg="Migration successfully executed" id="add index api_key.account_id" duration=552.024µs 2024-09-21T17:46:34.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.626936735Z level=info msg="Executing migration" id="add index api_key.key" 2024-09-21T17:46:34.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.627427738Z level=info msg="Migration successfully executed" id="add index api_key.key" duration=490.863µs 2024-09-21T17:46:34.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.629685795Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-09-21T17:46:34.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.630240677Z level=info msg="Migration successfully executed" id="add index api_key.account_id_name" duration=554.534µs 2024-09-21T17:46:34.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.632479423Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-09-21T17:46:34.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.632981434Z level=info msg="Migration successfully executed" id="drop index IDX_api_key_account_id - v1" duration=501.897µs 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.635058989Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.635546538Z level=info msg="Migration successfully executed" id="drop index UQE_api_key_key - v1" duration=487.42µs 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.638108701Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.638637407Z level=info msg="Migration successfully executed" id="drop index UQE_api_key_account_id_name - v1" duration=531.16µs 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.640875218Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.644623984Z level=info msg="Migration successfully executed" id="Rename table api_key to api_key_v1 - v1" duration=3.752968ms 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.6450206Z level=info msg="Executing migration" id="create api_key table v2" 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.645530015Z level=info msg="Migration successfully executed" id="create api_key table v2" duration=509.09µs 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.6477148Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.648216756Z level=info msg="Migration successfully executed" id="create index IDX_api_key_org_id - v2" duration=501.651µs 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.650380038Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-09-21T17:46:34.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.650889359Z level=info msg="Migration successfully executed" id="create index UQE_api_key_key - v2" duration=509.025µs 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.652902892Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.653395071Z level=info msg="Migration successfully executed" id="create index UQE_api_key_org_id_name - v2" duration=492.848µs 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.653744087Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.654003716Z level=info msg="Migration successfully executed" id="copy api_key v1 to v2" duration=259.516µs 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.656562914Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.657012446Z level=info msg="Migration successfully executed" id="Drop old table api_key_v1" duration=451.235µs 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.658973946Z level=info msg="Executing migration" id="Update api_key table charset" 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.658998409Z level=info msg="Migration successfully executed" id="Update api_key table charset" duration=24.854µs 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.661455725Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.662946722Z level=info msg="Migration successfully executed" id="Add expires to api_key table" duration=1.490513ms 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.663289577Z level=info msg="Executing migration" id="Add service account foreign key" 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.664760625Z level=info msg="Migration successfully executed" id="Add service account foreign key" duration=1.470858ms 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.666072333Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-09-21T17:46:34.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.666185502Z level=info msg="Migration successfully executed" id="set service account foreign key to nil if 0" duration=113.133µs 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.668743254Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.670299866Z level=info msg="Migration successfully executed" id="Add last_used_at to api_key table" duration=1.556187ms 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.671520939Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.6730285Z level=info msg="Migration successfully executed" id="Add is_revoked column to api_key table" duration=1.507233ms 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.673382842Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.673891629Z level=info msg="Migration successfully executed" id="create dashboard_snapshot table v4" duration=508.515µs 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.676126111Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.67650327Z level=info msg="Migration successfully executed" id="drop table dashboard_snapshot_v4 #1" duration=376.923µs 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.678818222Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.679403431Z level=info msg="Migration successfully executed" id="create dashboard_snapshot table v5 #2" duration=584.397µs 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.681523692Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-09-21T17:46:34.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.682174196Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_snapshot_key - v5" duration=652.814µs 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.682540486Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.683105815Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_snapshot_delete_key - v5" duration=564.946µs 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.685085656Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.685587162Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_snapshot_user_id - v5" duration=501.343µs 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.687907823Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.687956332Z level=info msg="Migration successfully executed" id="alter dashboard_snapshot to mediumtext v2" duration=48.671µs 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.68852629Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.688546208Z level=info msg="Migration successfully executed" id="Update dashboard_snapshot table charset" duration=19.742µs 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.68893553Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.690580511Z level=info msg="Migration successfully executed" id="Add column external_delete_url to dashboard_snapshots table" duration=1.644561ms 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.690939824Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.692608163Z level=info msg="Migration successfully executed" id="Add encrypted dashboard json column" duration=1.666548ms 2024-09-21T17:46:34.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.692989803Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.693039225Z level=info msg="Migration successfully executed" id="Change dashboard_encrypted column to MEDIUMBLOB" duration=49.609µs 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.693914572Z level=info msg="Executing migration" id="create quota table v1" 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.694421021Z level=info msg="Migration successfully executed" id="create quota table v1" duration=508.348µs 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.694785713Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.695297202Z level=info msg="Migration successfully executed" id="create index UQE_quota_org_id_user_id_target - v1" duration=511.188µs 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.695633996Z level=info msg="Executing migration" id="Update quota table charset" 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.695654578Z level=info msg="Migration successfully executed" id="Update quota table charset" duration=21.268µs 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.696411025Z level=info msg="Executing migration" id="create plugin_setting table" 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.696922312Z level=info msg="Migration successfully executed" id="create plugin_setting table" duration=511.049µs 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.697275615Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.697793974Z level=info msg="Migration successfully executed" id="create index UQE_plugin_setting_org_id_plugin_id - v1" duration=517.076µs 2024-09-21T17:46:34.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.698142503Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.699868533Z level=info msg="Migration successfully executed" id="Add column plugin_version to plugin_settings" duration=1.72569ms 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.700228041Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.700250053Z level=info msg="Migration successfully executed" id="Update plugin_setting table charset" duration=22.538µs 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.701009595Z level=info msg="Executing migration" id="create session table" 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.701578305Z level=info msg="Migration successfully executed" id="create session table" duration=568.393µs 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.701948898Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.702018645Z level=info msg="Migration successfully executed" id="Drop old table playlist table" duration=69.807µs 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.702815715Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.702888117Z level=info msg="Migration successfully executed" id="Drop old table playlist_item table" duration=72.806µs 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.703337204Z level=info msg="Executing migration" id="create playlist table v2" 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.703802174Z level=info msg="Migration successfully executed" id="create playlist table v2" duration=463.628µs 2024-09-21T17:46:34.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.704177834Z level=info msg="Executing migration" id="create playlist item table v2" 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.704659435Z level=info msg="Migration successfully executed" id="create playlist item table v2" duration=481.441µs 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.70500618Z level=info msg="Executing migration" id="Update playlist table charset" 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.705026369Z level=info msg="Migration successfully executed" id="Update playlist table charset" duration=19.092µs 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.706025671Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.706074474Z level=info msg="Migration successfully executed" id="Update playlist_item table charset" duration=48.669µs 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.706528322Z level=info msg="Executing migration" id="Add playlist column created_at" 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.708346685Z level=info msg="Migration successfully executed" id="Add playlist column created_at" duration=1.816073ms 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.708754427Z level=info msg="Executing migration" id="Add playlist column updated_at" 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.713135317Z level=info msg="Migration successfully executed" id="Add playlist column updated_at" duration=4.379576ms 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.713476804Z level=info msg="Executing migration" id="drop preferences table v2" 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.713546507Z level=info msg="Migration successfully executed" id="drop preferences table v2" duration=69.766µs 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.714344461Z level=info msg="Executing migration" id="drop preferences table v3" 2024-09-21T17:46:34.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.714413062Z level=info msg="Migration successfully executed" id="drop preferences table v3" duration=68.69µs 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.714794466Z level=info msg="Executing migration" id="create preferences table v3" 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.715337277Z level=info msg="Migration successfully executed" id="create preferences table v3" duration=542.447µs 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.715700821Z level=info msg="Executing migration" id="Update preferences table charset" 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.715719438Z level=info msg="Migration successfully executed" id="Update preferences table charset" duration=18.814µs 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.716588649Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.71844375Z level=info msg="Migration successfully executed" id="Add column team_id in preferences" duration=1.854876ms 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.718806847Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.718926375Z level=info msg="Migration successfully executed" id="Update team_id column values in preferences" duration=119.445µs 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.719320879Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.721184668Z level=info msg="Migration successfully executed" id="Add column week_start in preferences" duration=1.863249ms 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.721538247Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.723400363Z level=info msg="Migration successfully executed" id="Add column preferences.json_data" duration=1.861528ms 2024-09-21T17:46:34.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.723754807Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-09-21T17:46:34.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.723802729Z level=info msg="Migration successfully executed" id="alter preferences.json_data to mediumtext v1" duration=48.073µs 2024-09-21T17:46:34.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.72466794Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-09-21T17:46:34.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.72530628Z level=info msg="Migration successfully executed" id="Add preferences index org_id" duration=638.942µs 2024-09-21T17:46:34.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.72568268Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-09-21T17:46:34.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.726242769Z level=info msg="Migration successfully executed" id="Add preferences index user_id" duration=559.785µs 2024-09-21T17:46:34.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.72661524Z level=info msg="Executing migration" id="create alert table v1" 2024-09-21T17:46:34.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.727353219Z level=info msg="Migration successfully executed" id="create alert table v1" duration=737.682µs 2024-09-21T17:46:34.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.727712523Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-09-21T17:46:34.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.72836172Z level=info msg="Migration successfully executed" id="add index alert org_id & id " duration=649.295µs 2024-09-21T17:46:34.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.728747891Z level=info msg="Executing migration" id="add index alert state" 2024-09-21T17:46:34.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.729282987Z level=info msg="Migration successfully executed" id="add index alert state" duration=534.952µs 2024-09-21T17:46:34.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.729627095Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-09-21T17:46:34.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.730184169Z level=info msg="Migration successfully executed" id="add index alert dashboard_id" duration=556.822µs 2024-09-21T17:46:34.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.732500777Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-09-21T17:46:34.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.732991227Z level=info msg="Migration successfully executed" id="Create alert_rule_tag table v1" duration=492.578µs 2024-09-21T17:46:34.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.734997949Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-09-21T17:46:34.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.735567906Z level=info msg="Migration successfully executed" id="Add unique index alert_rule_tag.alert_id_tag_id" duration=569.595µs 2024-09-21T17:46:34.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.738064956Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-09-21T17:46:34.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.738594068Z level=info msg="Migration successfully executed" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" duration=531.268µs 2024-09-21T17:46:34.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.738930742Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-09-21T17:46:34.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.744653475Z level=info msg="Migration successfully executed" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" duration=5.722331ms 2024-09-21T17:46:34.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.745009059Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.745482806Z level=info msg="Migration successfully executed" id="Create alert_rule_tag table v2" duration=473.486µs 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.747949003Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.74859308Z level=info msg="Migration successfully executed" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" duration=645.761µs 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.750746711Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.750969719Z level=info msg="Migration successfully executed" id="copy alert_rule_tag v1 to v2" duration=222.855µs 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.751291812Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.751648941Z level=info msg="Migration successfully executed" id="drop table alert_rule_tag_v1" duration=356.844µs 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.754276157Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.754755761Z level=info msg="Migration successfully executed" id="create alert_notification table v1" duration=479.321µs 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.75702084Z level=info msg="Executing migration" id="Add column is_default" 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.759106464Z level=info msg="Migration successfully executed" id="Add column is_default" duration=2.085066ms 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.759595138Z level=info msg="Executing migration" id="Add column frequency" 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.761790391Z level=info msg="Migration successfully executed" id="Add column frequency" duration=2.194878ms 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.762163765Z level=info msg="Executing migration" id="Add column send_reminder" 2024-09-21T17:46:34.852 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.764480427Z level=info msg="Migration successfully executed" id="Add column send_reminder" duration=2.316532ms 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.765182519Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.76732448Z level=info msg="Migration successfully executed" id="Add column disable_resolve_message" duration=2.141585ms 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.767784532Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.768321002Z level=info msg="Migration successfully executed" id="add index alert_notification org_id & name" duration=535.39µs 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.770729907Z level=info msg="Executing migration" id="Update alert table charset" 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.770767435Z level=info msg="Migration successfully executed" id="Update alert table charset" duration=37.538µs 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.771169593Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.771188007Z level=info msg="Migration successfully executed" id="Update alert_notification table charset" duration=18.377µs 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.774069932Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.774718236Z level=info msg="Migration successfully executed" id="create notification_journal table v1" duration=650.348µs 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.776960931Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.777664127Z level=info msg="Migration successfully executed" id="add index notification_journal org_id & alert_id & notifier_id" duration=704.878µs 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.77945984Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-09-21T17:46:34.853 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.779993031Z level=info msg="Migration successfully executed" id="drop alert_notification_journal" duration=533.579µs 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.780359775Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.780885025Z level=info msg="Migration successfully executed" id="create alert_notification_state table v1" duration=525.556µs 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.781234947Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.781761606Z level=info msg="Migration successfully executed" id="add index alert_notification_state org_id & alert_id & notifier_id" duration=525.381µs 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.782117831Z level=info msg="Executing migration" id="Add for to alert table" 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.784651674Z level=info msg="Migration successfully executed" id="Add for to alert table" duration=2.533453ms 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.785032117Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.787323766Z level=info msg="Migration successfully executed" id="Add column uid in alert_notification" duration=2.291219ms 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.787671088Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.787793272Z level=info msg="Migration successfully executed" id="Update uid column values in alert_notification" duration=122.878µs 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.788514702Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.789039823Z level=info msg="Migration successfully executed" id="Add unique index alert_notification_org_id_uid" duration=524.812µs 2024-09-21T17:46:34.854 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.789431332Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.78996431Z level=info msg="Migration successfully executed" id="Remove unique index org_id_name" duration=532.84µs 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.790304155Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.792469397Z level=info msg="Migration successfully executed" id="Add column secure_settings in alert_notification" duration=2.164848ms 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.792864109Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.792914771Z level=info msg="Migration successfully executed" id="alter alert.settings to mediumtext" duration=50.966µs 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.793737723Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.794245226Z level=info msg="Migration successfully executed" id="Add non-unique index alert_notification_state_alert_id" duration=505.652µs 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.794576345Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.795148733Z level=info msg="Migration successfully executed" id="Add non-unique index alert_rule_tag_alert_id" duration=572.252µs 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.795493546Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.7955513Z level=info msg="Migration successfully executed" id="Drop old annotation table v4" duration=57.856µs 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.795938042Z level=info msg="Executing migration" id="create annotation table v5" 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.796486714Z level=info msg="Migration successfully executed" id="create annotation table v5" duration=548.351µs 2024-09-21T17:46:34.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.796826106Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.797347603Z level=info msg="Migration successfully executed" id="add index annotation 0 v3" duration=521.117µs 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.797682419Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.7982081Z level=info msg="Migration successfully executed" id="add index annotation 1 v3" duration=525.3µs 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.798545842Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.799061209Z level=info msg="Migration successfully executed" id="add index annotation 2 v3" duration=515.114µs 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.799399614Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.799975251Z level=info msg="Migration successfully executed" id="add index annotation 3 v3" duration=575.306µs 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.80031942Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.80091344Z level=info msg="Migration successfully executed" id="add index annotation 4 v3" duration=592.502µs 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.80125657Z level=info msg="Executing migration" id="Update annotation table charset" 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.801271382Z level=info msg="Migration successfully executed" id="Update annotation table charset" duration=15.379µs 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.802095485Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.80450885Z level=info msg="Migration successfully executed" id="Add column region_id to annotation table" duration=2.412994ms 2024-09-21T17:46:34.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.804866794Z level=info msg="Executing migration" id="Drop category_id index" 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.805387495Z level=info msg="Migration successfully executed" id="Drop category_id index" duration=520.358µs 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.805714054Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.807980067Z level=info msg="Migration successfully executed" id="Add column tags to annotation table" duration=2.265729ms 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.808325968Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.8087513Z level=info msg="Migration successfully executed" id="Create annotation_tag table v2" duration=425.127µs 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.809162123Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.809712152Z level=info msg="Migration successfully executed" id="Add unique index annotation_tag.annotation_id_tag_id" duration=548.18µs 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.810078227Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.810583536Z level=info msg="Migration successfully executed" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" duration=505.123µs 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.810935096Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.81730563Z level=info msg="Migration successfully executed" id="Rename table annotation_tag to annotation_tag_v2 - v2" duration=6.370351ms 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.817673654Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.818129064Z level=info msg="Migration successfully executed" id="Create annotation_tag table v3" duration=455.175µs 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.818614473Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-09-21T17:46:34.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.81916254Z level=info msg="Migration successfully executed" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" duration=547.691µs 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.819515085Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.819703811Z level=info msg="Migration successfully executed" id="copy annotation_tag v2 to v3" duration=188.62µs 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.820339849Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.820692992Z level=info msg="Migration successfully executed" id="drop table annotation_tag_v2" duration=352.732µs 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.821215658Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.821332027Z level=info msg="Migration successfully executed" id="Update alert annotations and set TEXT to empty" duration=116.308µs 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.822086108Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.824915574Z level=info msg="Migration successfully executed" id="Add created time to annotation table" duration=2.807451ms 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.825268569Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.827562915Z level=info msg="Migration successfully executed" id="Add updated time to annotation table" duration=2.295018ms 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.827926429Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.828459367Z level=info msg="Migration successfully executed" id="Add index for created in annotation table" duration=532.74µs 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.82881747Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-09-21T17:46:34.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.829354289Z level=info msg="Migration successfully executed" id="Add index for updated in annotation table" duration=536.516µs 2024-09-21T17:46:34.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.83170261Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-09-21T17:46:34.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.831842348Z level=info msg="Migration successfully executed" id="Convert existing annotations from seconds to milliseconds" duration=139.649µs 2024-09-21T17:46:34.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.83223327Z level=info msg="Executing migration" id="Add epoch_end column" 2024-09-21T17:46:34.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.834570785Z level=info msg="Migration successfully executed" id="Add epoch_end column" duration=2.337118ms 2024-09-21T17:46:34.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.835179785Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-09-21T17:46:34.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.83572083Z level=info msg="Migration successfully executed" id="Add index for epoch_end" duration=540.833µs 2024-09-21T17:46:34.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.837935108Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-09-21T17:46:34.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.8380484Z level=info msg="Migration successfully executed" id="Make epoch_end the same as epoch" duration=112.274µs 2024-09-21T17:46:35.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.840650009Z level=info msg="Executing migration" id="Move region to single row" 2024-09-21T17:46:35.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.840877059Z level=info msg="Migration successfully executed" id="Move region to single row" duration=226.77µs 2024-09-21T17:46:35.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.841272551Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-09-21T17:46:35.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.841829998Z level=info msg="Migration successfully executed" id="Remove index org_id_epoch from annotation table" duration=557.775µs 2024-09-21T17:46:35.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.844141205Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-09-21T17:46:35.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.844680971Z level=info msg="Migration successfully executed" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" duration=540.133µs 2024-09-21T17:46:35.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.847057796Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-09-21T17:46:35.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.847615912Z level=info msg="Migration successfully executed" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" duration=558.279µs 2024-09-21T17:46:35.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.849713173Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-09-21T17:46:35.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.850299494Z level=info msg="Migration successfully executed" id="Add index for org_id_epoch_end_epoch on annotation table" duration=587.285µs 2024-09-21T17:46:35.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.850665789Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-09-21T17:46:35.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.851212834Z level=info msg="Migration successfully executed" id="Remove index org_id_epoch_epoch_end from annotation table" duration=546.791µs 2024-09-21T17:46:35.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.853655513Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-09-21T17:46:35.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.854216527Z level=info msg="Migration successfully executed" id="Add index for alert_id on annotation table" duration=560.741µs 2024-09-21T17:46:35.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.856429587Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-09-21T17:46:35.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.856472272Z level=info msg="Migration successfully executed" id="Increase tags column to length 4096" duration=43.425µs 2024-09-21T17:46:35.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.856933626Z level=info msg="Executing migration" id="create test_data table" 2024-09-21T17:46:35.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.857458182Z level=info msg="Migration successfully executed" id="create test_data table" duration=524.833µs 2024-09-21T17:46:35.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.859206074Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-09-21T17:46:35.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.859751637Z level=info msg="Migration successfully executed" id="create dashboard_version table v1" duration=545.889µs 2024-09-21T17:46:35.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.861849622Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-09-21T17:46:35.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.862479797Z level=info msg="Migration successfully executed" id="add index dashboard_version.dashboard_id" duration=633.295µs 2024-09-21T17:46:35.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.864811276Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-09-21T17:46:35.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.865443913Z level=info msg="Migration successfully executed" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" duration=635.659µs 2024-09-21T17:46:35.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.867580862Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-09-21T17:46:35.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.867716832Z level=info msg="Migration successfully executed" id="Set dashboard version to 1 where 0" duration=136.42µs 2024-09-21T17:46:35.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.868106592Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-09-21T17:46:35.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.868344157Z level=info msg="Migration successfully executed" id="save existing dashboard data in dashboard_version table v1" duration=237.261µs 2024-09-21T17:46:35.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.871140454Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-09-21T17:46:35.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.871239311Z level=info msg="Migration successfully executed" id="alter dashboard_version.data to mediumtext v1" duration=105.086µs 2024-09-21T17:46:35.093 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.873595529Z level=info msg="Executing migration" id="create team table" 2024-09-21T17:46:35.093 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.874076514Z level=info msg="Migration successfully executed" id="create team table" duration=481.31µs 2024-09-21T17:46:35.093 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.876499663Z level=info msg="Executing migration" id="add index team.org_id" 2024-09-21T17:46:35.093 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.877245142Z level=info msg="Migration successfully executed" id="add index team.org_id" duration=747.115µs 2024-09-21T17:46:35.094 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.877634762Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-09-21T17:46:35.094 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.878186756Z level=info msg="Migration successfully executed" id="add unique index team_org_id_name" duration=551.832µs 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.880360082Z level=info msg="Executing migration" id="Add column uid in team" 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.882899505Z level=info msg="Migration successfully executed" id="Add column uid in team" duration=2.53907ms 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.883231611Z level=info msg="Executing migration" id="Update uid column values in team" 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.883339181Z level=info msg="Migration successfully executed" id="Update uid column values in team" duration=107.473µs 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.886116522Z level=info msg="Executing migration" id="Add unique index team_org_id_uid" 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.886720514Z level=info msg="Migration successfully executed" id="Add unique index team_org_id_uid" duration=605.603µs 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.887077255Z level=info msg="Executing migration" id="create team member table" 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.88755751Z level=info msg="Migration successfully executed" id="create team member table" duration=480.02µs 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.889775526Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.890334755Z level=info msg="Migration successfully executed" id="add index team_member.org_id" duration=557.905µs 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.892450493Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.893009155Z level=info msg="Migration successfully executed" id="add unique index team_member_org_id_team_id_user_id" duration=557.459µs 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.895241267Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-09-21T17:46:35.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.895778523Z level=info msg="Migration successfully executed" id="add index team_member.team_id" duration=536.288µs 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.896139429Z level=info msg="Executing migration" id="Add column email to team table" 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.898909796Z level=info msg="Migration successfully executed" id="Add column email to team table" duration=2.769809ms 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.8992623Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.902121108Z level=info msg="Migration successfully executed" id="Add column external to team_member table" duration=2.858409ms 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.902500194Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.905090338Z level=info msg="Migration successfully executed" id="Add column permission to team_member table" duration=2.589853ms 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.905477178Z level=info msg="Executing migration" id="create dashboard acl table" 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.906105377Z level=info msg="Migration successfully executed" id="create dashboard acl table" duration=627.811µs 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.906467966Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.907059492Z level=info msg="Migration successfully executed" id="add index dashboard_acl_dashboard_id" duration=592.146µs 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.907410116Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.908048653Z level=info msg="Migration successfully executed" id="add unique index dashboard_acl_dashboard_id_user_id" duration=638.098µs 2024-09-21T17:46:35.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.91011473Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.910698216Z level=info msg="Migration successfully executed" id="add unique index dashboard_acl_dashboard_id_team_id" duration=583.28µs 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 bash[59645]: 071d550bb132596bf7ef8acb676cb91a672047bd804e54c4306ef7dc7928d8c2 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.912542945Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.913177649Z level=info msg="Migration successfully executed" id="add index dashboard_acl_user_id" duration=634.063µs 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.913593195Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 systemd[1]: Started Ceph grafana.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.914357644Z level=info msg="Migration successfully executed" id="add index dashboard_acl_team_id" duration=764.126µs 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.914789089Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.915612511Z level=info msg="Migration successfully executed" id="add index dashboard_acl_org_id_role" duration=824.233µs 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.916145974Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.916729508Z level=info msg="Migration successfully executed" id="add index dashboard_permission" duration=583.538µs 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.917076404Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-09-21T17:46:35.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.917407449Z level=info msg="Migration successfully executed" id="save default acl rules in dashboard_acl table" duration=329.584µs 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.917857147Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.918005565Z level=info msg="Migration successfully executed" id="delete acl rules for deleted dashboards and folders" duration=148.47µs 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.918703951Z level=info msg="Executing migration" id="create tag table" 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.919220783Z level=info msg="Migration successfully executed" id="create tag table" duration=516.437µs 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.919570663Z level=info msg="Executing migration" id="add index tag.key_value" 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.920164228Z level=info msg="Migration successfully executed" id="add index tag.key_value" duration=593.184µs 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.920500539Z level=info msg="Executing migration" id="create login attempt table" 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.920973632Z level=info msg="Migration successfully executed" id="create login attempt table" duration=472.59µs 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.921339123Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.921956268Z level=info msg="Migration successfully executed" id="add index login_attempt.username" duration=616.154µs 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.922397326Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.923217329Z level=info msg="Migration successfully executed" id="drop index IDX_login_attempt_username - v1" duration=819.758µs 2024-09-21T17:46:35.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.923638796Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.93432946Z level=info msg="Migration successfully executed" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" duration=10.687227ms 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.934945764Z level=info msg="Executing migration" id="create login_attempt v2" 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.935762992Z level=info msg="Migration successfully executed" id="create login_attempt v2" duration=821.978µs 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.936143452Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.936712635Z level=info msg="Migration successfully executed" id="create index IDX_login_attempt_username - v2" duration=568.829µs 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.937069729Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.937270366Z level=info msg="Migration successfully executed" id="copy login_attempt v1 to v2" duration=200.515µs 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.937902953Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.938321626Z level=info msg="Migration successfully executed" id="drop login_attempt_tmp_qwerty" duration=418.573µs 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.938678728Z level=info msg="Executing migration" id="create user auth table" 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.939166626Z level=info msg="Migration successfully executed" id="create user auth table" duration=488.702µs 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.939517558Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-09-21T17:46:35.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.940109001Z level=info msg="Migration successfully executed" id="create index IDX_user_auth_auth_module_auth_id - v1" duration=589.841µs 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.940454145Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.940492491Z level=info msg="Migration successfully executed" id="alter user_auth.auth_id to length 190" duration=38.639µs 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.940947203Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.944149077Z level=info msg="Migration successfully executed" id="Add OAuth access token to user_auth" duration=3.199723ms 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.944651415Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.947756662Z level=info msg="Migration successfully executed" id="Add OAuth refresh token to user_auth" duration=3.102875ms 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.948224635Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.951227464Z level=info msg="Migration successfully executed" id="Add OAuth token type to user_auth" duration=3.001934ms 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.951728811Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.95481619Z level=info msg="Migration successfully executed" id="Add OAuth expiry to user_auth" duration=3.085878ms 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.955282035Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-09-21T17:46:35.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.955885754Z level=info msg="Migration successfully executed" id="Add index to user_id column in user_auth" duration=603.213µs 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.956268566Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.959364455Z level=info msg="Migration successfully executed" id="Add OAuth ID token to user_auth" duration=3.094289ms 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.95983806Z level=info msg="Executing migration" id="create server_lock table" 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.960412487Z level=info msg="Migration successfully executed" id="create server_lock table" duration=574.204µs 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.960799062Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.961389016Z level=info msg="Migration successfully executed" id="add index server_lock.operation_uid" duration=589.673µs 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.961763382Z level=info msg="Executing migration" id="create user auth token table" 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.962333459Z level=info msg="Migration successfully executed" id="create user auth token table" duration=569.883µs 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.962699808Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.963308892Z level=info msg="Migration successfully executed" id="add unique index user_auth_token.auth_token" duration=608.829µs 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.963677838Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.964266209Z level=info msg="Migration successfully executed" id="add unique index user_auth_token.prev_auth_token" duration=588.135µs 2024-09-21T17:46:35.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.964642239Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.965300509Z level=info msg="Migration successfully executed" id="add index user_auth_token.user_id" duration=657.949µs 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.96574412Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.969978487Z level=info msg="Migration successfully executed" id="Add revoked_at to the user auth token" duration=4.233958ms 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.970406591Z level=info msg="Executing migration" id="add index user_auth_token.revoked_at" 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.971216242Z level=info msg="Migration successfully executed" id="add index user_auth_token.revoked_at" duration=809.684µs 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.971562335Z level=info msg="Executing migration" id="create cache_data table" 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.972140175Z level=info msg="Migration successfully executed" id="create cache_data table" duration=578.832µs 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.97251125Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.973226315Z level=info msg="Migration successfully executed" id="add unique index cache_data.cache_key" duration=712.752µs 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.973641312Z level=info msg="Executing migration" id="create short_url table v1" 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.974515795Z level=info msg="Migration successfully executed" id="create short_url table v1" duration=874.163µs 2024-09-21T17:46:35.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.975074353Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.975942757Z level=info msg="Migration successfully executed" id="add index short_url.org_id-uid" duration=867.624µs 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.976285601Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.976325196Z level=info msg="Migration successfully executed" id="alter table short_url alter column created_by type to bigint" duration=39.914µs 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.976705339Z level=info msg="Executing migration" id="delete alert_definition table" 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.976772664Z level=info msg="Migration successfully executed" id="delete alert_definition table" duration=67.369µs 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.97720725Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.977753859Z level=info msg="Migration successfully executed" id="recreate alert_definition table" duration=546.333µs 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.978100193Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.97884166Z level=info msg="Migration successfully executed" id="add index in alert_definition on org_id and title columns" duration=740.203µs 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.979723948Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.980618523Z level=info msg="Migration successfully executed" id="add index in alert_definition on org_id and uid columns" duration=893.856µs 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.981029481Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-09-21T17:46:35.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.981069502Z level=info msg="Migration successfully executed" id="alter alert_definition table data column to mediumtext in mysql" duration=40.392µs 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.98191801Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.982533031Z level=info msg="Migration successfully executed" id="drop index in alert_definition on org_id and title columns" duration=615.415µs 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.982862217Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.983494744Z level=info msg="Migration successfully executed" id="drop index in alert_definition on org_id and uid columns" duration=634.976µs 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.983851429Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.984688258Z level=info msg="Migration successfully executed" id="add unique index in alert_definition on org_id and title columns" duration=835.563µs 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.98516766Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.986027189Z level=info msg="Migration successfully executed" id="add unique index in alert_definition on org_id and uid columns" duration=859.088µs 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.986453868Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.989939155Z level=info msg="Migration successfully executed" id="Add column paused in alert_definition" duration=3.485641ms 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.990270787Z level=info msg="Executing migration" id="drop alert_definition table" 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.990953301Z level=info msg="Migration successfully executed" id="drop alert_definition table" duration=682.1µs 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.991298479Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-09-21T17:46:35.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.991359259Z level=info msg="Migration successfully executed" id="delete alert_definition_version table" duration=59.307µs 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.993949389Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.994515708Z level=info msg="Migration successfully executed" id="recreate alert_definition_version table" duration=565.279µs 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.996650996Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.997290455Z level=info msg="Migration successfully executed" id="add index in alert_definition_version table on alert_definition_id and version columns" duration=639.201µs 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:34 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:34.999730032Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.000361656Z level=info msg="Migration successfully executed" id="add index in alert_definition_version table on alert_definition_uid and version columns" duration=631.431µs 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.000706913Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.000746963Z level=info msg="Migration successfully executed" id="alter alert_definition_version table data column to mediumtext in mysql" duration=40.309µs 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.003392723Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.004065859Z level=info msg="Migration successfully executed" id="drop alert_definition_version table" duration=672.921µs 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.0062363Z level=info msg="Executing migration" id="create alert_instance table" 2024-09-21T17:46:35.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.006848492Z level=info msg="Migration successfully executed" id="create alert_instance table" duration=611.947µs 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.008772578Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.009412697Z level=info msg="Migration successfully executed" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" duration=639.943µs 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.009762752Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.010400437Z level=info msg="Migration successfully executed" id="add index in alert_instance table on def_org_id, current_state columns" duration=637.375µs 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.01279698Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.016189059Z level=info msg="Migration successfully executed" id="add column current_state_end to alert_instance" duration=3.39409ms 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.016531693Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.017099625Z level=info msg="Migration successfully executed" id="remove index def_org_id, def_uid, current_state on alert_instance" duration=567.671µs 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.019412349Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.020008646Z level=info msg="Migration successfully executed" id="remove index def_org_id, current_state on alert_instance" duration=596.166µs 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.021928149Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-09-21T17:46:35.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.039842306Z level=info msg="Migration successfully executed" id="rename def_org_id to rule_org_id in alert_instance" duration=17.913815ms 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.040235651Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.056926488Z level=info msg="Migration successfully executed" id="rename def_uid to rule_uid in alert_instance" duration=16.690763ms 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.057324704Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.057979715Z level=info msg="Migration successfully executed" id="add index rule_org_id, rule_uid, current_state on alert_instance" duration=654.801µs 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.060233461Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.060900488Z level=info msg="Migration successfully executed" id="add index rule_org_id, current_state on alert_instance" duration=667.392µs 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.061256414Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.064428325Z level=info msg="Migration successfully executed" id="add current_reason column related to current_state" duration=3.172832ms 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.064786476Z level=info msg="Executing migration" id="add result_fingerprint column to alert_instance" 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.0680009Z level=info msg="Migration successfully executed" id="add result_fingerprint column to alert_instance" duration=3.214093ms 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.068367655Z level=info msg="Executing migration" id="create alert_rule table" 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.06901323Z level=info msg="Migration successfully executed" id="create alert_rule table" duration=645.253µs 2024-09-21T17:46:35.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.071157908Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.071855575Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id and title columns" duration=711.84µs 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.072211203Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.072820883Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id and uid columns" duration=609.403µs 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.075037837Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.075726289Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" duration=687.997µs 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.077803638Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.077858883Z level=info msg="Migration successfully executed" id="alter alert_rule table data column to mediumtext in mysql" duration=55.474µs 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.080429366Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.083836468Z level=info msg="Migration successfully executed" id="add column for to alert_rule" duration=3.406705ms 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.084222902Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.087864248Z level=info msg="Migration successfully executed" id="add column annotations to alert_rule" duration=3.641106ms 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.088274346Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.092049772Z level=info msg="Migration successfully executed" id="add column labels to alert_rule" duration=3.77564ms 2024-09-21T17:46:35.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.092423904Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-09-21T17:46:35.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.093071876Z level=info msg="Migration successfully executed" id="remove unique index from alert_rule on org_id, title columns" duration=646.773µs 2024-09-21T17:46:35.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.095004109Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-09-21T17:46:35.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.09561123Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, namespase_uid and title columns" duration=606.802µs 2024-09-21T17:46:35.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.095947652Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-09-21T17:46:35.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.099348755Z level=info msg="Migration successfully executed" id="add dashboard_uid column to alert_rule" duration=3.401442ms 2024-09-21T17:46:35.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.099703943Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-09-21T17:46:35.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.103094488Z level=info msg="Migration successfully executed" id="add panel_id column to alert_rule" duration=3.390239ms 2024-09-21T17:46:35.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.103442522Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-09-21T17:46:35.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.104088484Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" duration=644.494µs 2024-09-21T17:46:35.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.106303684Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-09-21T17:46:35.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.109693141Z level=info msg="Migration successfully executed" id="add rule_group_idx column to alert_rule" duration=3.389091ms 2024-09-21T17:46:35.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.110063332Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-09-21T17:46:35.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.11345019Z level=info msg="Migration successfully executed" id="add is_paused column to alert_rule table" duration=3.385588ms 2024-09-21T17:46:35.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.113814865Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-09-21T17:46:35.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.113858615Z level=info msg="Migration successfully executed" id="fix is_paused column for alert_rule table" duration=44.526µs 2024-09-21T17:46:35.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.116446294Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-09-21T17:46:35.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.117198699Z level=info msg="Migration successfully executed" id="create alert_rule_version table" duration=752.203µs 2024-09-21T17:46:35.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.119273055Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-09-21T17:46:35.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.12000235Z level=info msg="Migration successfully executed" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" duration=731.893µs 2024-09-21T17:46:35.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.120359877Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-09-21T17:46:35.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.12109424Z level=info msg="Migration successfully executed" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" duration=734.327µs 2024-09-21T17:46:35.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.121450024Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-09-21T17:46:35.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.12148945Z level=info msg="Migration successfully executed" id="alter alert_rule_version table data column to mediumtext in mysql" duration=38.563µs 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.12240603Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.126148202Z level=info msg="Migration successfully executed" id="add column for to alert_rule_version" duration=3.745223ms 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.126555191Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.130130984Z level=info msg="Migration successfully executed" id="add column annotations to alert_rule_version" duration=3.575399ms 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.130476673Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.134231982Z level=info msg="Migration successfully executed" id="add column labels to alert_rule_version" duration=3.754929ms 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.134587156Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.138190538Z level=info msg="Migration successfully executed" id="add rule_group_idx column to alert_rule_version" duration=3.60352ms 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.138550509Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.142198684Z level=info msg="Migration successfully executed" id="add is_paused column to alert_rule_versions table" duration=3.648262ms 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.142558211Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-09-21T17:46:35.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.142598629Z level=info msg="Migration successfully executed" id="fix is_paused column for alert_rule_version table" duration=40.665µs 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.143000944Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.143490279Z level=info msg="Migration successfully executed" id=create_alert_configuration_table duration=489.786µs 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.143838882Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.147511773Z level=info msg="Migration successfully executed" id="Add column default in alert_configuration" duration=3.6731ms 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.147867793Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.147919165Z level=info msg="Migration successfully executed" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" duration=51.621µs 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.148735607Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.152305908Z level=info msg="Migration successfully executed" id="add column org_id in alert_configuration" duration=3.570418ms 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.152666737Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.153297041Z level=info msg="Migration successfully executed" id="add index in alert_configuration table on org_id column" duration=630.601µs 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.153658274Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.157220043Z level=info msg="Migration successfully executed" id="add configuration_hash column to alert_configuration" duration=3.561458ms 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.157595764Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.158113052Z level=info msg="Migration successfully executed" id=create_ngalert_configuration_table duration=516.964µs 2024-09-21T17:46:35.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.158498041Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.159150489Z level=info msg="Migration successfully executed" id="add index in ngalert_configuration on org_id column" duration=652.4µs 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.159519938Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.163217339Z level=info msg="Migration successfully executed" id="add column send_alerts_to in ngalert_configuration" duration=3.697633ms 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.163593131Z level=info msg="Executing migration" id="create provenance_type table" 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.164100807Z level=info msg="Migration successfully executed" id="create provenance_type table" duration=509.94µs 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.164468835Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.165112129Z level=info msg="Migration successfully executed" id="add index to uniquify (record_key, record_type, org_id) columns" duration=643.213µs 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.165560424Z level=info msg="Executing migration" id="create alert_image table" 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.16608434Z level=info msg="Migration successfully executed" id="create alert_image table" duration=523.817µs 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.16648457Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.167103696Z level=info msg="Migration successfully executed" id="add unique index on token to alert_image table" duration=617.714µs 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.167480107Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-09-21T17:46:35.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.167520235Z level=info msg="Migration successfully executed" id="support longer URLs in alert_image table" duration=40.445µs 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.168494843Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.16925435Z level=info msg="Migration successfully executed" id=create_alert_configuration_history_table duration=763.406µs 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.169634697Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.170262036Z level=info msg="Migration successfully executed" id="drop non-unique orgID index on alert_configuration" duration=627.759µs 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.170612843Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.17084356Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.17146715Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.171770526Z level=info msg="Migration successfully executed" id="extract alertmanager configuration history to separate table" duration=303.212µs 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.172355604Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.172984272Z level=info msg="Migration successfully executed" id="add unique index on orgID to alert_configuration" duration=628.251µs 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.173323663Z level=info msg="Executing migration" id="add last_applied column to alert_configuration_history" 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.177117782Z level=info msg="Migration successfully executed" id="add last_applied column to alert_configuration_history" duration=3.793277ms 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.177525853Z level=info msg="Executing migration" id="create library_element table v1" 2024-09-21T17:46:35.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.178240754Z level=info msg="Migration successfully executed" id="create library_element table v1" duration=714.667µs 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.178620577Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.179299295Z level=info msg="Migration successfully executed" id="add index library_element org_id-folder_id-name-kind" duration=677.159µs 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.179660603Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.180206149Z level=info msg="Migration successfully executed" id="create library_element_connection table v1" duration=545.411µs 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.180573592Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.18126025Z level=info msg="Migration successfully executed" id="add index library_element_connection element_id-kind-connection_id" duration=686.272µs 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.181622228Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.182256908Z level=info msg="Migration successfully executed" id="add unique index library_element org_id_uid" duration=634.379µs 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.182614738Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.182630397Z level=info msg="Migration successfully executed" id="increase max description length to 2048" duration=16.3µs 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.183641064Z level=info msg="Executing migration" id="alter library_element model to mediumtext" 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.183758126Z level=info msg="Migration successfully executed" id="alter library_element model to mediumtext" duration=119.508µs 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.18619955Z level=info msg="Executing migration" id="add library_element folder uid" 2024-09-21T17:46:35.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.190361576Z level=info msg="Migration successfully executed" id="add library_element folder uid" duration=4.162177ms 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.190702692Z level=info msg="Executing migration" id="populate library_element folder_uid" 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.190962111Z level=info msg="Migration successfully executed" id="populate library_element folder_uid" duration=259.316µs 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.193608373Z level=info msg="Executing migration" id="add index library_element org_id-folder_uid-name-kind" 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.194278893Z level=info msg="Migration successfully executed" id="add index library_element org_id-folder_uid-name-kind" duration=670.138µs 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.196472647Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.196678529Z level=info msg="Migration successfully executed" id="clone move dashboard alerts to unified alerting" duration=205.658µs 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.199314365Z level=info msg="Executing migration" id="create data_keys table" 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.199999005Z level=info msg="Migration successfully executed" id="create data_keys table" duration=684.952µs 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.20037823Z level=info msg="Executing migration" id="create secrets table" 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.200968339Z level=info msg="Migration successfully executed" id="create secrets table" duration=589.338µs 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.203019593Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.225006571Z level=info msg="Migration successfully executed" id="rename data_keys name column to id" duration=21.98523ms 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.225389653Z level=info msg="Executing migration" id="add name column into data_keys" 2024-09-21T17:46:35.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.229799462Z level=info msg="Migration successfully executed" id="add name column into data_keys" duration=4.410196ms 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.230187936Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.230291475Z level=info msg="Migration successfully executed" id="copy data_keys id column values into name" duration=104.102µs 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.23068131Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.251325893Z level=info msg="Migration successfully executed" id="rename data_keys name column to label" duration=20.645778ms 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.251704799Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.273185787Z level=info msg="Migration successfully executed" id="rename data_keys id column back to name" duration=21.479792ms 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.27359164Z level=info msg="Executing migration" id="create kv_store table v1" 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.27423809Z level=info msg="Migration successfully executed" id="create kv_store table v1" duration=646.785µs 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.276329388Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.277041984Z level=info msg="Migration successfully executed" id="add index kv_store.org_id-namespace-key" duration=712.247µs 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.277393986Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.277520263Z level=info msg="Migration successfully executed" id="update dashboard_uid and panel_id from existing annotations" duration=126.055µs 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.280440031Z level=info msg="Executing migration" id="create permission table" 2024-09-21T17:46:35.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.2810457Z level=info msg="Migration successfully executed" id="create permission table" duration=609.241µs 2024-09-21T17:46:35.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.28319135Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-09-21T17:46:35.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.283837878Z level=info msg="Migration successfully executed" id="add unique index permission.role_id" duration=646.643µs 2024-09-21T17:46:35.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.285864427Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-09-21T17:46:35.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.286547251Z level=info msg="Migration successfully executed" id="add unique index role_id_action_scope" duration=682.368µs 2024-09-21T17:46:35.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.28693679Z level=info msg="Executing migration" id="create role table" 2024-09-21T17:46:35.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.287504255Z level=info msg="Migration successfully executed" id="create role table" duration=567.319µs 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.289696854Z level=info msg="Executing migration" id="add column display_name" 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.294308913Z level=info msg="Migration successfully executed" id="add column display_name" duration=4.614277ms 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.294689772Z level=info msg="Executing migration" id="add column group_name" 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.299204878Z level=info msg="Migration successfully executed" id="add column group_name" duration=4.514957ms 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.299583739Z level=info msg="Executing migration" id="add index role.org_id" 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.300239341Z level=info msg="Migration successfully executed" id="add index role.org_id" duration=655.291µs 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.300588271Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.301283269Z level=info msg="Migration successfully executed" id="add unique index role_org_id_name" duration=694.618µs 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.303363777Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.304121793Z level=info msg="Migration successfully executed" id="add index role_org_id_uid" duration=758.005µs 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.305942675Z level=info msg="Executing migration" id="create team role table" 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.306721581Z level=info msg="Migration successfully executed" id="create team role table" duration=784.047µs 2024-09-21T17:46:35.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.308392402Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.309075023Z level=info msg="Migration successfully executed" id="add index team_role.org_id" duration=682.382µs 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.309461682Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.31013Z level=info msg="Migration successfully executed" id="add unique index team_role_org_id_team_id_role_id" duration=667.987µs 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.312226961Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.312887264Z level=info msg="Migration successfully executed" id="add index team_role.team_id" duration=660.023µs 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.314823976Z level=info msg="Executing migration" id="create user role table" 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.315390485Z level=info msg="Migration successfully executed" id="create user role table" duration=566.634µs 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.317540817Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.318315428Z level=info msg="Migration successfully executed" id="add index user_role.org_id" duration=777.638µs 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.318668223Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.319363076Z level=info msg="Migration successfully executed" id="add unique index user_role_org_id_user_id_role_id" duration=694.52µs 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.321567718Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.322311705Z level=info msg="Migration successfully executed" id="add index user_role.user_id" duration=745.665µs 2024-09-21T17:46:35.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.324015169Z level=info msg="Executing migration" id="create builtin role table" 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.324748451Z level=info msg="Migration successfully executed" id="create builtin role table" duration=733.888µs 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.326624036Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.327322257Z level=info msg="Migration successfully executed" id="add index builtin_role.role_id" duration=698.205µs 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.327683946Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.3283614Z level=info msg="Migration successfully executed" id="add index builtin_role.name" duration=677.204µs 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.330572405Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.335146984Z level=info msg="Migration successfully executed" id="Add column org_id to builtin_role table" duration=4.574212ms 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.335531654Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.336189533Z level=info msg="Migration successfully executed" id="add index builtin_role.org_id" duration=656.001µs 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.336553398Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.33722909Z level=info msg="Migration successfully executed" id="add unique index builtin_role_org_id_role_id_role" duration=675.125µs 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.337587039Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.338251784Z level=info msg="Migration successfully executed" id="Remove unique index role_org_id_uid" duration=664.28µs 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.338628285Z level=info msg="Executing migration" id="add unique index role.uid" 2024-09-21T17:46:35.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.339297863Z level=info msg="Migration successfully executed" id="add unique index role.uid" duration=669.246µs 2024-09-21T17:46:35.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.339652385Z level=info msg="Executing migration" id="create seed assignment table" 2024-09-21T17:46:35.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.340186377Z level=info msg="Migration successfully executed" id="create seed assignment table" duration=534.205µs 2024-09-21T17:46:35.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.340548853Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-09-21T17:46:35.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.34125084Z level=info msg="Migration successfully executed" id="add unique index builtin_role_role_name" duration=702.656µs 2024-09-21T17:46:35.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.341606922Z level=info msg="Executing migration" id="add column hidden to role table" 2024-09-21T17:46:35.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.346272314Z level=info msg="Migration successfully executed" id="add column hidden to role table" duration=4.665058ms 2024-09-21T17:46:35.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.346655465Z level=info msg="Executing migration" id="permission kind migration" 2024-09-21T17:46:35.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.351427293Z level=info msg="Migration successfully executed" id="permission kind migration" duration=4.771543ms 2024-09-21T17:46:35.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.35179899Z level=info msg="Executing migration" id="permission attribute migration" 2024-09-21T17:46:35.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.356448425Z level=info msg="Migration successfully executed" id="permission attribute migration" duration=4.64926ms 2024-09-21T17:46:35.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.356817659Z level=info msg="Executing migration" id="permission identifier migration" 2024-09-21T17:46:35.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.361378465Z level=info msg="Migration successfully executed" id="permission identifier migration" duration=4.56048ms 2024-09-21T17:46:35.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.36176294Z level=info msg="Executing migration" id="add permission identifier index" 2024-09-21T17:46:35.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.362456368Z level=info msg="Migration successfully executed" id="add permission identifier index" duration=693.233µs 2024-09-21T17:46:35.604 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.36495733Z level=info msg="Executing migration" id="add permission action scope role_id index" 2024-09-21T17:46:35.605 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.365685908Z level=info msg="Migration successfully executed" id="add permission action scope role_id index" duration=728.194µs 2024-09-21T17:46:35.605 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.366081118Z level=info msg="Executing migration" id="remove permission role_id action scope index" 2024-09-21T17:46:35.605 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.36673087Z level=info msg="Migration successfully executed" id="remove permission role_id action scope index" duration=649.657µs 2024-09-21T17:46:35.605 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.367098573Z level=info msg="Executing migration" id="create query_history table v1" 2024-09-21T17:46:35.605 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.36768894Z level=info msg="Migration successfully executed" id="create query_history table v1" duration=591.129µs 2024-09-21T17:46:35.605 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.368076557Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-09-21T17:46:35.605 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.368742188Z level=info msg="Migration successfully executed" id="add index query_history.org_id-created_by-datasource_uid" duration=665.307µs 2024-09-21T17:46:35.606 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.369104398Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-09-21T17:46:35.606 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.369144635Z level=info msg="Migration successfully executed" id="alter table query_history alter column created_by type to bigint" duration=40.528µs 2024-09-21T17:46:35.606 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.369566409Z level=info msg="Executing migration" id="rbac disabled migrator" 2024-09-21T17:46:35.606 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.369593023Z level=info msg="Migration successfully executed" id="rbac disabled migrator" duration=27.287µs 2024-09-21T17:46:35.606 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.370054687Z level=info msg="Executing migration" id="teams permissions migration" 2024-09-21T17:46:35.606 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.370329883Z level=info msg="Migration successfully executed" id="teams permissions migration" duration=275.123µs 2024-09-21T17:46:35.606 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.370720286Z level=info msg="Executing migration" id="dashboard permissions" 2024-09-21T17:46:35.606 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.371074918Z level=info msg="Migration successfully executed" id="dashboard permissions" duration=355.087µs 2024-09-21T17:46:35.606 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.371469871Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-09-21T17:46:35.606 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.371895644Z level=info msg="Migration successfully executed" id="dashboard permissions uid scopes" duration=425.554µs 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.372289623Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.372443812Z level=info msg="Migration successfully executed" id="drop managed folder create actions" duration=153.971µs 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.372830611Z level=info msg="Executing migration" id="alerting notification permissions" 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.37314401Z level=info msg="Migration successfully executed" id="alerting notification permissions" duration=313.215µs 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.37355695Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.374083041Z level=info msg="Migration successfully executed" id="create query_history_star table v1" duration=525.86µs 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.374438876Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.375186449Z level=info msg="Migration successfully executed" id="add index query_history.user_id-query_uid" duration=745.993µs 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.375557934Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.380317394Z level=info msg="Migration successfully executed" id="add column org_id in query_history_star" duration=4.759208ms 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.380682624Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.380727687Z level=info msg="Migration successfully executed" id="alter table query_history_star_mig column user_id type to bigint" duration=44.771µs 2024-09-21T17:46:35.607 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.381168836Z level=info msg="Executing migration" id="create correlation table v1" 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.381814753Z level=info msg="Migration successfully executed" id="create correlation table v1" duration=645.548µs 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.382180858Z level=info msg="Executing migration" id="add index correlations.uid" 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.382930738Z level=info msg="Migration successfully executed" id="add index correlations.uid" duration=749.653µs 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.3832995Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.383971458Z level=info msg="Migration successfully executed" id="add index correlations.source_uid" duration=671.732µs 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.384323115Z level=info msg="Executing migration" id="add correlation config column" 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.389144762Z level=info msg="Migration successfully executed" id="add correlation config column" duration=4.805457ms 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.389514184Z level=info msg="Executing migration" id="drop index IDX_correlation_uid - v1" 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.390187237Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_uid - v1" duration=672.709µs 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.39054952Z level=info msg="Executing migration" id="drop index IDX_correlation_source_uid - v1" 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.391229647Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_source_uid - v1" duration=679.95µs 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.393564564Z level=info msg="Executing migration" id="Rename table correlation to correlation_tmp_qwerty - v1" 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.41091731Z level=info msg="Migration successfully executed" id="Rename table correlation to correlation_tmp_qwerty - v1" duration=17.35225ms 2024-09-21T17:46:35.608 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.411344441Z level=info msg="Executing migration" id="create correlation v2" 2024-09-21T17:46:35.609 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.412139525Z level=info msg="Migration successfully executed" id="create correlation v2" duration=794.561µs 2024-09-21T17:46:35.609 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.41256299Z level=info msg="Executing migration" id="create index IDX_correlation_uid - v2" 2024-09-21T17:46:35.609 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.413294842Z level=info msg="Migration successfully executed" id="create index IDX_correlation_uid - v2" duration=732.363µs 2024-09-21T17:46:35.609 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.415471344Z level=info msg="Executing migration" id="create index IDX_correlation_source_uid - v2" 2024-09-21T17:46:35.609 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.416164832Z level=info msg="Migration successfully executed" id="create index IDX_correlation_source_uid - v2" duration=693.652µs 2024-09-21T17:46:35.609 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.418562317Z level=info msg="Executing migration" id="create index IDX_correlation_org_id - v2" 2024-09-21T17:46:35.610 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.419253255Z level=info msg="Migration successfully executed" id="create index IDX_correlation_org_id - v2" duration=690.61µs 2024-09-21T17:46:35.610 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.421511882Z level=info msg="Executing migration" id="copy correlation v1 to v2" 2024-09-21T17:46:35.610 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.421750973Z level=info msg="Migration successfully executed" id="copy correlation v1 to v2" duration=242.59µs 2024-09-21T17:46:35.610 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.422155283Z level=info msg="Executing migration" id="drop correlation_tmp_qwerty" 2024-09-21T17:46:35.610 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.422727848Z level=info msg="Migration successfully executed" id="drop correlation_tmp_qwerty" duration=572.908µs 2024-09-21T17:46:35.610 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.423083878Z level=info msg="Executing migration" id="add provisioning column" 2024-09-21T17:46:35.610 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.42785332Z level=info msg="Migration successfully executed" id="add provisioning column" duration=4.772059ms 2024-09-21T17:46:35.610 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.428233072Z level=info msg="Executing migration" id="create entity_events table" 2024-09-21T17:46:35.610 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.428755355Z level=info msg="Migration successfully executed" id="create entity_events table" duration=522.182µs 2024-09-21T17:46:35.610 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.431132821Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-09-21T17:46:35.610 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.431913404Z level=info msg="Migration successfully executed" id="create dashboard public config v1" duration=782.575µs 2024-09-21T17:46:35.611 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.432286634Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-21T17:46:35.611 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.432570248Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-21T17:46:35.611 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.434799317Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-21T17:46:35.611 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.435090313Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.435489298Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.436063207Z level=info msg="Migration successfully executed" id="Drop old dashboard public config table" duration=575.457µs 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.438094039Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.438740363Z level=info msg="Migration successfully executed" id="recreate dashboard public config v1" duration=645.978µs 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.440813553Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.441569102Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_uid - v1" duration=757.04µs 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.44345182Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.444233071Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" duration=784.271µs 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.446183082Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.446961961Z level=info msg="Migration successfully executed" id="drop index UQE_dashboard_public_config_uid - v2" duration=781.243µs 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.448831396Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.449662033Z level=info msg="Migration successfully executed" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" duration=832.658µs 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.450007975Z level=info msg="Executing migration" id="Drop public config table" 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.450555652Z level=info msg="Migration successfully executed" id="Drop public config table" duration=547.352µs 2024-09-21T17:46:35.612 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.452641277Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.453384978Z level=info msg="Migration successfully executed" id="Recreate dashboard public config v2" duration=741.699µs 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.45505799Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.455731184Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_uid - v2" duration=672.86µs 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.45762781Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.458327736Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" duration=699.486µs 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.458669984Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.459331579Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_access_token - v2" duration=661.31µs 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.461493075Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.476045822Z level=info msg="Migration successfully executed" id="Rename table dashboard_public_config to dashboard_public - v2" duration=14.552787ms 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.476413546Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.481638495Z level=info msg="Migration successfully executed" id="add annotations_enabled column" duration=5.224778ms 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.481979401Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.487041968Z level=info msg="Migration successfully executed" id="add time_selection_enabled column" duration=5.062264ms 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.48737832Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-09-21T17:46:35.613 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.487517898Z level=info msg="Migration successfully executed" id="delete orphaned public dashboards" duration=138.506µs 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.488193308Z level=info msg="Executing migration" id="add share column" 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.493316608Z level=info msg="Migration successfully executed" id="add share column" duration=5.123091ms 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.49365143Z level=info msg="Executing migration" id="backfill empty share column fields with default of public" 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.493780058Z level=info msg="Migration successfully executed" id="backfill empty share column fields with default of public" duration=130.387µs 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.49467221Z level=info msg="Executing migration" id="create file table" 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.495360822Z level=info msg="Migration successfully executed" id="create file table" duration=690.464µs 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.495699851Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.496369958Z level=info msg="Migration successfully executed" id="file table idx: path natural pk" duration=669.944µs 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.496705788Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.497411811Z level=info msg="Migration successfully executed" id="file table idx: parent_folder_path_hash fast folder retrieval" duration=705.715µs 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.497753386Z level=info msg="Executing migration" id="create file_meta table" 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.498335793Z level=info msg="Migration successfully executed" id="create file_meta table" duration=582.298µs 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.498698811Z level=info msg="Executing migration" id="file table idx: path key" 2024-09-21T17:46:35.614 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.499404146Z level=info msg="Migration successfully executed" id="file table idx: path key" duration=704.994µs 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.499755928Z level=info msg="Executing migration" id="set path collation in file table" 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.499793954Z level=info msg="Migration successfully executed" id="set path collation in file table" duration=38.163µs 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.500579216Z level=info msg="Executing migration" id="migrate contents column to mediumblob for MySQL" 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.500617065Z level=info msg="Migration successfully executed" id="migrate contents column to mediumblob for MySQL" duration=38.057µs 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.501409368Z level=info msg="Executing migration" id="managed permissions migration" 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.501710323Z level=info msg="Migration successfully executed" id="managed permissions migration" duration=300.756µs 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.502106413Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.502227933Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions migration" duration=122.337µs 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.502610616Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.503401977Z level=info msg="Migration successfully executed" id="RBAC action name migrator" duration=791.231µs 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.503788259Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.509041181Z level=info msg="Migration successfully executed" id="Add UID column to playlist" duration=5.252605ms 2024-09-21T17:46:35.615 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.509377159Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.509478598Z level=info msg="Migration successfully executed" id="Update uid column values in playlist" duration=101.382µs 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.510264468Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.51093002Z level=info msg="Migration successfully executed" id="Add index for uid in playlist" duration=663.527µs 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.51127086Z level=info msg="Executing migration" id="update group index for alert rules" 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.511493795Z level=info msg="Migration successfully executed" id="update group index for alert rules" duration=223.349µs 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.511868963Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.511996667Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions repeated migration" duration=127.537µs 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.512852889Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.513249123Z level=info msg="Migration successfully executed" id="admin only folder/dashboard permission" duration=399.782µs 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.513636489Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.51861818Z level=info msg="Migration successfully executed" id="add action column to seed_assignment" duration=4.981344ms 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.51896529Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.524509833Z level=info msg="Migration successfully executed" id="add scope column to seed_assignment" duration=5.544309ms 2024-09-21T17:46:35.616 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.524866282Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-09-21T17:46:35.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.525626673Z level=info msg="Migration successfully executed" id="remove unique index builtin_role_role_name before nullable update" duration=758.995µs 2024-09-21T17:46:35.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.525965167Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-09-21T17:46:35.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.582143016Z level=info msg="Migration successfully executed" id="update seed_assignment role_name column to nullable" duration=56.17706ms 2024-09-21T17:46:35.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.582530963Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-09-21T17:46:35.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.583212458Z level=info msg="Migration successfully executed" id="add unique index builtin_role_name back" duration=681.21µs 2024-09-21T17:46:35.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.583544215Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-09-21T17:46:35.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.58424014Z level=info msg="Migration successfully executed" id="add unique index builtin_role_action_scope" duration=695.632µs 2024-09-21T17:46:35.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.584585074Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-09-21T17:46:35.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.601724841Z level=info msg="Migration successfully executed" id="add primary key to seed_assigment" duration=17.139265ms 2024-09-21T17:46:35.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.602175854Z level=info msg="Executing migration" id="add origin column to seed_assignment" 2024-09-21T17:46:35.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.610303781Z level=info msg="Migration successfully executed" id="add origin column to seed_assignment" duration=8.129671ms 2024-09-21T17:46:35.855 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.61065724Z level=info msg="Executing migration" id="add origin to plugin seed_assignment" 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.610841461Z level=info msg="Migration successfully executed" id="add origin to plugin seed_assignment" duration=184.108µs 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.611554897Z level=info msg="Executing migration" id="prevent seeding OnCall access" 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.611658862Z level=info msg="Migration successfully executed" id="prevent seeding OnCall access" duration=104.05µs 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.612048105Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.612168572Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions repeated fixed migration" duration=121.629µs 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.612896732Z level=info msg="Executing migration" id="managed folder permissions library panel actions migration" 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.613015607Z level=info msg="Migration successfully executed" id="managed folder permissions library panel actions migration" duration=118.58µs 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.613766832Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.613895798Z level=info msg="Migration successfully executed" id="migrate external alertmanagers to datsourcse" duration=128.822µs 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.614758506Z level=info msg="Executing migration" id="create folder table" 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.615537827Z level=info msg="Migration successfully executed" id="create folder table" duration=781.044µs 2024-09-21T17:46:35.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.615913273Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-09-21T17:46:35.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.61659845Z level=info msg="Migration successfully executed" id="Add index for parent_uid" duration=684.902µs 2024-09-21T17:46:35.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.616938195Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-09-21T17:46:35.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.617638903Z level=info msg="Migration successfully executed" id="Add unique index for folder.uid and folder.org_id" duration=700.476µs 2024-09-21T17:46:35.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.617980525Z level=info msg="Executing migration" id="Update folder title length" 2024-09-21T17:46:35.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.617995692Z level=info msg="Migration successfully executed" id="Update folder title length" duration=15.68µs 2024-09-21T17:46:35.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.618992283Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-09-21T17:46:35.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.619836222Z level=info msg="Migration successfully executed" id="Add unique index for folder.title and folder.parent_uid" duration=845.451µs 2024-09-21T17:46:35.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.620200775Z level=info msg="Executing migration" id="Remove unique index for folder.title and folder.parent_uid" 2024-09-21T17:46:35.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.620851774Z level=info msg="Migration successfully executed" id="Remove unique index for folder.title and folder.parent_uid" duration=649.115µs 2024-09-21T17:46:35.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.623085122Z level=info msg="Executing migration" id="Add unique index for title, parent_uid, and org_id" 2024-09-21T17:46:35.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.623831822Z level=info msg="Migration successfully executed" id="Add unique index for title, parent_uid, and org_id" duration=748.36µs 2024-09-21T17:46:35.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.625961418Z level=info msg="Executing migration" id="Sync dashboard and folder table" 2024-09-21T17:46:35.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.626247458Z level=info msg="Migration successfully executed" id="Sync dashboard and folder table" duration=286.003µs 2024-09-21T17:46:35.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.628639314Z level=info msg="Executing migration" id="Remove ghost folders from the folder table" 2024-09-21T17:46:35.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.628809798Z level=info msg="Migration successfully executed" id="Remove ghost folders from the folder table" duration=170.277µs 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.629211587Z level=info msg="Executing migration" id="Remove unique index UQE_folder_uid_org_id" 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.629858462Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_uid_org_id" duration=646.658µs 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.632093368Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_uid" 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.632777357Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_uid" duration=683.792µs 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.63489534Z level=info msg="Executing migration" id="Remove unique index UQE_folder_title_parent_uid_org_id" 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.635553195Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_title_parent_uid_org_id" duration=657.698µs 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.637710031Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_parent_uid_title" 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.638403283Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_parent_uid_title" duration=692.971µs 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.638762227Z level=info msg="Executing migration" id="Remove index IDX_folder_parent_uid_org_id" 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.639412239Z level=info msg="Migration successfully executed" id="Remove index IDX_folder_parent_uid_org_id" duration=648.701µs 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.64166148Z level=info msg="Executing migration" id="create anon_device table" 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.64225125Z level=info msg="Migration successfully executed" id="create anon_device table" duration=589.617µs 2024-09-21T17:46:35.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.64437503Z level=info msg="Executing migration" id="add unique index anon_device.device_id" 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.645126792Z level=info msg="Migration successfully executed" id="add unique index anon_device.device_id" duration=751.365µs 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.647268506Z level=info msg="Executing migration" id="add index anon_device.updated_at" 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.647958579Z level=info msg="Migration successfully executed" id="add index anon_device.updated_at" duration=689.797µs 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.648299517Z level=info msg="Executing migration" id="create signing_key table" 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.648832533Z level=info msg="Migration successfully executed" id="create signing_key table" duration=532.816µs 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.65119935Z level=info msg="Executing migration" id="add unique index signing_key.key_id" 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.651886086Z level=info msg="Migration successfully executed" id="add unique index signing_key.key_id" duration=688.056µs 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.65395535Z level=info msg="Executing migration" id="set legacy alert migration status in kvstore" 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.654664746Z level=info msg="Migration successfully executed" id="set legacy alert migration status in kvstore" duration=709.332µs 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.657140416Z level=info msg="Executing migration" id="migrate record of created folders during legacy migration to kvstore" 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.657345784Z level=info msg="Migration successfully executed" id="migrate record of created folders during legacy migration to kvstore" duration=206.318µs 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.657769637Z level=info msg="Executing migration" id="Add folder_uid for dashboard" 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.663330051Z level=info msg="Migration successfully executed" id="Add folder_uid for dashboard" duration=5.559972ms 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.663709669Z level=info msg="Executing migration" id="Populate dashboard folder_uid column" 2024-09-21T17:46:35.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.664199054Z level=info msg="Migration successfully executed" id="Populate dashboard folder_uid column" duration=485.691µs 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.666349753Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title" 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.666360692Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title" duration=11.391µs 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.669092255Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_id_title" 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.669777067Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_id_title" duration=685.192µs 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.670142915Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_uid_title" 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.670152283Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_uid_title" duration=10.14µs 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.672690095Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.673442445Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" duration=752.458µs 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.673805984Z level=info msg="Executing migration" id="Restore index for dashboard_org_id_folder_id_title" 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.674522811Z level=info msg="Migration successfully executed" id="Restore index for dashboard_org_id_folder_id_title" duration=716.54µs 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.676624484Z level=info msg="Executing migration" id="create sso_setting table" 2024-09-21T17:46:35.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.677314321Z level=info msg="Migration successfully executed" id="create sso_setting table" duration=689.506µs 2024-09-21T17:46:35.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.67769242Z level=info msg="Executing migration" id="copy kvstore migration status to each org" 2024-09-21T17:46:35.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.678233572Z level=info msg="Migration successfully executed" id="copy kvstore migration status to each org" duration=542.321µs 2024-09-21T17:46:35.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.680226346Z level=info msg="Executing migration" id="add back entry for orgid=0 migrated status" 2024-09-21T17:46:35.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.680402989Z level=info msg="Migration successfully executed" id="add back entry for orgid=0 migrated status" duration=177.148µs 2024-09-21T17:46:35.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.682797607Z level=info msg="Executing migration" id="alter kv_store.value to longtext" 2024-09-21T17:46:35.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.682908523Z level=info msg="Migration successfully executed" id="alter kv_store.value to longtext" duration=113.204µs 2024-09-21T17:46:35.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.685478906Z level=info msg="Executing migration" id="add notification_settings column to alert_rule table" 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.690792668Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule table" duration=5.315258ms 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.691167555Z level=info msg="Executing migration" id="add notification_settings column to alert_rule_version table" 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.696514419Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule_version table" duration=5.346535ms 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.696880264Z level=info msg="Executing migration" id="removing scope from alert.instances:read action migration" 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.697100907Z level=info msg="Migration successfully executed" id="removing scope from alert.instances:read action migration" duration=221.138µs 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=migrator t=2024-09-21T17:46:35.699414546Z level=info msg="migrations completed" performed=551 skipped=0 duration=1.295563429s 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore t=2024-09-21T17:46:35.700319125Z level=info msg="Created default organization" 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=secrets t=2024-09-21T17:46:35.700824548Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=plugin.store t=2024-09-21T17:46:35.714956755Z level=info msg="Loading plugins..." 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=local.finder t=2024-09-21T17:46:35.758818367Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=plugin.store t=2024-09-21T17:46:35.7588385Z level=info msg="Plugins loaded" count=55 duration=43.882908ms 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=query_data t=2024-09-21T17:46:35.760814982Z level=info msg="Query Service initialization" 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=live.push_http t=2024-09-21T17:46:35.763309131Z level=info msg="Live Push Gateway initialization" 2024-09-21T17:46:35.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ngalert.migration t=2024-09-21T17:46:35.764417698Z level=info msg=Starting 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ngalert.migration t=2024-09-21T17:46:35.764687683Z level=info msg="Applying transition" currentType=Legacy desiredType=UnifiedAlerting cleanOnDowngrade=false cleanOnUpgrade=false 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ngalert.migration orgID=1 t=2024-09-21T17:46:35.764984628Z level=info msg="Migrating alerts for organisation" 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ngalert.migration orgID=1 t=2024-09-21T17:46:35.765435804Z level=info msg="Alerts found to migrate" alerts=0 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ngalert.migration t=2024-09-21T17:46:35.766622779Z level=info msg="Completed alerting migration" 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ngalert.state.manager t=2024-09-21T17:46:35.777763692Z level=info msg="Running in alternative execution of Error/NoData mode" 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=infra.usagestats.collector t=2024-09-21T17:46:35.779188755Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=provisioning.datasources t=2024-09-21T17:46:35.780802274Z level=info msg="inserting datasource from configuration" name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=provisioning.datasources t=2024-09-21T17:46:35.793048623Z level=info msg="inserting datasource from configuration" name=Loki uid=P8E80F9AEF21F6940 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=provisioning.alerting t=2024-09-21T17:46:35.805795797Z level=info msg="starting to provision alerting" 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=provisioning.alerting t=2024-09-21T17:46:35.805807414Z level=info msg="finished to provision alerting" 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ngalert.state.manager t=2024-09-21T17:46:35.806151739Z level=info msg="Warming state cache for startup" 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ngalert.state.manager t=2024-09-21T17:46:35.806386779Z level=info msg="State cache has been initialized" states=0 duration=234.092µs 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ngalert.multiorg.alertmanager t=2024-09-21T17:46:35.806406862Z level=info msg="Starting MultiOrg Alertmanager" 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ngalert.scheduler t=2024-09-21T17:46:35.80642792Z level=info msg="Starting scheduler" tickInterval=10s maxAttempts=1 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ticker t=2024-09-21T17:46:35.806472424Z level=info msg=starting first_tick=2024-09-21T17:46:40Z 2024-09-21T17:46:35.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=grafanaStorageLogger t=2024-09-21T17:46:35.806712345Z level=info msg="Storage starting" 2024-09-21T17:46:35.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=http.server t=2024-09-21T17:46:35.808293018Z level=info msg="HTTP Server TLS settings" MinTLSVersion=TLS1.2 configuredciphers=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA,TLS_RSA_WITH_AES_128_GCM_SHA256,TLS_RSA_WITH_AES_256_GCM_SHA384,TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_256_CBC_SHA 2024-09-21T17:46:35.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=http.server t=2024-09-21T17:46:35.808599299Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-09-21T17:46:35.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=provisioning.dashboard t=2024-09-21T17:46:35.829240632Z level=info msg="starting to provision dashboards" 2024-09-21T17:46:35.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore.transactions t=2024-09-21T17:46:35.846325519Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T17:46:35.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore.transactions t=2024-09-21T17:46:35.85367143Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T17:46:35.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore.transactions t=2024-09-21T17:46:35.857707365Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-09-21T17:46:35.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:35 smithi042 systemd[1]: Starting Ceph node-exporter.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:46:36.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-mon[32106]: Deploying daemon node-exporter.a on smithi042 2024-09-21T17:46:36.227 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-mon[32106]: pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:36.228 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore.transactions t=2024-09-21T17:46:35.864826375Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T17:46:36.228 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore.transactions t=2024-09-21T17:46:35.868940773Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=2 code="database is locked" 2024-09-21T17:46:36.228 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore.transactions t=2024-09-21T17:46:35.876065245Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-09-21T17:46:36.228 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=plugins.update.checker t=2024-09-21T17:46:35.883721725Z level=info msg="Update check succeeded" duration=77.831639ms 2024-09-21T17:46:36.228 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=grafana.update.checker t=2024-09-21T17:46:35.885492263Z level=info msg="Update check succeeded" duration=78.948639ms 2024-09-21T17:46:36.228 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore.transactions t=2024-09-21T17:46:35.903221241Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T17:46:36.228 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=provisioning.dashboard t=2024-09-21T17:46:35.979574906Z level=info msg="finished to provision dashboards" 2024-09-21T17:46:36.228 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:36 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=grafana-apiserver t=2024-09-21T17:46:36.225466891Z level=info msg="Adding GroupVersion playlist.grafana.app v0alpha1 to ResourceManager" 2024-09-21T17:46:36.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[29361]: Deploying daemon node-exporter.a on smithi042 2024-09-21T17:46:36.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[29361]: pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:36.308 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.309 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.309 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.309 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:36.309 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[38309]: Deploying daemon node-exporter.a on smithi042 2024-09-21T17:46:36.309 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:35 smithi042 ceph-mon[38309]: pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:36.309 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:35 smithi042 bash[69858]: Trying to pull quay.io/prometheus/node-exporter:v1.7.0... 2024-09-21T17:46:36.309 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:36 smithi042 bash[69858]: Getting image source signatures 2024-09-21T17:46:36.309 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:36 smithi042 bash[69858]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-09-21T17:46:36.575 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:46:36 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=grafana-apiserver t=2024-09-21T17:46:36.225913383Z level=info msg="Adding GroupVersion featuretoggle.grafana.app v0alpha1 to ResourceManager" 2024-09-21T17:46:36.664 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:36 smithi042 bash[69858]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2024-09-21T17:46:36.664 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:36 smithi042 bash[69858]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2024-09-21T17:46:38.164 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:37 smithi042 bash[69858]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-09-21T17:46:38.164 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:37 smithi042 bash[69858]: Writing manifest to image destination 2024-09-21T17:46:38.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-mon[29361]: pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:38.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:38.436 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 podman[69858]: 2024-09-21 17:46:38.171849993 +0000 UTC m=+2.316576139 image pull 72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e quay.io/prometheus/node-exporter:v1.7.0 2024-09-21T17:46:38.436 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 podman[69858]: 2024-09-21 17:46:38.311686167 +0000 UTC m=+2.456412313 container create cd634aec6e319a5e71ecfc74266a27df1219033b30f2333f60a878fefa75de0a (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:38.436 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-mon[38309]: pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:38.436 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:38 smithi162 ceph-mon[32106]: pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:38 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:38.914 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 podman[69858]: 2024-09-21 17:46:38.548435995 +0000 UTC m=+2.693162147 container init cd634aec6e319a5e71ecfc74266a27df1219033b30f2333f60a878fefa75de0a (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:38.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 podman[69858]: 2024-09-21 17:46:38.55147408 +0000 UTC m=+2.696200225 container start cd634aec6e319a5e71ecfc74266a27df1219033b30f2333f60a878fefa75de0a (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:38.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.555Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-09-21T17:46:38.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.555Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-09-21T17:46:38.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.555Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-21T17:46:38.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.555Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-21T17:46:38.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.555Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-21T17:46:38.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.555Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-21T17:46:38.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-21T17:46:38.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=arp 2024-09-21T17:46:38.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-21T17:46:38.915 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-21T17:46:38.916 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-21T17:46:38.916 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-21T17:46:38.916 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-21T17:46:38.916 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-21T17:46:38.916 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-21T17:46:38.916 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-21T17:46:38.916 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=edac 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-21T17:46:38.917 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=os 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=stat 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-21T17:46:38.918 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-21T17:46:38.919 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=time 2024-09-21T17:46:38.919 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-21T17:46:38.919 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=uname 2024-09-21T17:46:38.919 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-21T17:46:38.919 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-21T17:46:38.919 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.556Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-21T17:46:38.919 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.557Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-09-21T17:46:38.919 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a[69931]: ts=2024-09-21T17:46:38.557Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-21T17:46:38.919 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 bash[69858]: cd634aec6e319a5e71ecfc74266a27df1219033b30f2333f60a878fefa75de0a 2024-09-21T17:46:38.919 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 17:46:38 smithi042 systemd[1]: Started Ceph node-exporter.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:46:39.069 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:46:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:46:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:39 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:39 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:39 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:39 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:39.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:39 smithi162 ceph-mon[32106]: Deploying daemon node-exporter.b on smithi162 2024-09-21T17:46:39.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:39 smithi162 ceph-mon[32106]: pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:40.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:40.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:40.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:40.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[29361]: Deploying daemon node-exporter.b on smithi162 2024-09-21T17:46:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[29361]: pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[38309]: Deploying daemon node-exporter.b on smithi162 2024-09-21T17:46:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:39 smithi042 ceph-mon[38309]: pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:40.325 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:39 smithi162 bash[59877]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-09-21T17:46:41.825 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:41 smithi162 bash[59877]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-09-21T17:46:41.825 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:41 smithi162 bash[59877]: Writing manifest to image destination 2024-09-21T17:46:42.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:41 smithi162 podman[59877]: 2024-09-21 17:46:41.889259589 +0000 UTC m=+2.335684063 image pull 72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e quay.io/prometheus/node-exporter:v1.7.0 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 podman[59877]: 2024-09-21 17:46:42.004412755 +0000 UTC m=+2.450837232 container create 045d33617a4c742eb0ea3c1399d9415d640ccf6b2710afbdfe9618f45344a3e3 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 podman[59877]: 2024-09-21 17:46:42.189827697 +0000 UTC m=+2.636252175 container init 045d33617a4c742eb0ea3c1399d9415d640ccf6b2710afbdfe9618f45344a3e3 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 podman[59877]: 2024-09-21 17:46:42.193067214 +0000 UTC m=+2.639491686 container start 045d33617a4c742eb0ea3c1399d9415d640ccf6b2710afbdfe9618f45344a3e3 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.196Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.196Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=arp 2024-09-21T17:46:42.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-21T17:46:42.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-21T17:46:42.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-21T17:46:42.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-21T17:46:42.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-21T17:46:42.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-21T17:46:42.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-21T17:46:42.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-21T17:46:42.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=edac 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-21T17:46:42.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=os 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=stat 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.197Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.198Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-21T17:46:42.236 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.198Z caller=node_exporter.go:117 level=info collector=time 2024-09-21T17:46:42.237 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.198Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-21T17:46:42.237 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.198Z caller=node_exporter.go:117 level=info collector=uname 2024-09-21T17:46:42.237 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.198Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-21T17:46:42.237 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.198Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-21T17:46:42.237 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.198Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-21T17:46:42.237 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.198Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-09-21T17:46:42.237 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b[59953]: ts=2024-09-21T17:46:42.198Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-21T17:46:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:42 smithi162 ceph-mon[32106]: pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:42.575 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 bash[59877]: 045d33617a4c742eb0ea3c1399d9415d640ccf6b2710afbdfe9618f45344a3e3 2024-09-21T17:46:42.575 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 17:46:42 smithi162 systemd[1]: Started Ceph node-exporter.b for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:46:42.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:42 smithi042 ceph-mon[29361]: pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:42.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:42 smithi042 ceph-mon[38309]: pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:46:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:46:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:46:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:46:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:44 smithi162 ceph-mon[32106]: pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:44.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:44 smithi042 ceph-mon[29361]: pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:44.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:44 smithi042 ceph-mon[38309]: pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:46 smithi162 ceph-mon[32106]: pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:46 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:46 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:46 smithi042 ceph-mon[29361]: pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:46 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:46 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:46 smithi042 ceph-mon[38309]: pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:46 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:46 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:47 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:47 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:47 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:46:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:47 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:46:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:47 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:47.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:47 smithi162 ceph-mon[32106]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-21T17:46:47.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:47 smithi162 ceph-mon[32106]: Reconfiguring daemon alertmanager.a on smithi042 2024-09-21T17:46:47.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:47 smithi162 ceph-mon[32106]: pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:47.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:47.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:47.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:46:47.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[29361]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[29361]: Reconfiguring daemon alertmanager.a on smithi042 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[29361]: pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[38309]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[38309]: Reconfiguring daemon alertmanager.a on smithi042 2024-09-21T17:46:47.869 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:47 smithi042 ceph-mon[38309]: pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:49.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:46:48 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:46:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:50 smithi162 ceph-mon[32106]: pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:50.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:50.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:50 smithi042 ceph-mon[29361]: pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:46:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:50 smithi042 ceph-mon[38309]: pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:51.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:51 smithi042 systemd[1]: Stopping Ceph alertmanager.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:46:51.817 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:51 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[69632]: ts=2024-09-21T17:46:51.531Z caller=main.go:542 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-21T17:46:51.817 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:51 smithi042 podman[70532]: 2024-09-21 17:46:51.552295217 +0000 UTC m=+0.130184036 container died 8d5f9f23b496a48d373072079c5f6d67a4727ff9228143e93aa215f5ead8a23e (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:52.108 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:51 smithi042 podman[70532]: 2024-09-21 17:46:51.880288207 +0000 UTC m=+0.458177013 container cleanup 8d5f9f23b496a48d373072079c5f6d67a4727ff9228143e93aa215f5ead8a23e (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:52.108 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:51 smithi042 bash[70532]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a 2024-09-21T17:46:52.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:52 smithi042 ceph-mon[29361]: pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:52.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:52 smithi042 podman[70543]: 2024-09-21 17:46:52.106318906 +0000 UTC m=+0.549978883 container remove 8d5f9f23b496a48d373072079c5f6d67a4727ff9228143e93aa215f5ead8a23e (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:52.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:52 smithi042 podman[70543]: 2024-09-21 17:46:52.173506366 +0000 UTC m=+0.617166339 volume remove e32c21cbc04ad3aa1e420793f8ed3cea9b09266c7df5766094b186415c8c6aca 2024-09-21T17:46:52.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:52 smithi042 ceph-mon[38309]: pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:52.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:52 smithi162 ceph-mon[32106]: pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:52.759 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:52 smithi042 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@alertmanager.a.service: Deactivated successfully. 2024-09-21T17:46:52.760 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:52 smithi042 systemd[1]: Stopped Ceph alertmanager.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:46:52.760 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:52 smithi042 systemd[1]: Starting Ceph alertmanager.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:46:52.760 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:52 smithi042 podman[70629]: 2024-09-21 17:46:52.638340017 +0000 UTC m=+0.018895800 image pull 11f11916f8cdfb17c1da74b20deb2075d778357b4d60474d82453303f8d461f5 quay.io/prometheus/alertmanager:v0.27.0 2024-09-21T17:46:52.760 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:52 smithi042 podman[70629]: 2024-09-21 17:46:52.758088208 +0000 UTC m=+0.138643965 volume create 32c2cf8c0e08f90f870dc6d8b40f059fa50e0d061772fb740943498332534a2d 2024-09-21T17:46:53.050 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:52 smithi042 podman[70629]: 2024-09-21 17:46:52.875305323 +0000 UTC m=+0.255861082 container create 08a5abaa1a372d06509721ce4dd9be7714b17ae3beec1012065715c4cc97e08f (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:53.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 podman[70629]: 2024-09-21 17:46:53.145532142 +0000 UTC m=+0.526087914 container init 08a5abaa1a372d06509721ce4dd9be7714b17ae3beec1012065715c4cc97e08f (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:53.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 podman[70629]: 2024-09-21 17:46:53.149886702 +0000 UTC m=+0.530442464 container start 08a5abaa1a372d06509721ce4dd9be7714b17ae3beec1012065715c4cc97e08f (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:53.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T17:46:53.164Z caller=main.go:181 level=info msg="Starting Alertmanager" version="(version=0.27.0, branch=HEAD, revision=0aa3c2aad14cff039931923ab16b26b7481783b5)" 2024-09-21T17:46:53.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T17:46:53.164Z caller=main.go:182 level=info build_context="(go=go1.21.7, platform=linux/amd64, user=root@22cd11f671e9, date=20240228-11:51:20, tags=netgo)" 2024-09-21T17:46:53.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T17:46:53.165Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.42 port=9094 2024-09-21T17:46:53.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T17:46:53.167Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-21T17:46:53.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T17:46:53.202Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T17:46:53.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T17:46:53.202Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T17:46:53.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T17:46:53.203Z caller=main.go:394 level=info component=configuration msg="skipping creation of receiver not referenced by any route" receiver=custom-receiver 2024-09-21T17:46:53.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T17:46:53.205Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9093 2024-09-21T17:46:53.416 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T17:46:53.206Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-21T17:46:53.416 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 bash[70629]: 08a5abaa1a372d06509721ce4dd9be7714b17ae3beec1012065715c4cc97e08f 2024-09-21T17:46:53.416 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:53 smithi042 systemd[1]: Started Ceph alertmanager.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:46:53.914 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:46:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:46:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:54 smithi162 ceph-mon[32106]: pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:54 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:54 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:54 smithi162 ceph-mon[32106]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T17:46:54.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:54 smithi042 ceph-mon[29361]: pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:54 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:54 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:54 smithi042 ceph-mon[29361]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T17:46:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:54 smithi042 ceph-mon[38309]: pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:46:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:54 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:54 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:54 smithi042 ceph-mon[38309]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T17:46:55.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:55 smithi162 ceph-mon[32106]: Reconfiguring daemon prometheus.a on smithi162 2024-09-21T17:46:55.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:55 smithi042 ceph-mon[29361]: Reconfiguring daemon prometheus.a on smithi162 2024-09-21T17:46:55.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:55 smithi042 ceph-mon[38309]: Reconfiguring daemon prometheus.a on smithi162 2024-09-21T17:46:55.665 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:46:55 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T17:46:55.167Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00067664s 2024-09-21T17:46:56.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-mon[32106]: pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:56.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:56 smithi042 ceph-mon[29361]: pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:56.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:56 smithi042 ceph-mon[38309]: pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:56.825 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 systemd[1]: Stopping Ceph prometheus.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:46:57.224 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.972Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-21T17:46:57.225 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.972Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..." 2024-09-21T17:46:57.225 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.972Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..." 2024-09-21T17:46:57.225 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.972Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-21T17:46:57.225 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.972Z caller=main.go:984 level=info msg="Scrape discovery manager stopped" 2024-09-21T17:46:57.225 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.972Z caller=main.go:998 level=info msg="Notify discovery manager stopped" 2024-09-21T17:46:57.225 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.972Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped" 2024-09-21T17:46:57.225 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.972Z caller=main.go:1039 level=info msg="Stopping scrape manager..." 2024-09-21T17:46:57.225 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.972Z caller=main.go:1031 level=info msg="Scrape manager stopped" 2024-09-21T17:46:57.225 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.973Z caller=notifier.go:618 level=info component=notifier msg="Stopping notification manager..." 2024-09-21T17:46:57.225 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.973Z caller=main.go:1261 level=info msg="Notifier manager stopped" 2024-09-21T17:46:57.226 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[58158]: ts=2024-09-21T17:46:56.973Z caller=main.go:1273 level=info msg="See you next time!" 2024-09-21T17:46:57.226 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:56 smithi162 podman[60652]: 2024-09-21 17:46:56.982650789 +0000 UTC m=+0.134601288 container died d558d92063264e471c19b960b7a7579222b8bfee31d947481d8093fb4a0f2749 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:57.551 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:57 smithi162 podman[60652]: 2024-09-21 17:46:57.380605285 +0000 UTC m=+0.532555771 container cleanup d558d92063264e471c19b960b7a7579222b8bfee31d947481d8093fb4a0f2749 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:57.551 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:57 smithi162 bash[60652]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a 2024-09-21T17:46:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]} : dispatch 2024-09-21T17:46:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]} : dispatch 2024-09-21T17:46:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]} : dispatch 2024-09-21T17:46:57.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]} : dispatch 2024-09-21T17:46:57.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]} : dispatch 2024-09-21T17:46:57.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]} : dispatch 2024-09-21T17:46:57.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]} : dispatch 2024-09-21T17:46:57.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]} : dispatch 2024-09-21T17:46:57.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]} : dispatch 2024-09-21T17:46:57.814 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:57 smithi162 podman[60664]: 2024-09-21 17:46:57.648616649 +0000 UTC m=+0.667393104 container remove d558d92063264e471c19b960b7a7579222b8bfee31d947481d8093fb4a0f2749 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:58.075 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:57 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-21T17:46:58.075 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:57 smithi162 systemd[1]: Stopped Ceph prometheus.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:46:58.075 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:57 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@prometheus.a.service: Consumed 1.014s CPU time. 2024-09-21T17:46:58.075 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:57 smithi162 systemd[1]: Starting Ceph prometheus.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T17:46:58.075 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 podman[60770]: 2024-09-21 17:46:57.93837539 +0000 UTC m=+0.016937388 image pull 1d3b7f56885b6dd623f1785be963aa9c195f86bc256ea454e8d02a7980b79c53 quay.io/prometheus/prometheus:v2.51.0 2024-09-21T17:46:58.075 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 podman[60770]: 2024-09-21 17:46:58.058241502 +0000 UTC m=+0.136803497 container create cffd8c5825007d6e49af952c03e04bc3f6729d188ce7644aa4e53b31fca608e9 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-mon[32106]: pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2024-09-21T17:46:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]': finished 2024-09-21T17:46:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-09-21T17:46:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-mon[32106]: osdmap e63: 8 total, 8 up, 8 in 2024-09-21T17:46:58.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:58.576 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 podman[60770]: 2024-09-21 17:46:58.293815852 +0000 UTC m=+0.372377852 container init cffd8c5825007d6e49af952c03e04bc3f6729d188ce7644aa4e53b31fca608e9 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:58.576 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 podman[60770]: 2024-09-21 17:46:58.297993084 +0000 UTC m=+0.376555089 container start cffd8c5825007d6e49af952c03e04bc3f6729d188ce7644aa4e53b31fca608e9 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T17:46:58.576 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.320Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.0, branch=HEAD, revision=c05c15512acb675e3f6cd662a6727854e93fc024)" 2024-09-21T17:46:58.576 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.320Z caller=main.go:622 level=info build_context="(go=go1.22.1, platform=linux/amd64, user=root@b5723e458358, date=20240319-10:54:45, tags=netgo,builtinassets,stringlabels)" 2024-09-21T17:46:58.576 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.320Z caller=main.go:623 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi162 (none))" 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.320Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.320Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.322Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=:9095 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.322Z caller=main.go:1129 level=info msg="Starting TSDB ..." 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.325Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.325Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.326Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.326Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.425µs 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.326Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.326Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.326Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.326Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=32.727µs wal_replay_duration=367.783µs wbl_replay_duration=139ns total_replay_duration=428.856µs 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.328Z caller=main.go:1150 level=info fs_type=XFS_SUPER_MAGIC 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.328Z caller=main.go:1153 level=info msg="TSDB started" 2024-09-21T17:46:58.577 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.328Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-21T17:46:58.578 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.345Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=17.141578ms db_storage=793ns remote_storage=1.171µs web_handler=250ns query_engine=594ns scrape=375.107µs scrape_sd=135.643µs notify=57.21µs notify_sd=18.687µs rules=16.179979ms tracing=8.951µs 2024-09-21T17:46:58.578 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.345Z caller=main.go:1114 level=info msg="Server is ready to receive web requests." 2024-09-21T17:46:58.578 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T17:46:58.345Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..." 2024-09-21T17:46:58.578 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 bash[60770]: cffd8c5825007d6e49af952c03e04bc3f6729d188ce7644aa4e53b31fca608e9 2024-09-21T17:46:58.578 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 17:46:58 smithi162 systemd[1]: Started Ceph prometheus.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T17:46:58.591 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[29361]: pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:58.591 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2024-09-21T17:46:58.591 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]': finished 2024-09-21T17:46:58.591 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-09-21T17:46:58.591 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[29361]: osdmap e63: 8 total, 8 up, 8 in 2024-09-21T17:46:58.592 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:58.592 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[38309]: pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:46:58.592 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2024-09-21T17:46:58.592 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]': finished 2024-09-21T17:46:58.592 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-09-21T17:46:58.592 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[38309]: osdmap e63: 8 total, 8 up, 8 in 2024-09-21T17:46:58.592 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:46:58.592 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:58] ENGINE Bus STOPPING 2024-09-21T17:46:58.593 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:58] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T17:46:58.593 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:58] ENGINE Bus STOPPED 2024-09-21T17:46:58.593 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:58] ENGINE Bus STARTING 2024-09-21T17:46:58.593 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:58] ENGINE Serving on http://:::9283 2024-09-21T17:46:58.593 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:58] ENGINE Bus STARTED 2024-09-21T17:46:58.914 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:58] ENGINE Bus STOPPING 2024-09-21T17:46:59.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:46:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:46:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: osdmap e64: 8 total, 8 up, 8 in 2024-09-21T17:46:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-21T17:46:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T17:46:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi042.front.sepia.ceph.com:9093"} : dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi042.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"} : dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"} : dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T17:46:59.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:46:59.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:46:59.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: osdmap e64: 8 total, 8 up, 8 in 2024-09-21T17:46:59.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-21T17:46:59.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T17:46:59.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi042.front.sepia.ceph.com:9093"} : dispatch 2024-09-21T17:46:59.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi042.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"} : dispatch 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"} : dispatch 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:46:59.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:46:59.419 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:59] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T17:46:59.419 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:59] ENGINE Bus STOPPED 2024-09-21T17:46:59.419 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:59] ENGINE Bus STARTING 2024-09-21T17:46:59.419 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:59] ENGINE Serving on http://:::9283 2024-09-21T17:46:59.419 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:59] ENGINE Bus STARTED 2024-09-21T17:46:59.419 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:59] ENGINE Bus STOPPING 2024-09-21T17:46:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: osdmap e64: 8 total, 8 up, 8 in 2024-09-21T17:46:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi042.front.sepia.ceph.com:9093"} : dispatch 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi042.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"} : dispatch 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:46:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:46:59.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-21T17:46:59.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T17:46:59.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"} : dispatch 2024-09-21T17:46:59.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T17:46:59.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:46:59.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:46:59.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:46:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:46:59.811 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:59] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T17:46:59.811 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:59] ENGINE Bus STOPPED 2024-09-21T17:46:59.812 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:59] ENGINE Bus STARTING 2024-09-21T17:46:59.812 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:59] ENGINE Serving on http://:::9283 2024-09-21T17:46:59.812 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:46:59 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:17:46:59] ENGINE Bus STARTED 2024-09-21T17:47:00.561 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:00.561 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:00 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:47:00.561 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:00 smithi042 ceph-mon[38309]: pgmap v36: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:47:00.562 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:00 smithi042 ceph-mon[38309]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T17:47:00.562 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:00 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:47:00.562 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:00.562 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:00 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:47:00.562 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:00 smithi042 ceph-mon[29361]: pgmap v36: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:47:00.562 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:00 smithi042 ceph-mon[29361]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T17:47:00.562 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:00 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:47:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:00 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:47:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:00 smithi162 ceph-mon[32106]: pgmap v36: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:47:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:00 smithi162 ceph-mon[32106]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T17:47:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:00 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T17:47:01.454 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:01 smithi042 ceph-mon[38309]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:47:01.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:01 smithi042 ceph-mon[29361]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:47:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:01 smithi162 ceph-mon[32106]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T17:47:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:02 smithi162 ceph-mon[32106]: pgmap v37: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T17:47:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:02 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:02 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:02.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:02 smithi042 ceph-mon[29361]: pgmap v37: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T17:47:02.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:02 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:02.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:02 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:02 smithi042 ceph-mon[38309]: pgmap v37: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T17:47:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:02 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:02 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:03.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:03 smithi042 ceph-mon[29361]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T17:47:03.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:03 smithi042 ceph-mon[29361]: Cluster is now healthy 2024-09-21T17:47:03.665 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 17:47:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T17:47:03.171Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003986652s 2024-09-21T17:47:03.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:03 smithi042 ceph-mon[38309]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T17:47:03.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:03 smithi042 ceph-mon[38309]: Cluster is now healthy 2024-09-21T17:47:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:03 smithi162 ceph-mon[32106]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T17:47:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:03 smithi162 ceph-mon[32106]: Cluster is now healthy 2024-09-21T17:47:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:47:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:47:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:47:04.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:04 smithi042 ceph-mon[29361]: pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72 B/s, 2 objects/s recovering 2024-09-21T17:47:04.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:04 smithi042 ceph-mon[38309]: pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72 B/s, 2 objects/s recovering 2024-09-21T17:47:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:04 smithi162 ceph-mon[32106]: pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72 B/s, 2 objects/s recovering 2024-09-21T17:47:06.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[29361]: pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72 B/s, 2 objects/s recovering 2024-09-21T17:47:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:47:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:47:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[38309]: pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72 B/s, 2 objects/s recovering 2024-09-21T17:47:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:47:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:47:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:06 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:06 smithi162 ceph-mon[32106]: pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72 B/s, 2 objects/s recovering 2024-09-21T17:47:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:06 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:06 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:06 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:47:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:06 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:47:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:06 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:08.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:08 smithi042 ceph-mon[29361]: pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 58 B/s, 2 objects/s recovering 2024-09-21T17:47:08.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:08 smithi042 ceph-mon[38309]: pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 58 B/s, 2 objects/s recovering 2024-09-21T17:47:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:08 smithi162 ceph-mon[32106]: pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 58 B/s, 2 objects/s recovering 2024-09-21T17:47:08.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:47:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:47:10.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:10.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:10 smithi042 ceph-mon[29361]: pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s; 53 B/s, 1 objects/s recovering 2024-09-21T17:47:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:10 smithi042 ceph-mon[38309]: pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s; 53 B/s, 1 objects/s recovering 2024-09-21T17:47:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:10 smithi162 ceph-mon[32106]: pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s; 53 B/s, 1 objects/s recovering 2024-09-21T17:47:12.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:12 smithi042 ceph-mon[29361]: pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48 B/s, 1 objects/s recovering 2024-09-21T17:47:12.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:12 smithi042 ceph-mon[38309]: pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48 B/s, 1 objects/s recovering 2024-09-21T17:47:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:12 smithi162 ceph-mon[32106]: pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48 B/s, 1 objects/s recovering 2024-09-21T17:47:13.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:13.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:47:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:47:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:47:14.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:14 smithi042 ceph-mon[29361]: pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48 B/s, 1 objects/s recovering 2024-09-21T17:47:14.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:14 smithi042 ceph-mon[38309]: pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48 B/s, 1 objects/s recovering 2024-09-21T17:47:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:14 smithi162 ceph-mon[32106]: pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48 B/s, 1 objects/s recovering 2024-09-21T17:47:16.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:16 smithi042 ceph-mon[29361]: pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:16.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:16 smithi042 ceph-mon[38309]: pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:16 smithi162 ceph-mon[32106]: pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:18.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:18 smithi042 ceph-mon[29361]: pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:18 smithi042 ceph-mon[38309]: pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:18 smithi162 ceph-mon[32106]: pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:18.826 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:47:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:47:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:20 smithi042 ceph-mon[29361]: pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:47:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:20 smithi042 ceph-mon[38309]: pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:47:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:20 smithi162 ceph-mon[32106]: pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:47:22.196 INFO:tasks.workunit.client.0.smithi042.stderr:Updating files: 93% (11820/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T17:47:22.658 INFO:tasks.workunit.client.0.smithi042.stderr:Note: switching to '0ecbb435437226bc091a0c2d4549ba25bf724efe'. 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr: git switch -c 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr:Or undo this operation with: 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-21T17:47:22.659 INFO:tasks.workunit.client.0.smithi042.stderr: git switch - 2024-09-21T17:47:22.660 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-21T17:47:22.660 INFO:tasks.workunit.client.0.smithi042.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T17:47:22.660 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-21T17:47:22.660 INFO:tasks.workunit.client.0.smithi042.stderr:HEAD is now at 0ecbb435437 Merge branch 'alertmanager-custom-webhook' of https://github.com/adk3798/ceph into wip-adk-testing-2024-09-21-1014 2024-09-21T17:47:22.664 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T17:47:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:22 smithi042 ceph-mon[29361]: pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:22 smithi042 ceph-mon[38309]: pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:22.699 INFO:tasks.workunit.client.0.smithi042.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T17:47:22.701 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T17:47:22.701 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T17:47:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:22 smithi162 ceph-mon[32106]: pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:23.347 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T17:47:23.423 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T17:47:23.463 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T17:47:23.465 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T17:47:23.465 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T17:47:23.505 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T17:47:23.508 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T17:47:23.508 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T17:47:23.565 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-21T17:47:23.566 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-21T17:47:23.566 DEBUG:teuthology.orchestra.run.smithi042:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0ecbb435437226bc091a0c2d4549ba25bf724efe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-09-21T17:47:23.643 INFO:tasks.workunit.client.0.smithi042.stderr:+ parallel=1 2024-09-21T17:47:23.643 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' '' = --serial ']' 2024-09-21T17:47:23.643 INFO:tasks.workunit.client.0.smithi042.stderr:+ crimson=0 2024-09-21T17:47:23.643 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' '' = --crimson ']' 2024-09-21T17:47:23.643 INFO:tasks.workunit.client.0.smithi042.stderr:+ color= 2024-09-21T17:47:23.643 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -t 1 ']' 2024-09-21T17:47:23.644 INFO:tasks.workunit.client.0.smithi042.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-21T17:47:23.644 INFO:tasks.workunit.client.0.smithi042.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-21T17:47:23.644 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-21T17:47:23.645 INFO:tasks.workunit.client.0.smithi042.stderr:+ declare -A pids 2024-09-21T17:47:23.645 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.645 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.645 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_aio 2024-09-21T17:47:23.645 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_aio' 2024-09-21T17:47:23.645 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_aio 2024-09-21T17:47:23.645 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.646 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_aio 2024-09-21T17:47:23.646 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71200 2024-09-21T17:47:23.646 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_aio on pid 71200' 2024-09-21T17:47:23.646 INFO:tasks.workunit.client.0.smithi042.stdout:test api_aio on pid 71200 2024-09-21T17:47:23.649 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71200 2024-09-21T17:47:23.649 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.649 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.649 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-09-21T17:47:23.649 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_aio_pp 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_aio_pp' 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_aio_pp 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.650 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.651 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.652 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.652 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.652 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.652 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.652 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_aio_pp 2024-09-21T17:47:23.652 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71207 2024-09-21T17:47:23.652 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_aio_pp on pid 71207' 2024-09-21T17:47:23.652 INFO:tasks.workunit.client.0.smithi042.stdout:test api_aio_pp on pid 71207 2024-09-21T17:47:23.656 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71207 2024-09-21T17:47:23.656 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.656 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.656 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-09-21T17:47:23.656 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_io 2024-09-21T17:47:23.656 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_io' 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_io 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.657 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.658 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.659 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.659 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.659 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.659 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.659 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.659 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.659 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.659 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.659 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.659 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.659 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.660 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_io 2024-09-21T17:47:23.661 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71216 2024-09-21T17:47:23.661 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_io on pid 71216' 2024-09-21T17:47:23.661 INFO:tasks.workunit.client.0.smithi042.stdout:test api_io on pid 71216 2024-09-21T17:47:23.664 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71216 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_io_pp 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_io_pp' 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_io_pp 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.665 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.666 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.667 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.667 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.667 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.667 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.667 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.667 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.667 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.667 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.667 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.668 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.668 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.668 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.668 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.668 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.668 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.668 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.669 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.669 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.669 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.669 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.669 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.669 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.669 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.670 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.670 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.670 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.670 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.671 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.671 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.671 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.671 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.671 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.671 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.672 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.672 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.672 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.672 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_io_pp 2024-09-21T17:47:23.672 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71227 2024-09-21T17:47:23.672 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_io_pp on pid 71227' 2024-09-21T17:47:23.672 INFO:tasks.workunit.client.0.smithi042.stdout:test api_io_pp on pid 71227 2024-09-21T17:47:23.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71227 2024-09-21T17:47:23.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-09-21T17:47:23.677 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_asio 2024-09-21T17:47:23.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_asio' 2024-09-21T17:47:23.677 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_asio 2024-09-21T17:47:23.677 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.678 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.679 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.680 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.681 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.682 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_asio 2024-09-21T17:47:23.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71243 2024-09-21T17:47:23.683 INFO:tasks.workunit.client.0.smithi042.stdout:test api_asio on pid 71243 2024-09-21T17:47:23.691 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_asio on pid 71243' 2024-09-21T17:47:23.691 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71243 2024-09-21T17:47:23.691 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.691 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.691 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-09-21T17:47:23.691 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_list 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_list' 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.692 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_list 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.693 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.694 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.695 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.696 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.697 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.698 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_list 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.699 INFO:tasks.workunit.client.0.smithi042.stdout:test api_list on pid 71258 2024-09-21T17:47:23.704 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71258 2024-09-21T17:47:23.704 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_list on pid 71258' 2024-09-21T17:47:23.704 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71258 2024-09-21T17:47:23.704 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.704 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.704 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-09-21T17:47:23.704 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71200/exe 2024-09-21T17:47:23.704 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_lock 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_lock' 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.705 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_lock 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.706 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.707 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.708 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.709 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.710 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71207/exe 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.711 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.712 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2024-09-21T17:47:23.713 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.713 INFO:tasks.workunit.client.0.smithi042.stdout:test api_lock on pid 71279 2024-09-21T17:47:23.715 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_lock 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_aio: /' 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71279 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_lock on pid 71279' 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71279 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_lock_pp 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_lock_pp' 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.716 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_aio.log 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.717 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.718 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_aio_pp: /' 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.719 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.720 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71216/exe 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.721 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.722 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.723 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_lock_pp 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.724 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.725 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.725 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2024-09-21T17:47:23.725 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_lock_pp 2024-09-21T17:47:23.725 INFO:tasks.workunit.client.0.smithi042.stdout:test api_lock_pp on pid 71304 2024-09-21T17:47:23.726 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71304 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_lock_pp on pid 71304' 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71304 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_io: /' 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_misc 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_misc' 2024-09-21T17:47:23.727 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.728 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_io.log 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.729 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.730 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.731 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_misc 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.732 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.733 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.733 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.733 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.733 INFO:tasks.workunit.client.0.smithi042.stdout:test api_misc on pid 71318 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_misc 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71318 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_misc on pid 71318' 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71318 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_misc_pp 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.737 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_misc_pp' 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.738 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.739 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.740 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.741 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.742 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.743 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71227/exe 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.744 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.745 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_misc_pp 2024-09-21T17:47:23.746 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.747 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.748 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71243/exe 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71258/exe 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.749 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.750 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.751 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.752 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.753 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_asio.log 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_list.log 2024-09-21T17:47:23.754 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_list: /' 2024-09-21T17:47:23.755 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.755 INFO:tasks.workunit.client.0.smithi042.stdout:test api_misc_pp on pid 71356 2024-09-21T17:47:23.757 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_misc_pp 2024-09-21T17:47:23.757 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71356 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_misc_pp on pid 71356' 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71356 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_asio: /' 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.758 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.759 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_io_pp: /' 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.760 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_tier_pp 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_tier_pp' 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71279/exe 2024-09-21T17:47:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_tier_pp 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.763 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_lock.log 2024-09-21T17:47:23.764 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.765 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.765 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.765 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.765 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.765 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.765 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.765 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.765 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.765 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71304/exe 2024-09-21T17:47:23.765 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_tier_pp 2024-09-21T17:47:23.765 INFO:tasks.workunit.client.0.smithi042.stdout:test api_tier_pp on pid 71374 2024-09-21T17:47:23.769 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71374 2024-09-21T17:47:23.769 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_tier_pp on pid 71374' 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71374 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_pool 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_pool' 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.770 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.771 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.772 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.773 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_lock: /' 2024-09-21T17:47:23.774 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.775 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.776 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71318/exe 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_lock_pp: /' 2024-09-21T17:47:23.777 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.778 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.779 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_misc.log 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_misc: /' 2024-09-21T17:47:23.780 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_pool 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.781 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.782 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.783 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.784 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.785 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.785 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.785 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.785 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.785 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.785 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.785 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.785 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.785 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.785 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_pool 2024-09-21T17:47:23.785 INFO:tasks.workunit.client.0.smithi042.stdout:test api_pool on pid 71444 2024-09-21T17:47:23.788 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71444 2024-09-21T17:47:23.788 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_pool on pid 71444' 2024-09-21T17:47:23.788 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71444 2024-09-21T17:47:23.788 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71374/exe 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_snapshots 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_snapshots' 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.789 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.790 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.791 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_snapshots 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_tier_pp: /' 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.792 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.793 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.794 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.794 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.794 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.794 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_snapshots 2024-09-21T17:47:23.794 INFO:tasks.workunit.client.0.smithi042.stdout:test api_snapshots on pid 71496 2024-09-21T17:47:23.797 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71496 2024-09-21T17:47:23.797 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_snapshots on pid 71496' 2024-09-21T17:47:23.797 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71496 2024-09-21T17:47:23.797 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.797 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.798 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-09-21T17:47:23.799 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.800 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_snapshots_pp 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.801 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_snapshots_pp' 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71356/exe 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.802 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_snapshots_pp 2024-09-21T17:47:23.803 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.804 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.805 INFO:tasks.workunit.client.0.smithi042.stdout:test api_snapshots_pp on pid 71535 2024-09-21T17:47:23.807 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_snapshots_pp 2024-09-21T17:47:23.807 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71535 2024-09-21T17:47:23.807 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_snapshots_pp on pid 71535' 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71535 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.808 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.809 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.810 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_stat 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_stat' 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.811 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_misc_pp: /' 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.812 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.813 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.814 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.815 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_stat 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.816 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.817 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.817 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.817 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.817 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.817 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71444/exe 2024-09-21T17:47:23.817 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.817 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.817 INFO:tasks.workunit.client.0.smithi042.stdout:test api_stat on pid 71584 2024-09-21T17:47:23.819 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_stat 2024-09-21T17:47:23.819 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71584 2024-09-21T17:47:23.819 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_stat on pid 71584' 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71584 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.820 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_stat_pp 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.821 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_stat_pp' 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.822 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.823 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_pool.log 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_pool: /' 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_stat_pp 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.824 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.825 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71496/exe 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.826 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.827 INFO:tasks.workunit.client.0.smithi042.stdout:test api_stat_pp on pid 71617 2024-09-21T17:47:23.830 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_stat_pp 2024-09-21T17:47:23.830 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71617 2024-09-21T17:47:23.830 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_stat_pp on pid 71617' 2024-09-21T17:47:23.830 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71617 2024-09-21T17:47:23.830 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.830 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.830 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.830 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-09-21T17:47:23.830 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.830 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_watch_notify 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_watch_notify' 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.831 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.832 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.833 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.834 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_snapshots: /' 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.835 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.836 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.837 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_watch_notify 2024-09-21T17:47:23.837 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-09-21T17:47:23.837 INFO:tasks.workunit.client.0.smithi042.stdout:test api_watch_notify on pid 71651 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_watch_notify 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71651 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_watch_notify on pid 71651' 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71651 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.840 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.841 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_watch_notify_pp 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_watch_notify_pp' 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_watch_notify_pp 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.842 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.843 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.844 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.845 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.846 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.847 INFO:tasks.workunit.client.0.smithi042.stdout:test api_watch_notify_pp on pid 71677 2024-09-21T17:47:23.850 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_watch_notify_pp 2024-09-21T17:47:23.850 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71677 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_watch_notify_pp on pid 71677' 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71677 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.851 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71535/exe 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71584/exe 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.852 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.853 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.854 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-09-21T17:47:23.855 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_stat: /' 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_stat.log 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_cmd 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_cmd' 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.857 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_cmd 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.858 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.859 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.860 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_cmd 2024-09-21T17:47:23.861 INFO:tasks.workunit.client.0.smithi042.stdout:test api_cmd on pid 71716 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71716 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_cmd on pid 71716' 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71716 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.864 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_cmd_pp 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.865 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_cmd_pp' 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71617/exe 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.866 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.867 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.868 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.869 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.870 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_stat_pp: /' 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.871 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_cmd_pp 2024-09-21T17:47:23.872 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.873 INFO:tasks.workunit.client.0.smithi042.stdout:test api_cmd_pp on pid 71780 2024-09-21T17:47:23.874 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_cmd_pp 2024-09-21T17:47:23.874 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71780 2024-09-21T17:47:23.874 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_cmd_pp on pid 71780' 2024-09-21T17:47:23.874 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71780 2024-09-21T17:47:23.874 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.874 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.874 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_service 2024-09-21T17:47:23.874 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_service' 2024-09-21T17:47:23.874 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-09-21T17:47:23.874 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.874 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.876 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.876 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.876 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_service 2024-09-21T17:47:23.876 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.876 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.876 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.876 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.876 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.876 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.876 INFO:tasks.workunit.client.0.smithi042.stdout:test api_service on pid 71794 2024-09-21T17:47:23.879 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_service 2024-09-21T17:47:23.879 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71794 2024-09-21T17:47:23.879 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_service on pid 71794' 2024-09-21T17:47:23.879 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71794 2024-09-21T17:47:23.879 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.879 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_service_pp 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_service_pp' 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.880 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.881 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.882 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_service_pp 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.883 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.884 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.885 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.886 INFO:tasks.workunit.client.0.smithi042.stdout:test api_service_pp on pid 71811 2024-09-21T17:47:23.887 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_service_pp 2024-09-21T17:47:23.887 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71811 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_service_pp on pid 71811' 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71811 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.888 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_c_write_operations 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_c_write_operations' 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.889 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_c_write_operations 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.890 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.891 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.892 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.893 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.894 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.895 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71651/exe 2024-09-21T17:47:23.896 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_c_write_operations 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71716/exe 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71846 2024-09-21T17:47:23.897 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_c_write_operations on pid 71846' 2024-09-21T17:47:23.898 INFO:tasks.workunit.client.0.smithi042.stdout:test api_c_write_operations on pid 71846 2024-09-21T17:47:23.901 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71846 2024-09-21T17:47:23.901 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.902 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.903 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s api_c_read_operations 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.904 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' api_c_read_operations' 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.905 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.906 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_cmd.log 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_cmd: /' 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.907 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.908 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.909 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71677/exe 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo api_c_read_operations 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.910 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_watch_notify: /' 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.911 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.912 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.912 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-09-21T17:47:23.912 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2024-09-21T17:47:23.912 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-09-21T17:47:23.912 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=api_c_read_operations 2024-09-21T17:47:23.912 INFO:tasks.workunit.client.0.smithi042.stdout:test api_c_read_operations on pid 71889 2024-09-21T17:47:23.913 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.913 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.913 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.913 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71889 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test api_c_read_operations on pid 71889' 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71889 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.914 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.915 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.916 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.917 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s list_parallel 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' list_parallel' 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.918 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.919 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.919 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo list_parallel 2024-09-21T17:47:23.919 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.919 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.919 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.919 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.919 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=list_parallel 2024-09-21T17:47:23.919 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.919 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71907 2024-09-21T17:47:23.919 INFO:tasks.workunit.client.0.smithi042.stdout:test list_parallel on pid 71907 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test list_parallel on pid 71907' 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71907 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.925 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.926 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.927 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.928 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s open_pools_parallel 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' open_pools_parallel' 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.929 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.930 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.931 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71780/exe 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.932 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.933 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo open_pools_parallel 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71794/exe 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.934 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.935 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.935 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=open_pools_parallel 2024-09-21T17:47:23.935 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.935 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.935 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.935 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.935 INFO:tasks.workunit.client.0.smithi042.stdout:test open_pools_parallel on pid 71934 2024-09-21T17:47:23.941 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71934 2024-09-21T17:47:23.941 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test open_pools_parallel on pid 71934' 2024-09-21T17:47:23.941 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.941 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71934 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.942 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.943 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.944 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-09-21T17:47:23.945 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_service.log 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.946 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.947 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.948 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s delete_pools_parallel 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' delete_pools_parallel' 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.949 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.950 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.951 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo delete_pools_parallel 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71811/exe 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.952 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_service: /' 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.953 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71846/exe 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.954 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.955 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.955 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.955 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.955 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.955 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.955 INFO:tasks.workunit.client.0.smithi042.stdout:test delete_pools_parallel on pid 71977 2024-09-21T17:47:23.960 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.960 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.960 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.960 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=delete_pools_parallel 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71977 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test delete_pools_parallel on pid 71977' 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.961 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=71977 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.962 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_service_pp: /' 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.963 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.964 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.965 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.966 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.967 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.968 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-09-21T17:47:23.969 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s cls 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' cls' 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71907/exe 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.970 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.971 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo cls 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71889/exe 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.972 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.973 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.974 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.975 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.975 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.975 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.975 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2024-09-21T17:47:23.975 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-09-21T17:47:23.975 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ list_parallel: /' 2024-09-21T17:47:23.975 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=cls 2024-09-21T17:47:23.975 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72022 2024-09-21T17:47:23.975 INFO:tasks.workunit.client.0.smithi042.stdout:test cls on pid 72022 2024-09-21T17:47:23.978 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test cls on pid 72022' 2024-09-21T17:47:23.978 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72022 2024-09-21T17:47:23.978 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:23.978 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_list_parallel.log 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s cmd 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' cmd' 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo cmd 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.979 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.980 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.981 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.982 INFO:tasks.workunit.client.0.smithi042.stdout:test cmd on pid 72048 2024-09-21T17:47:23.986 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=cmd 2024-09-21T17:47:23.986 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72048 2024-09-21T17:47:23.986 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test cmd on pid 72048' 2024-09-21T17:47:23.986 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72048 2024-09-21T17:47:23.986 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:23.986 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.987 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.988 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s handler_error 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' handler_error' 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.989 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.990 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.991 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:23.992 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo handler_error 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.993 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.994 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:23.995 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71934/exe 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:23.996 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:23.997 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:23.998 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:23.999 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:23.999 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=handler_error 2024-09-21T17:47:23.999 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72124 2024-09-21T17:47:23.999 INFO:tasks.workunit.client.0.smithi042.stdout:test handler_error on pid 72124 2024-09-21T17:47:24.004 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test handler_error on pid 72124' 2024-09-21T17:47:24.004 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72124 2024-09-21T17:47:24.004 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:24.004 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:24.004 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2024-09-21T17:47:24.004 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-09-21T17:47:24.004 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:24.004 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:24.004 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.004 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.005 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-09-21T17:47:24.006 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:24.007 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.008 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s io 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' io' 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/71977/exe 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.009 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo io 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.010 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2024-09-21T17:47:24.011 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.012 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.013 INFO:tasks.workunit.client.0.smithi042.stdout:test io on pid 72173 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=io 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72173 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test io on pid 72173' 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72173 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s ec_io 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' ec_io' 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.019 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:24.020 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.021 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.022 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.023 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.024 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.025 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.026 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.027 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72124/exe 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.028 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.029 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.030 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.031 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.032 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.032 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_handler_error 2024-09-21T17:47:24.032 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo ec_io 2024-09-21T17:47:24.032 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:24.032 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_handler_error.log 2024-09-21T17:47:24.032 INFO:tasks.workunit.client.0.smithi042.stdout:test ec_io on pid 72244 2024-09-21T17:47:24.036 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=ec_io 2024-09-21T17:47:24.036 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ handler_error: /' 2024-09-21T17:47:24.036 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72244 2024-09-21T17:47:24.036 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test ec_io on pid 72244' 2024-09-21T17:47:24.036 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72244 2024-09-21T17:47:24.036 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:24.036 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:24.036 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72022/exe 2024-09-21T17:47:24.036 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-09-21T17:47:24.036 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:24.036 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s list 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.037 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' list' 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo list 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72048/exe 2024-09-21T17:47:24.038 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:24.039 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_cls 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.040 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.041 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ cls: /' 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_cls.log 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_cmd 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_cmd.log 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.042 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.043 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.044 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.045 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.045 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.045 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.045 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.045 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.045 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.045 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ cmd: /' 2024-09-21T17:47:24.045 INFO:tasks.workunit.client.0.smithi042.stdout:test list on pid 72305 2024-09-21T17:47:24.046 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=list 2024-09-21T17:47:24.046 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72305 2024-09-21T17:47:24.046 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test list on pid 72305' 2024-09-21T17:47:24.046 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72305 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72173/exe 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s ec_list 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.047 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' ec_list' 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ io: /' 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo ec_list 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:24.048 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:24.049 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.050 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:24.050 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.050 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.050 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.050 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.050 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.050 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.050 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.051 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.051 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.051 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.051 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_io 2024-09-21T17:47:24.051 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_io.log 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.056 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.057 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.057 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.057 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.057 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.057 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.057 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.057 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.057 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.059 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.059 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.059 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.059 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.059 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.059 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.059 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.059 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.059 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.059 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.059 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.060 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.060 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.060 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.060 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.060 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.060 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.060 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=ec_list 2024-09-21T17:47:24.060 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72395 2024-09-21T17:47:24.060 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test ec_list on pid 72395' 2024-09-21T17:47:24.060 INFO:tasks.workunit.client.0.smithi042.stdout:test ec_list on pid 72395 2024-09-21T17:47:24.061 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72395 2024-09-21T17:47:24.061 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:24.061 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s misc 2024-09-21T17:47:24.062 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' misc' 2024-09-21T17:47:24.063 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.063 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.063 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.063 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.064 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.064 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.064 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.066 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.066 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.066 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.066 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.066 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.066 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.067 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.068 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.069 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.069 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.069 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.069 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72244/exe 2024-09-21T17:47:24.069 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.069 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.072 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.072 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.072 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.072 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.073 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ ec_io: /' 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_ec_io 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:24.074 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.075 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_ec_io.log 2024-09-21T17:47:24.076 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.076 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:24.076 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.076 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.076 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo misc 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.077 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.078 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.078 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.078 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.078 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.078 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.078 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72305/exe 2024-09-21T17:47:24.079 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.080 INFO:tasks.workunit.client.0.smithi042.stdout:test misc on pid 72462 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=misc 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.081 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72462 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test misc on pid 72462' 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.082 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72462 2024-09-21T17:47:24.083 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.083 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.083 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:24.083 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.083 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:24.083 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.083 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.083 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.083 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.083 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_list 2024-09-21T17:47:24.083 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ list: /' 2024-09-21T17:47:24.084 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s pool 2024-09-21T17:47:24.084 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' pool' 2024-09-21T17:47:24.084 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-09-21T17:47:24.084 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:24.084 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_list.log 2024-09-21T17:47:24.085 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:24.085 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:24.086 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:24.086 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:24.086 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.086 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:24.086 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo pool 2024-09-21T17:47:24.087 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:24.087 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:24.087 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:24.087 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.087 INFO:tasks.workunit.client.0.smithi042.stdout:test pool on pid 72486 2024-09-21T17:47:24.088 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=pool 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72486 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test pool on pid 72486' 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72486 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.089 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:24.090 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.090 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.090 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s read_operations 2024-09-21T17:47:24.090 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.090 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:24.090 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.090 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:24.090 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.091 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' read_operations' 2024-09-21T17:47:24.092 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo read_operations 2024-09-21T17:47:24.092 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:24.092 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:24.092 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:24.093 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.093 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:24.093 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:24.093 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:24.093 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:24.093 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.093 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:24.093 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.093 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:24.094 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.095 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.096 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.097 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.097 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.097 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.097 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.097 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.097 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.097 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.097 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.097 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.097 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.098 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.099 INFO:tasks.workunit.client.0.smithi042.stdout:test read_operations on pid 72528 2024-09-21T17:47:24.099 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=read_operations 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72528 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test read_operations on pid 72528' 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72528 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s snapshots 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' snapshots' 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:24.100 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.101 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.101 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:24.101 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.101 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.101 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.101 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.101 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:24.105 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:24.105 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:24.105 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.105 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:24.105 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.105 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.106 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.107 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo snapshots 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.108 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.109 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72395/exe 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.110 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.111 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=snapshots 2024-09-21T17:47:24.112 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.112 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72549 2024-09-21T17:47:24.112 INFO:tasks.workunit.client.0.smithi042.stdout:test snapshots on pid 72549 2024-09-21T17:47:24.116 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test snapshots on pid 72549' 2024-09-21T17:47:24.116 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72549 2024-09-21T17:47:24.116 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:24.116 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:24.116 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-09-21T17:47:24.116 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s watch_notify 2024-09-21T17:47:24.116 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.116 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.117 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.118 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' watch_notify' 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_ec_list 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.119 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_ec_list.log 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ ec_list: /' 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo watch_notify 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:24.120 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.121 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.122 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.123 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:24.123 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.123 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.123 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.123 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:24.123 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.123 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.123 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.123 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.123 INFO:tasks.workunit.client.0.smithi042.stdout:test watch_notify on pid 72577 2024-09-21T17:47:24.125 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=watch_notify 2024-09-21T17:47:24.125 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72577 2024-09-21T17:47:24.125 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test watch_notify on pid 72577' 2024-09-21T17:47:24.125 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72577 2024-09-21T17:47:24.125 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T17:47:24.125 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:24.125 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-09-21T17:47:24.125 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72462/exe 2024-09-21T17:47:24.125 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.125 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.126 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.127 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:++ printf %25s write_operations 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=' write_operations' 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:24.128 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:++ echo write_operations 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:24.129 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_misc 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:++ awk '{print $1}' 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.130 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_misc.log 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.131 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.132 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ misc: /' 2024-09-21T17:47:24.133 INFO:tasks.workunit.client.0.smithi042.stdout:test write_operations on pid 72608 2024-09-21T17:47:24.142 INFO:tasks.workunit.client.0.smithi042.stderr:+ ff=write_operations 2024-09-21T17:47:24.142 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72608 2024-09-21T17:47:24.142 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'test write_operations on pid 72608' 2024-09-21T17:47:24.142 INFO:tasks.workunit.client.0.smithi042.stderr:+ pids[$f]=72608 2024-09-21T17:47:24.142 INFO:tasks.workunit.client.0.smithi042.stderr:+ ret=0 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71374 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71374 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.143 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.144 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.144 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.144 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.144 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.145 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.145 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.145 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.145 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.145 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.146 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.147 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:+ . /etc/bashrc 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -z '' ']' 2024-09-21T17:47:24.148 INFO:tasks.workunit.client.0.smithi042.stderr:++ BASHRCSOURCED=Y 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72486/exe 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:++ shopt -q login_shell 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:+++ umask 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:++ SHELL=/bin/bash 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.149 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.150 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.151 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.152 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.153 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_pool.log 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_pool 2024-09-21T17:47:24.154 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ pool: /' 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:+++ return 2024-09-21T17:47:24.155 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export S_COLORS=auto 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:+++ S_COLORS=auto 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72528/exe 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.156 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.157 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.158 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.159 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72549/exe 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_read_operations.log 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_read_operations 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.160 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ read_operations: /' 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T17:47:24.161 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ snapshots: /' 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_snapshots 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.162 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.163 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72577/exe 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.164 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/locale 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.165 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T17:47:24.166 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.166 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.166 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.166 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.166 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.166 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.166 INFO:tasks.workunit.client.0.smithi042.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T17:47:24.166 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_watch_notify 2024-09-21T17:47:24.166 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ watch_notify: /' 2024-09-21T17:47:24.168 INFO:tasks.workunit.client.0.smithi042.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:++++ LANG=en_US.UTF-8 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:+++ LANG=en_US.UTF-8 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:+++ unset LANG_backup config 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n '' ']' 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' dumb = linux ']' 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.169 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/less.sh 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:++ '[' '' ']' 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_snapshots.log 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:+++++ readlink /proc/72608/exe 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:++++ basename /usr/bin/bash 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_declare='declare -f' 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:+++ which_opt=-f 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export which_declare 2024-09-21T17:47:24.170 INFO:tasks.workunit.client.0.smithi042.stderr:+++ export -f which 2024-09-21T17:47:24.171 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset i 2024-09-21T17:47:24.171 INFO:tasks.workunit.client.0.smithi042.stderr:++ unset -f pathmunge 2024-09-21T17:47:24.171 INFO:tasks.workunit.client.0.smithi042.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T17:47:24.171 INFO:tasks.workunit.client.0.smithi042.stderr:+ export PATH 2024-09-21T17:47:24.171 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T17:47:24.171 INFO:tasks.workunit.client.0.smithi042.stderr:+ unset rc 2024-09-21T17:47:24.171 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph_test_neorados_write_operations 2024-09-21T17:47:24.171 INFO:tasks.workunit.client.0.smithi042.stderr:+ tee ceph_test_neorados_write_operations.log 2024-09-21T17:47:24.171 INFO:tasks.workunit.client.0.smithi042.stderr:+ sed 's/^/ write_operations: /' 2024-09-21T17:47:24.171 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:47:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:47:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:47:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[38309]: pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:47:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/20799374' entity='client.admin' cmd={"prefix":"quorum_status"} : dispatch 2024-09-21T17:47:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi042-72437-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi042-72437-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi042-72554-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi042-72554-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[29361]: pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:47:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/20799374' entity='client.admin' cmd={"prefix":"quorum_status"} : dispatch 2024-09-21T17:47:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi042-72437-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi042-72437-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi042-72554-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi042-72554-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:24 smithi162 ceph-mon[32106]: pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:47:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/20799374' entity='client.admin' cmd={"prefix":"quorum_status"} : dispatch 2024-09-21T17:47:24.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi042-72437-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi042-72437-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi042-72554-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:24.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi042-72554-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:25.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:25.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi042-72437-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:25.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi042-72554-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:25.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: osdmap e65: 8 total, 8 up, 8 in 2024-09-21T17:47:25.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi042-72554-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:25.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi042-71883-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:25.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi042-72437-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:25.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1107597663' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi042-71285-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2406661723' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/491415344' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi042-71299-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/552998019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71940-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/598277756' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi042-71854-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2873857875' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi042-71622-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3658291344' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_smithi042-71275-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3930250170' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi042-71379-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1913807103' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi042-71745-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3620897458' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi042-71455-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/915460378' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi042-71687-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi042-72554-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi042-72437-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1377163981' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi042-71368-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3354399223' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi042-71285-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi042-71351-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71940-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi042-71622-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2487640908' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi042-71684-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3899958736' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi042-72013-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi042-71299-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1690676688' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71856-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1390202451' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi042-71338-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi042-71368-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi042-71854-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi042-71351-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_smithi042-71275-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi042-71379-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi042-71684-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi042-72013-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi042-71745-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71856-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi042-71455-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi042-71687-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.829 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi042-71338-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.841 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-09-21T17:47:25.841 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [----------] Global test environment set-up. 2024-09-21T17:47:25.841 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [----------] 12 tests from AsioRados 2024-09-21T17:47:25.841 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-09-21T17:47:25.841 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2024-09-21T17:47:25.841 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-09-21T17:47:25.841 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (0 ms) 2024-09-21T17:47:25.841 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-09-21T17:47:25.841 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (1 ms) 2024-09-21T17:47:25.841 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (11 ms) 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (7 ms) 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (3 ms) 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (1 ms) 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (0 ms) 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (1 ms) 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (3 ms) 2024-09-21T17:47:25.842 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-21T17:47:25.843 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (3 ms) 2024-09-21T17:47:25.843 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-21T17:47:25.843 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (3 ms) 2024-09-21T17:47:25.843 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [----------] 12 tests from AsioRados (34 ms total) 2024-09-21T17:47:25.843 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: 2024-09-21T17:47:25.843 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [----------] Global test environment tear-down 2024-09-21T17:47:25.843 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (2090 ms total) 2024-09-21T17:47:25.843 INFO:tasks.workunit.client.0.smithi042.stdout: api_asio: [ PASSED ] 12 tests. 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi042-72437-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi042-72554-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: osdmap e65: 8 total, 8 up, 8 in 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi042-72554-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi042-71883-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi042-72437-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1107597663' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi042-71285-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2406661723' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/491415344' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi042-71299-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/552998019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71940-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/598277756' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi042-71854-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2873857875' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi042-71622-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3658291344' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_smithi042-71275-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3930250170' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi042-71379-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1913807103' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi042-71745-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:25.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi042-72437-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:25.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi042-72554-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: osdmap e65: 8 total, 8 up, 8 in 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi042-72554-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi042-71883-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi042-72437-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1107597663' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi042-71285-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2406661723' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/491415344' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi042-71299-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/552998019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71940-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/598277756' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi042-71854-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2873857875' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi042-71622-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3658291344' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_smithi042-71275-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3930250170' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi042-71379-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1913807103' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi042-71745-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3620897458' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi042-71455-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/915460378' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi042-71687-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi042-72554-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi042-72437-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1377163981' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi042-71368-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3354399223' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi042-71285-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi042-71351-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71940-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi042-71622-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2487640908' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi042-71684-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3899958736' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi042-72013-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi042-71299-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1690676688' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71856-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3620897458' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi042-71455-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/915460378' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi042-71687-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi042-72554-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:25.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi042-72437-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:25.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1377163981' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi042-71368-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3354399223' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi042-71285-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi042-71351-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71940-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi042-71622-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2487640908' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi042-71684-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3899958736' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi042-72013-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi042-71299-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1690676688' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71856-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1390202451' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi042-71338-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi042-71368-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi042-71854-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi042-71351-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_smithi042-71275-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi042-71379-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi042-71684-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi042-72013-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi042-71745-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71856-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi042-71455-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi042-71687-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi042-71338-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1390202451' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi042-71338-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi042-71368-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi042-71854-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi042-71351-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_smithi042-71275-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.922 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.922 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi042-71379-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.922 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi042-71684-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.922 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi042-72013-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.922 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi042-71745-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.922 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71856-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.922 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi042-71455-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.922 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi042-71687-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:25.922 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi042-71338-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:26.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [----------] Global test environment set-up. 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [----------] 7 tests from LibRadosList 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ OK ] LibRadosList.ListObjects (402 ms) 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (36 ms) 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: myset foo1,foo2,foo3 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo1 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo2 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo3 2024-09-21T17:47:26.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: myset foo1,foo4,foo5 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo4 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo5 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo1 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: myset foo6,foo7 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo7 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo6 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: ns1:foo4 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: ns1:foo5 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: ns2:foo7 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: ns2:foo6 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: ns1:foo1 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: :foo1 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: :foo2 2024-09-21T17:47:26.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: :foo3 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (94 ms) 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 1 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 10 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 13 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 7 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 14 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 0 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 15 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 11 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 5 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 8 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 6 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 3 0 2024-09-21T17:47:26.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 4 0 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 12 0 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 9 0 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 2 0 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (79 ms) 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: x cursor=MIN 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=1 cursor=13:02547ec2:::1:head 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=10 cursor=13:52ea6a34:::10:head 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=13 cursor=13:566253c9:::13:head 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=7 cursor=13:5c6b0b28:::7:head 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=14 cursor=13:62a1935d:::14:head 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=0 cursor=13:6cac518f:::0:head 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=15 cursor=13:863748b0:::15:head 2024-09-21T17:47:26.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=11 cursor=13:89d3ae78:::11:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=5 cursor=13:b29083e3:::5:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=8 cursor=13:bd63b0f1:::8:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=6 cursor=13:c4fdafeb:::6:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=3 cursor=13:cfc208b3:::3:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=4 cursor=13:d83876eb:::4:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=12 cursor=13:de5d7c5f:::12:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=9 cursor=13:e960b815:::9:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > oid=2 cursor=13:f905c69b:::2:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: FIRST> seek to MIN oid=1 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=1 cursor=13:02547ec2:::1:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:02547ec2:::1:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:02547ec2:::1:head -> 1 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=10 cursor=13:52ea6a34:::10:head 2024-09-21T17:47:26.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:52ea6a34:::10:head 2024-09-21T17:47:26.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:52ea6a34:::10:head -> 10 2024-09-21T17:47:26.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=13 cursor=13:566253c9:::13:head 2024-09-21T17:47:26.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:566253c9:::13:head 2024-09-21T17:47:26.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:566253c9:::13:head -> 13 2024-09-21T17:47:26.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=7 cursor=13:5c6b0b28:::7:head 2024-09-21T17:47:26.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:5c6b0b28:::7:head 2024-09-21T17:47:26.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:5c6b0b28:::7:head -> 7 2024-09-21T17:47:26.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=14 cursor=13:62a1935d:::14:head 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:62a1935d:::14:head 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:62a1935d:::14:head -> 14 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=0 cursor=13:6cac518f:::0:head 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:6cac518f:::0:head 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:6cac518f:::0:head -> 0 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=15 cursor=13:863748b0:::15:head 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:863748b0:::15:head 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:863748b0:::15:head -> 15 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=11 cursor=13:89d3ae78:::11:head 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:89d3ae78:::11:head 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:89d3ae78:::11:head -> 11 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=5 cursor=13:b29083e3:::5:head 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:b29083e3:::5:head 2024-09-21T17:47:26.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:b29083e3:::5:head -> 5 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=8 cursor=13:bd63b0f1:::8:head 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:bd63b0f1:::8:head 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:bd63b0f1:::8:head -> 8 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=6 cursor=13:c4fdafeb:::6:head 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:c4fdafeb:::6:head 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:c4fdafeb:::6:head -> 6 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=3 cursor=13:cfc208b3:::3:head 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:cfc208b3:::3:head 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:cfc208b3:::3:head -> 3 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=4 cursor=13:d83876eb:::4:head 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:d83876eb:::4:head 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:d83876eb:::4:head -> 4 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=12 cursor=13:de5d7c5f:::12:head 2024-09-21T17:47:26.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:de5d7c5f:::12:head 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:de5d7c5f:::12:head -> 12 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=9 cursor=13:e960b815:::9:head 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:e960b815:::9:head 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:e960b815:::9:head -> 9 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : oid=2 cursor=13:f905c69b:::2:head 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:f905c69b:::2:head 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:f905c69b:::2:head -> 2 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:566253c9:::13:head 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:566253c9:::13:head expected=13:566253c9:::13:head 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:566253c9:::13:head -> 13 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=13 expected=13 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:52ea6a34:::10:head 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:52ea6a34:::10:head expected=13:52ea6a34:::10:head 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:52ea6a34:::10:head -> 10 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=10 expected=10 2024-09-21T17:47:26.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:62a1935d:::14:head 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:62a1935d:::14:head expected=13:62a1935d:::14:head 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:62a1935d:::14:head -> 14 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=14 expected=14 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:5c6b0b28:::7:head 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:5c6b0b28:::7:head expected=13:5c6b0b28:::7:head 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:5c6b0b28:::7:head -> 7 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=7 expected=7 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:e960b815:::9:head 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:e960b815:::9:head expected=13:e960b815:::9:head 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:e960b815:::9:head -> 9 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=9 expected=9 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:de5d7c5f:::12:head 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:de5d7c5f:::12:head expected=13:de5d7c5f:::12:head 2024-09-21T17:47:26.220 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:de5d7c5f:::12:head -> 12 2024-09-21T17:47:26.221 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=12 expected=12 2024-09-21T17:47:26.221 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:b29083e3:::5:head 2024-09-21T17:47:26.221 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:b29083e3:::5:head expected=13:b29083e3:::5:head 2024-09-21T17:47:26.221 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:b29083e3:::5:head -> 5 2024-09-21T17:47:26.221 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=5 expected=5 2024-09-21T17:47:26.221 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:f905c69b:::2:head 2024-09-21T17:47:26.221 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:f905c69b:::2:head expected=13:f905c69b:::2:head 2024-09-21T17:47:26.221 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:f905c69b:::2:head -> 2 2024-09-21T17:47:26.400 INFO:tasks.workunit.client.0.smithi042.stdout: api_li list_parallel: process_1_[72080]: starting. 2024-09-21T17:47:26.400 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_1_[72080]: creating pool ceph_test_rados_list_parallel.smithi042-72012 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_1_[72080]: created object 0... 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_1_[72080]: created object 25... 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_1_[72080]: created object 49... 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_1_[72080]: finishing. 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_1_[72080]: shutting down. 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_2_[72081]: starting. 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_2_[72081]: listing objects. 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_2_[72081]: listed object 0... 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_2_[72081]: listed object 25... 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_2_[72081]: saw 50 objects 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_2_[72081]: shutting down. 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_3_[72872]: starting. 2024-09-21T17:47:26.401 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_3_[72872]: creating pool ceph_test_rados_list_parallel.smithi042-72012 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_3_[72872]: created object 0... 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_3_[72872]: created object 25... 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_3_[72872]: created object 49... 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_3_[72872]: finishing. 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_3_[72872]: shutting down. 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_4_[72873]: starting. 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_4_[72873]: listing objects. 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_4_[72873]: listed object 0... 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_4_[72873]: listed object 25... 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_4_[72873]: saw 43 objects 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_4_[72873]: shutting down. 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.402 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_5_[72874]: starting. 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_5_[72874]: removed 25 objects... 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_5_[72874]: removed half of the objects 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_5_[72874]: removed 50 objects... 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_5_[72874]: removed 50 objects 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_5_[72874]: shutting down. 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_6_[72920]: starting. 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_6_[72920]: creating pool ceph_test_rados_list_parallel.smithi042-72012 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_6_[72920]: created object 0... 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_6_[72920]: created object 25... 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_6_[72920]: created object 49... 2024-09-21T17:47:26.403 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_6_[72920]: finishing. 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_6_[72920]: shutting down. 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_7_[72921]: starting. 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_7_[72921]: listing objects. 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_7_[72921]: listed object 0... 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_7_[72921]: listed object 25... 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_7_[72921]: listed object 50... 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_7_[72921]: saw 56 objects 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_7_[72921]: shutting down. 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_8_[72922]: starting. 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_8_[72922]: added 25 objects... 2024-09-21T17:47:26.404 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_8_[72922]: added half of the objects 2024-09-21T17:47:26.405 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_8_[72922]: added 50 objects... 2024-09-21T17:47:26.405 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_8_[72922]: added 50 objects 2024-09-21T17:47:26.405 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_8_[72922]: shutting down. 2024-09-21T17:47:26.405 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.405 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.459 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ********************** handler_error: Running main() from gmock_main.cc 2024-09-21T17:47:26.459 INFO:tasks.workunit.client.0.smithi042.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-09-21T17:47:26.459 INFO:tasks.workunit.client.0.smithi042.stdout: handler_error: [----------] Global test environment set-up. 2024-09-21T17:47:26.459 INFO:tasks.workunit.client.0.smithi042.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-09-21T17:47:26.459 INFO:tasks.workunit.client.0.smithi042.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-09-21T17:47:26.459 INFO:tasks.workunit.client.0.smithi042.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (2431 ms) 2024-09-21T17:47:26.459 INFO:tasks.workunit.client.0.smithi042.stdout: handler_error: [----------] 1 test from neocls_handler_error (2431 ms total) 2024-09-21T17:47:26.459 INFO:tasks.workunit.client.0.smithi042.stdout: handler_error: 2024-09-21T17:47:26.459 INFO:tasks.workunit.client.0.smithi042.stdout: handler_error: [----------] Global test environment tear-down 2024-09-21T17:47:26.459 INFO:tasks.workunit.client.0.smithi042.stdout: handler_error: [==========] 1 test from 1 test suite ran. (2431 ms total) 2024-09-21T17:47:26.459 INFO:tasks.workunit.client.0.smithi042.stdout: handler_error: [ PASSED ] 1 test. 2024-09-21T17:47:26.461 INFO:tasks.workunit.client.0.smithi042.stdout: cls: Running main() from gmock_main.cc 2024-09-21T17:47:26.461 INFO:tasks.workunit.client.0.smithi042.stdout: cls: [==========] Running 1 test from 1 test suite. 2024-09-21T17:47:26.461 INFO:tasks.workunit.client.0.smithi042.stdout: cls: [----------] Global test environment set-up. 2024-09-21T17:47:26.461 INFO:tasks.workunit.client.0.smithi042.stdout: cls: [----------] 1 test from NeoRadosCls 2024-09-21T17:47:26.461 INFO:tasks.workunit.client.0.smithi042.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-09-21T17:47:26.461 INFO:tasks.workunit.client.0.smithi042.stdout: cls: [ OK ] NeoRadosCls.DNE (2424 ms) 2024-09-21T17:47:26.461 INFO:tasks.workunit.client.0.smithi042.stdout: cls: [----------] 1 test from NeoRadosCls (2424 ms total) 2024-09-21T17:47:26.462 INFO:tasks.workunit.client.0.smithi042.stdout: cls: 2024-09-21T17:47:26.462 INFO:tasks.workunit.client.0.smithi042.stdout: cls: [----------] Global test environment tear-down 2024-09-21T17:47:26.462 INFO:tasks.workunit.client.0.smithi042.stdout: cls: [==========] 1 test from 1 test suite ran. (2424 ms total) 2024-09-21T17:47:26.462 INFO:tasks.workunit.client.0.smithi042.stdout: cls: [ PASSED ] 1 test. 2024-09-21T17:47:26.466 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-09-21T17:47:26.466 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-09-21T17:47:26.466 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-09-21T17:47:26.466 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-09-21T17:47:26.466 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-09-21T17:47:26.466 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (58 ms) 2024-09-21T17:47:26.466 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-09-21T17:47:26.467 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (70 ms) 2024-09-21T17:47:26.467 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-09-21T17:47:26.467 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (2405 ms) 2024-09-21T17:47:26.467 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (2533 ms total) 2024-09-21T17:47:26.467 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: 2024-09-21T17:47:26.467 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-09-21T17:47:26.467 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (2533 ms total) 2024-09-21T17:47:26.467 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-09-21T17:47:26.482 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: Running main() from gmock_main.cc 2024-09-21T17:47:26.482 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (373 ms) 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (10 ms) 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (10 ms) 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (28 ms) 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (9 ms) 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-09-21T17:47:26.483 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (8 ms) 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (6 ms) 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (5 ms) 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (5 ms) 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (10 ms) 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (7 ms) 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (5 ms) 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (16 ms) 2024-09-21T17:47:26.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-09-21T17:47:26.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (9 ms) 2024-09-21T17:47:26.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-09-21T17:47:26.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (9 ms) 2024-09-21T17:47:26.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-09-21T17:47:26.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (4 ms) 2024-09-21T17:47:26.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (514 ms total) 2024-09-21T17:47:26.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: 2024-09-21T17:47:26.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-09-21T17:47:26.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (2543 ms total) 2024-09-21T17:47:26.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-09-21T17:47:26.611 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: Running main() from gmock_main.cc 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [----------] Global test environment set-up. 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (67 ms) 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (56 ms) 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (2455 ms) 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.414123+0000 mon.a [WRN] Health check failed: 34 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.425577+0000 mon.a [INF] from='client.? 172.21.15.42:0/3354399223' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.425684+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi042-71285-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.425805+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71940-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.425876+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.425945+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi042-71622-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426036+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi042-71299-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426103+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi042-71368-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426208+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi042-71854-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426266+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi042-71351-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426349+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi042-71275-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426407+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426482+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi042-71379-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: pgmap v50: 1220 pgs: 1088 unknown, 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:47:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: Health check failed: 34 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3354399223' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi042-71285-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71940-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi042-71622-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi042-71299-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi042-71368-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi042-71854-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi042-71351-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi042-71275-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi042-71379-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi042-71684-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi042-72013-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi042-71745-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71856-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.728 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi042-71455-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi042-71687-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi042-71338-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: osdmap e66: 8 total, 8 up, 8 in 2024-09-21T17:47:26.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:26.887 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.4********* 2024-09-21T17:47:26.887 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_9_[72968]: starting. 2024-09-21T17:47:26.887 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_9_[72968]: creating pool ceph_test_rados_list_parallel.smithi042-72012 2024-09-21T17:47:26.887 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_9_[72968]: created object 0... 2024-09-21T17:47:26.887 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_9_[72968]: created object 25... 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_9_[72968]: created object 49... 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_9_[72968]: finishing. 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_9_[72968]: shutting down. 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_10_[72969]: starting. 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_10_[72969]: listing objects. 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_10_[72969]: listed object 0... 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_10_[72969]: listed object 25... 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_10_[72969]: listed object 50... 2024-09-21T17:47:26.888 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_10_[72969]: listed object 75... 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_10_[72969]: saw 97 objects 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_10_[72969]: shutting down. 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_13_[72972]: starting. 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_13_[72972]: removed 25 objects... 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_13_[72972]: removed half of the objects 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_13_[72972]: removed 50 objects... 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_13_[72972]: removed 50 objects 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_13_[72972]: shutting down. 2024-09-21T17:47:26.889 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_11_[72970]: starting. 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_11_[72970]: added 25 objects... 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_11_[72970]: added half of the objects 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_11_[72970]: added 50 objects... 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_11_[72970]: added 50 objects 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_11_[72970]: shutting down. 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_12_[72971]: starting. 2024-09-21T17:47:26.890 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_12_[72971]: added 25 objects... 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_12_[72971]: added half of the objects 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_12_[72971]: added 50 objects... 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_12_[72971]: added 50 objects 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_12_[72971]: shutting down. 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_14_[73350]: starting. 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_14_[73350]: creating pool ceph_test_rados_list_parallel.smithi042-72012 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_14_[73350]: created object 0... 2024-09-21T17:47:26.891 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_14_[73350]: created object 25... 2024-09-21T17:47:26.892 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_14_[73350]: created object 49... 2024-09-21T17:47:26.892 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_14_[73350]: finishing. 2024-09-21T17:47:26.892 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_14_[73350]: shutting down. 2024-09-21T17:47:26.892 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.892 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.892 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.892 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:26.892 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_15_[73351]: starting. 2024-09-21T17:47:26.892 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_15_[73351]: listing objects. 2024-09-21T17:47:26.892 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_15_[73351]: listed object 0... 2024-09-21T17:47:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: pgmap v50: 1220 pgs: 1088 unknown, 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:47:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: Health check failed: 34 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3354399223' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi042-71285-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71940-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi042-71622-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi042-71299-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi042-71368-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi042-71854-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi042-71351-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi042-71275-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi042-71379-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi042-71684-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi042-72013-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi042-71745-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71856-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: pgmap v50: 1220 pgs: 1088 unknown, 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:47:26.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: Health check failed: 34 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:26.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3354399223' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi042-71285-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71940-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi042-71622-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi042-71299-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi042-71368-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi042-71854-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi042-71351-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi042-71275-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi042-71379-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi042-71684-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi042-72013-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi042-71745-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71856-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi042-71455-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi042-71687-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi042-71338-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: osdmap e66: 8 total, 8 up, 8 in 2024-09-21T17:47:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:26.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi042-71455-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi042-71687-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi042-71338-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:26.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: osdmap e66: 8 total, 8 up, 8 in 2024-09-21T17:47:26.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:27.452 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_15_[73351]: listed object 226539+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi042-71684-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:27.452 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426614+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi042-72013-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:27.452 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426670+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi042-71745-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:27.452 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426740+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71856-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:27.452 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426811+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi042-71455-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426890+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi042-71687-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:25.426966+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi042-71338-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.437371+0000 mon.a [INF] from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi042-71883-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.437451+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi042-72554-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.437548+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi042-72437-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.449855+0000 mon.c [INF] from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.451278+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.561213+0000 mon.b [INF] from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.563649+0000 mon.b [INF] from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.574615+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.574967+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.577910+0000 mon.b [INF] from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.453 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.578341+0000 mon.b [INF] from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.599482+0000 mon.b [INF] from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.602081+0000 client.admin [INF] onexx 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.607626+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.608499+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.608753+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.616333+0000 mon.b [INF] from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi042-71687-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.617071+0000 mon.b [INF] from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.644769+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi042-71687-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.652060+0000 mon.a [INF] from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.652536+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.662099+0000 mon.a [INF] from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.662580+0000 mon.a [INF] from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:27.454 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.666909+0000 mon.a [INF] from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi042-71299-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.455 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.669418+0000 mon.a [INF] from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:27.462 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:26.670045+0000 mon.a [INF] from='client.? 172.21.15.42:0/3487255... 2024-09-21T17:47:27.462 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_15_[73351]: listed object 50... 2024-09-21T17:47:27.462 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_15_[73351]: listed object 75... 2024-09-21T17:47:27.462 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_15_[73351]: listed object 100... 2024-09-21T17:47:27.462 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_15_[73351]: listed object 125... 2024-09-21T17:47:27.462 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_15_[73351]: saw 150 objects 2024-09-21T17:47:27.462 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_15_[73351]: shutting down. 2024-09-21T17:47:27.462 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:27.462 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_16_[73352]: starting. 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_16_[73352]: added 25 objects... 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_16_[73352]: added half of the objects 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_16_[73352]: added 50 objects... 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_16_[73352]: added 50 objects 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: process_16_[73352]: shutting down. 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******************************* 2024-09-21T17:47:27.463 INFO:tasks.workunit.client.0.smithi042.stdout: list_parallel: ******* SUCCESS ********** 2024-09-21T17:47:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi042-71883-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi042-72554-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi042-72437-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: osdmap e67: 8 total, 8 up, 8 in 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: onexx 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi042-71687-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi042-71687-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi042-71299-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi042-71883-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi042-72554-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi042-72437-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: osdmap e67: 8 total, 8 up, 8 in 2024-09-21T17:47:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T17:47:27.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: onexx 2024-09-21T17:47:27.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T17:47:27.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi042-71687-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi042-71883-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:27.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi042-72554-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:27.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi042-72437-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:27.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: osdmap e67: 8 total, 8 up, 8 in 2024-09-21T17:47:27.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:27.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:27.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T17:47:27.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: onexx 2024-09-21T17:47:27.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:27.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:27.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T17:47:27.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi042-71687-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi042-71687-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi042-71299-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi042-71687-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:27.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi042-71299-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:27.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:27.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:28.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:47:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: pgmap v53: 636 pgs: 504 unknown, 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi042-71687-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi042-71299-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: osdmap e68: 8 total, 8 up, 8 in 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi042-71687-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: twoxx 2024-09-21T17:47:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1000138068' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/8473578' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/604865779' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi042-71275-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4149895549' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi042-71299-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi042-71745-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi042-71687-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi042-71275-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.0"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.1"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.2"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.3"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.4"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.5"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.6"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.7"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.8"} : dispatch 2024-09-21T17:47:28.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.9"} : dispatch 2024-09-21T17:47:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: pgmap v53: 636 pgs: 504 unknown, 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi042-71687-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi042-71299-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: osdmap e68: 8 total, 8 up, 8 in 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi042-71687-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: twoxx 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1000138068' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/8473578' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:28.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/604865779' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi042-71275-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4149895549' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi042-71299-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:28.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: pgmap v53: 636 pgs: 504 unknown, 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:47:28.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:28.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi042-71687-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi042-71299-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:28.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-21T17:47:28.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: osdmap e68: 8 total, 8 up, 8 in 2024-09-21T17:47:28.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi042-71687-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:28.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:28.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T17:47:28.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: twoxx 2024-09-21T17:47:28.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1000138068' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/8473578' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:28.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/604865779' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi042-71275-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4149895549' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi042-71299-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:28.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi042-71745-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi042-71687-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi042-71275-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.0"} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.1"} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.2"} : dispatch 2024-09-21T17:47:28.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.3"} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.4"} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.5"} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.6"} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.7"} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.8"} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.9"} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi042-71745-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi042-71687-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi042-71275-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.0"} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.1"} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.2"} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.3"} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.4"} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.5"} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.6"} : dispatch 2024-09-21T17:47:28.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.7"} : dispatch 2024-09-21T17:47:28.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.8"} : dispatch 2024-09-21T17:47:28.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.9"} : dispatch 2024-09-21T17:47:29.487 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_1_[72208]: starting. 2024-09-21T17:47:29.487 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_1_[72208]: creating pool ceph_test_rados_open_pools_parallel.smithi042-72118 2024-09-21T17:47:29.487 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_1_[72208]: created object 0... 2024-09-21T17:47:29.487 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_1_[72208]: created object 25... 2024-09-21T17:47:29.487 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_1_[72208]: created object 49... 2024-09-21T17:47:29.487 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_1_[72208]: finishing. 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_1_[72208]: shutting down. 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_2_[72209]: starting. 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_2_[72209]: rados_pool_create. 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_2_[72209]: rados_ioctx_create. 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_2_[72209]: shutting down. 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: ******************************* 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_3_[73051]: starting. 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_3_[73051]: creating pool ceph_test_rados_open_pools_parallel.smithi042-72118 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_3_[73051]: created object 0... 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_3_[73051]: created object 25... 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_3_[73051]: created object 49... 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_3_[73051]: finishing. 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_3_[73051]: shutting down. 2024-09-21T17:47:29.488 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: ******************************* 2024-09-21T17:47:29.489 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_4_[73052]: starting. 2024-09-21T17:47:29.489 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_4_[73052]: rados_pool_create. 2024-09-21T17:47:29.489 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_4_[73052]: rados_ioctx_create. 2024-09-21T17:47:29.489 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: process_4_[73052]: shutting down. 2024-09-21T17:47:29.489 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: ******************************* 2024-09-21T17:47:29.489 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: ******************************* 2024-09-21T17:47:29.489 INFO:tasks.workunit.client.0.smithi042.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-09-21T17:47:29.489 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_1_[72281]: starting. 2024-09-21T17:47:29.489 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_1_[72281]: creating pool ceph_test_rados_delete_pools_parallel.smithi042-72163 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_1_[72281]: created object 0... 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_1_[72281]: created object 25... 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_1_[72281]: created object 49... 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_1_[72281]: finishing. 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_1_[72281]: shutting down. 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_2_[72282]: starting. 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_2_[72282]: deleting pool ceph_test_rados_delete_pools_parallel.smithi042-72163 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_2_[72282]: shutting down. 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: ******************************* 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_3_[73048]: starting. 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_3_[73048]: creating pool ceph_test_rados_delete_pools_parallel.smithi042-72163 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_3_[73048]: created object 0... 2024-09-21T17:47:29.490 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_3_[73048]: created object 25... 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_3_[73048]: created object 49... 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_3_[73048]: finishing. 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_3_[73048]: shutting down. 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: ******************************* 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_5_[73050]: starting. 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_5_[73050]: listing objects. 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_5_[73050]: listed object 0... 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_5_[73050]: listed object 25... 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_5_[73050]: saw 50 objects 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_5_[73050]: shutting down. 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: ******************************* 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_4_[73049]: starting. 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_4_[73049]: deleting pool ceph_test_rados_delete_pools_parallel.smithi042-72163 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: process_4_[73049]: shutting down. 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: ******************************* 2024-09-21T17:47:29.491 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: ******************************* 2024-09-21T17:47:29.492 INFO:tasks.workunit.client.0.smithi042.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-09-21T17:47:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-09-21T17:47:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-09-21T17:47:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-09-21T17:47:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: 18.1 deep-scrub starts 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: 18.1 deep-scrub ok 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:29.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:29.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi042-71275-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:29.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:29.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:29.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: osdmap e69: 8 total, 8 up, 8 in 2024-09-21T17:47:29.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:29.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-21T17:47:29.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:29.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:29.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:29.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-09-21T17:47:29.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: 18.1 deep-scrub starts 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: 18.1 deep-scrub ok 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:29.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:29.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:29.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi042-71275-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:29.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:29.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:29.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: osdmap e69: 8 total, 8 up, 8 in 2024-09-21T17:47:29.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:29.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-21T17:47:29.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:29.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:29.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:29.920 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:29.920 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: 18.7 deep-scrub starts 2024-09-21T17:47:29.920 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.920 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.920 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.920 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.920 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.920 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: 18.2 deep-scrub starts 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: 18.2 deep-scrub ok 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: 18.0 deep-scrub starts 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: 18.0 deep-scrub ok 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/250489783' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T17:47:29.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: pgmap v56: 868 pgs: 352 creating+peering, 128 unknown, 388 active+clean; 97 MiB data, 278 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 545 op/s 2024-09-21T17:47:29.922 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:29.922 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:29.922 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: 18.7 deep-scrub starts 2024-09-21T17:47:29.922 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.922 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.922 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.922 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.922 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.922 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: 18.2 deep-scrub starts 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: 18.2 deep-scrub ok 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: 18.0 deep-scrub starts 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: 18.0 deep-scrub ok 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/250489783' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T17:47:29.923 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: pgmap v56: 868 pgs: 352 creating+peering, 128 unknown, 388 active+clean; 97 MiB data, 278 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 545 op/s 2024-09-21T17:47:29.924 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:29.924 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi042-71299-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi042-71299-16"}]': finished 2024-09-21T17:47:29.924 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi042-71745-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi042-71745-7"}]': finished 2024-09-21T17:47:29.924 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi042-71687-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi042-71687-7"}]': finished 2024-09-21T17:47:29.924 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:29.924 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:29.924 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:29.924 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:29.924 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:29.924 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:29.925 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:29.925 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: osdmap e70: 8 total, 8 up, 8 in 2024-09-21T17:47:29.925 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:29.925 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi042-71368-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.925 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/8473578' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:29.925 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi042-71379-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.925 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:29.925 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:29.925 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi042-71299-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi042-71299-16"}]': finished 2024-09-21T17:47:29.925 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi042-71745-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi042-71745-7"}]': finished 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi042-71687-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi042-71687-7"}]': finished 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: osdmap e70: 8 total, 8 up, 8 in 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi042-71368-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/8473578' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:29.926 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi042-71379-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.927 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:29.927 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:29.927 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi042-71368-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.927 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:29.927 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:29.927 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi042-71379-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.927 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:29.927 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi042-71368-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:29.928 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:29.928 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:29.928 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi042-71379-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:29.928 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: 18.1 deep-scrub starts 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: 18.1 deep-scrub ok 2024-09-21T17:47:30.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi042-71275-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: osdmap e69: 8 total, 8 up, 8 in 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:30.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: 18.7 deep-scrub starts 2024-09-21T17:47:30.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: 18.2 deep-scrub starts 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: 18.2 deep-scrub ok 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: 18.0 deep-scrub starts 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: 18.0 deep-scrub ok 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/250489783' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: pgmap v56: 868 pgs: 352 creating+peering, 128 unknown, 388 active+clean; 97 MiB data, 278 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 545 op/s 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi042-71299-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi042-71299-16"}]': finished 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi042-71745-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi042-71745-7"}]': finished 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi042-71687-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi042-71687-7"}]': finished 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:30.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: osdmap e70: 8 total, 8 up, 8 in 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi042-71368-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/8473578' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi042-71379-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi042-71368-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:30.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.081 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi042-71379-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.081 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:30.509 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: Running main() from gmock_main.cc 2024-09-21T17:47:30.510 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-09-21T17:47:30.510 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [----------] Global test environment set-up. 2024-09-21T17:47:30.510 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-09-21T17:47:30.510 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-09-21T17:47:30.510 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (1413 ms) 2024-09-21T17:47:30.510 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-09-21T17:47:30.510 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (2007 ms) 2024-09-21T17:47:30.510 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-09-21T17:47:30.510 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (3033 ms) 2024-09-21T17:47:30.510 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [----------] 3 tests from NeoRadosCmd (6453 ms total) 2024-09-21T17:47:30.510 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: 2024-09-21T17:47:30.511 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [----------] Global test environment tear-down 2024-09-21T17:47:30.511 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [==========] 3 tests from 1 test suite ran. (6453 ms total) 2024-09-21T17:47:30.511 INFO:tasks.workunit.client.0.smithi042.stdout: cmd: [ PASSED ] 3 tests. 2024-09-21T17:47:30.533 INFO:tasks.workunit.client.0.smithi042.stdout:8819' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.533 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.450524+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:30.533 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.450583+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.533 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.450662+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.533 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.450741+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.534 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.450792+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi042-71275-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.534 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.456075+0000 mon.c [INF] from='client.? 172.21.15.42:0/731988068' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:30.534 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.475679+0000 mon.c [INF] from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.534 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.489751+0000 mon.b [INF] from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:30.534 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.518801+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-21T17:47:30.534 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.528438+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"} : dispatch 2024-09-21T17:47:30.534 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.529956+0000 mon.a [INF] from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:30.534 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.530368+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.534 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.532634+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:30.534 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.556087+0000 mon.c [INF] from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.556567+0000 mon.c [INF] from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.556611+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.557016+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.565538+0000 mon.c [INF] from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.566032+0000 mon.c [INF] from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.568735+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.569140+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.570553+0000 mon.c [INF] from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.570960+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.571588+0000 mon.c [INF] from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:28.571963+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.455259+0000 mon.a [INF] from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi042-71299-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi042-71299-16"}]': finished 2024-09-21T17:47:30.535 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.455320+0000 mon.a [INF] from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi042-71745-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi042-71745-7"}]': finished 2024-09-21T17:47:30.536 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.455360+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi042-71687-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi042-71687-7"}]': finished 2024-09-21T17:47:30.536 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.455446+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:30.536 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.455540+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi042-72437-1"}]': finished 2024-09-21T17:47:30.536 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.455614+0000 mon.a [INF] from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:30.536 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.455672+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.536 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.455742+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:30.536 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.455831+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:30.536 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.455915+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi042-71368-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:30.536 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.462983+0000 mon.b [INF] from='client.? 172.21.15.42:0/1920648890' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:30.536 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.463148+0000 mon.c [INF] from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi042-71368-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.536 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.464506+0000 mon.b [INF] from='client.? 172.21.15.42:0/8473578' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.537 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.464824+0000 mon.c [INF] from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi042-71379-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.537 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.471745+0000 mon.c [INF] from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:30.537 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.472204+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"} : dispatch 2024-09-21T17:47:30.537 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.473066+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi042-71368-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:30.537 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.474158+0000 mon.a [INF] from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi042-71883-1"} : dispatch 2024-09-21T17:47:30.537 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.503253+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.537 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.503736+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi042-71379-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:30.591 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.504641+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:30.591 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.539864+0000 mon.b [INF] from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.591 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:29.565664+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.461019+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.461118+0000 mon.a [INF] from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.461203+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.461293+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"}]': finished 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.461358+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.466664+0000 mon.b [INF] from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi042-72437-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.472391+0000 mon.c [INF] from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-4", "overlaypool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.474231+0000 mon.b [INF] from='client.? 172.21.15.42:0/8473578' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi042-71285-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.490013+0000 mon.b [INF] from='client.? 172.21.15.42:0/3200249645' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.490336+0000 mon.b [INF] from='client.? 172.21.15.42:0/1011928646' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.490628+0000 mon.b [INF] from='client.? 172.21.15.42:0/1530620239' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi042-71275-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.592 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.510186+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi042-72437-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:30.611 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.510839+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix api_io_pp: Running main() from gmock_main.cc 2024-09-21T17:47:30.611 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2024-09-21T17:47:30.611 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [----------] Global test environment set-up. 2024-09-21T17:47:30.611 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2024-09-21T17:47:30.611 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: seed 71338 2024-09-21T17:47:30.611 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-09-21T17:47:30.611 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-21T17:47:30.611 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-21T17:47:30.611 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (347 ms) 2024-09-21T17:47:30.611 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (9 ms) 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (5 ms) 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (349 ms) 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (4 ms) 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (5 ms) 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (5 ms) 2024-09-21T17:47:30.612 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (2 ms) 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (6 ms) 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (2 ms) 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (5 ms) 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (5 ms) 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (4 ms) 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (3 ms) 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-21T17:47:30.613 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (3 ms) 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (8 ms) 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (4 ms) 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (4 ms) 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (4 ms) 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (2 ms) 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (3 ms) 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (780 ms total) 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: 2024-09-21T17:47:30.614 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2024-09-21T17:47:30.615 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-21T17:47:30.615 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1121 ms) 2024-09-21T17:47:30.615 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-21T17:47:30.615 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (20 ms) 2024-09-21T17:47:30.615 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-21T17:47:30.615 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (5 ms) 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: 18.3 deep-scrub starts 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: 18.3 deep-scrub ok 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: 18.7 deep-scrub ok 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: 18.9 deep-scrub starts 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: 18.9 deep-scrub ok 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: 18.6 deep-scrub starts 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: 18.6 deep-scrub ok 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: 18.4 deep-scrub starts 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: 18.4 deep-scrub ok 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"}]': finished 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi042-72437-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-4", "overlaypool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/8473578' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi042-71285-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: osdmap e71: 8 total, 8 up, 8 in 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3200249645' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1011928646' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1530620239' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi042-71275-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: 18.3 deep-scrub starts 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: 18.3 deep-scrub ok 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: 18.7 deep-scrub ok 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: 18.9 deep-scrub starts 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: 18.9 deep-scrub ok 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: 18.6 deep-scrub starts 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: 18.6 deep-scrub ok 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: 18.4 deep-scrub starts 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: 18.4 deep-scrub ok 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:30.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:30.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"}]': finished 2024-09-21T17:47:30.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:30.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi042-72437-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:30.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-4", "overlaypool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:30.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/8473578' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi042-71285-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T17:47:30.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: osdmap e71: 8 total, 8 up, 8 in 2024-09-21T17:47:30.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3200249645' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1011928646' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1530620239' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi042-71275-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi042-72437-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:30.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-4", "overlaypool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:30.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi042-71285-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T17:47:30.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi042-71275-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi042-72554-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T17:47:30.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: threexx 2024-09-21T17:47:30.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T17:47:30.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi042-72437-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:30.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-4", "overlaypool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:30.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi042-71285-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T17:47:30.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi042-71275-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:30.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi042-72554-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:30.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T17:47:30.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: threexx 2024-09-21T17:47:30.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T17:47:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: 18.3 deep-scrub starts 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: 18.3 deep-scrub ok 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: 18.7 deep-scrub ok 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: 18.9 deep-scrub starts 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: 18.9 deep-scrub ok 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: 18.6 deep-scrub starts 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: 18.6 deep-scrub ok 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: 18.4 deep-scrub starts 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: 18.4 deep-scrub ok 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi042-72554-1"}]': finished 2024-09-21T17:47:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2328018323' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi042-71883-1"}]': finished 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi042-71285-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"}]': finished 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi042-72437-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi042-72437-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-4", "overlaypool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/8473578' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi042-71285-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: osdmap e71: 8 total, 8 up, 8 in 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3200249645' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1011928646' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1530620239' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi042-71275-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi042-72437-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-4", "overlaypool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi042-71285-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T17:47:31.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:31.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:31.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi042-71275-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:31.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi042-72554-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:31.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T17:47:31.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: threexx 2024-09-21T17:47:31.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T17:47:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: 18.5 deep-scrub starts 2024-09-21T17:47:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: 18.5 deep-scrub ok 2024-09-21T17:47:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-21T17:47:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T17:47:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: fourxx 2024-09-21T17:47:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T17:47:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi042-71338-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T17:47:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi042-71338-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T17:47:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: 18.8 deep-scrub starts 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: 18.8 deep-scrub ok 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2155539525' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: pgmap v59: 900 pgs: 64 creating+peering, 448 unknown, 388 active+clean; 97 MiB data, 278 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 545 op/s 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi042-71368-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi042-71368-10"}]': finished 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi042-71379-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi042-71379-10"}]': finished 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-4", "overlaypool": "test-rados-api-smithi042-71455-4-cache"}]': finished 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi042-71285-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi042-71275-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi042-72554-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:31.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi042-71338-24", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T17:47:31.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: 18.5 deep-scrub starts 2024-09-21T17:47:31.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: 18.5 deep-scrub ok 2024-09-21T17:47:31.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-21T17:47:31.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T17:47:31.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: fourxx 2024-09-21T17:47:31.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T17:47:31.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi042-71338-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T17:47:31.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi042-71338-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T17:47:31.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: 18.8 deep-scrub starts 2024-09-21T17:47:31.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: 18.8 deep-scrub ok 2024-09-21T17:47:31.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2155539525' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: pgmap v59: 900 pgs: 64 creating+peering, 448 unknown, 388 active+clean; 97 MiB data, 278 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 545 op/s 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi042-71368-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi042-71368-10"}]': finished 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi042-71379-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi042-71379-10"}]': finished 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-4", "overlaypool": "test-rados-api-smithi042-71455-4-cache"}]': finished 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi042-71285-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi042-71275-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi042-72554-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi042-71338-24", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T17:47:31.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-4-cache", "mode": "writeback"} : dispatch 2024-09-21T17:47:31.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: osdmap e72: 8 total, 8 up, 8 in 2024-09-21T17:47:31.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:31.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:31.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNSsmithi042-72554-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi042-72554-2"} : dispatch 2024-09-21T17:47:31.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-4-cache", "mode": "writeback"} : dispatch 2024-09-21T17:47:31.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:31.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:31.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:31.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:31.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-4-cache", "mode": "writeback"} : dispatch 2024-09-21T17:47:31.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: osdmap e72: 8 total, 8 up, 8 in 2024-09-21T17:47:31.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:31.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:31.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNSsmithi042-72554-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi042-72554-2"} : dispatch 2024-09-21T17:47:31.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-4-cache", "mode": "writeback"} : dispatch 2024-09-21T17:47:31.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:31.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:31.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:31.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: 18.5 deep-scrub starts 2024-09-21T17:47:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: 18.5 deep-scrub ok 2024-09-21T17:47:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-21T17:47:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T17:47:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: fourxx 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi042-71338-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi042-71338-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: 18.8 deep-scrub starts 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: 18.8 deep-scrub ok 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2155539525' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: pgmap v59: 900 pgs: 64 creating+peering, 448 unknown, 388 active+clean; 97 MiB data, 278 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 545 op/s 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi042-71368-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi042-71368-10"}]': finished 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi042-71379-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi042-71379-10"}]': finished 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-4", "overlaypool": "test-rados-api-smithi042-71455-4-cache"}]': finished 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi042-71285-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:32.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi042-71275-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi042-72554-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi042-71338-24", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-4-cache", "mode": "writeback"} : dispatch 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: osdmap e72: 8 total, 8 up, 8 in 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNSsmithi042-72554-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi042-72554-2"} : dispatch 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-4-cache", "mode": "writeback"} : dispatch 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:32.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:32.535 INFO:tasks.workunit.client.0.smithi042.stdout: api list: Running main() from gmock_main.cc 2024-09-21T17:47:32.535 INFO:tasks.workunit.client.0.smithi042.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-09-21T17:47:32.535 INFO:tasks.workunit.client.0.smithi042.stdout: list: [----------] Global test environment set-up. 2024-09-21T17:47:32.535 INFO:tasks.workunit.client.0.smithi042.stdout: list: [----------] 3 tests from NeoradosList 2024-09-21T17:47:32.536 INFO:tasks.workunit.client.0.smithi042.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-09-21T17:47:32.536 INFO:tasks.workunit.client.0.smithi042.stdout: list: [ OK ] NeoradosList.ListObjects (2345 ms) 2024-09-21T17:47:32.536 INFO:tasks.workunit.client.0.smithi042.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-09-21T17:47:32.536 INFO:tasks.workunit.client.0.smithi042.stdout: list: [ OK ] NeoradosList.ListObjectsNS (3026 ms) 2024-09-21T17:47:32.536 INFO:tasks.workunit.client.0.smithi042.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-09-21T17:47:32.536 INFO:tasks.workunit.client.0.smithi042.stdout: list: [ OK ] NeoradosList.ListObjectsMany (3050 ms) 2024-09-21T17:47:32.536 INFO:tasks.workunit.client.0.smithi042.stdout: list: [----------] 3 tests from NeoradosList (8421 ms total) 2024-09-21T17:47:32.536 INFO:tasks.workunit.client.0.smithi042.stdout: list: 2024-09-21T17:47:32.536 INFO:tasks.workunit.client.0.smithi042.stdout: list: [----------] Global test environment tear-down 2024-09-21T17:47:32.536 INFO:tasks.workunit.client.0.smithi042.stdout: list: [==========] 3 tests from 1 test suite ran. (8422 ms total) 2024-09-21T17:47:32.536 INFO:tasks.workunit.client.0.smithi042.stdout: list: [ PASSED ] 3 tests. 2024-09-21T17:47:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-21T17:47:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:47:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi042-72437-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi042-72437-2"}]': finished 2024-09-21T17:47:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-4-cache", "mode": "writeback"}]': finished 2024-09-21T17:47:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi042-71299-16"}]': finished 2024-09-21T17:47:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7"}]': finished 2024-09-21T17:47:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"}]': finished 2024-09-21T17:47:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:32.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:32.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: osdmap e73: 8 total, 8 up, 8 in 2024-09-21T17:47:32.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:32.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:32.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:32.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:32.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:32.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:32.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-21T17:47:32.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:32.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi042-72437-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi042-72437-2"}]': finished 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-4-cache", "mode": "writeback"}]': finished 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi042-71299-16"}]': finished 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7"}]': finished 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"}]': finished 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: osdmap e73: 8 total, 8 up, 8 in 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:32.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi042-72437-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi042-72437-2"}]': finished 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-4-cache", "mode": "writeback"}]': finished 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi042-71299-16"}]': finished 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi042-71745-7"}]': finished 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi042-71687-7"}]': finished 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1052037053' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: osdmap e73: 8 total, 8 up, 8 in 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi042-71299-16"} : dispatch 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi042-71745-7"} : dispatch 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"} : dispatch 2024-09-21T17:47:33.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:33.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:33.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: Running main() from gmock_main.cc 2024-09-21T17:47:33.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-09-21T17:47:33.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [----------] Global test environment set-up. 2024-09-21T17:47:33.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (367 ms) 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: no timeout :/ 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: no timeout :/ 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: no timeout :/ 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: no timeout :/ 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: no timeout :/ 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (47 ms) 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (8 ms) 2024-09-21T17:47:33.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-09-21T17:47:33.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.Checksum (2 ms) 2024-09-21T17:47:33.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-21T17:47:33.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (5 ms) 2024-09-21T17:47:33.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-21T17:47:33.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (5 ms) 2024-09-21T17:47:33.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-09-21T17:47:33.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (4 ms) 2024-09-21T17:47:33.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-09-21T17:47:33.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (2 ms) 2024-09-21T17:47:33.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-09-21T17:47:33.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.TruncTest (6 ms) 2024-09-21T17:47:33.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-09-21T17:47:33.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (5 ms) 2024-09-21T17:47:33.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-21T17:47:33.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (5 ms) 2024-09-21T17:47:33.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-09-21T17:47:33.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.RmXattr (12 ms) 2024-09-21T17:47:33.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-09-21T17:47:33.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIo.XattrIter (5 ms) 2024-09-21T17:47:33.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [----------] 14 tests from LibRadosIo (473 ms total) 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1121 ms) 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (5 ms) 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (5 ms) 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (4 ms) 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (6 ms) 2024-09-21T17:47:33.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (3 ms) 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (3 ms) 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (3 ms) 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (9 ms) 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (4 ms) 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1163 ms total) 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [------- watch_notify: Running main() from gmock_main.cc 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-09-21T17:47:33.501 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: [----------] Global test environment set-up. 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: handle_notify cookie 94415678977712 notify_id 283467841536 notifier_gid 24829 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (2295 ms) 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: Trying... 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: handle_notify cookie 94415691682208 notify_id 296352743424 notifier_gid 24940 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: Waiting for 3.000000000s 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: Timed out. 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: Flushing... 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: Flushed... 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7035 ms) 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (9331 ms total) 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: 2024-09-21T17:47:33.502 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: [----------] Global test environment tear-down 2024-09-21T17:47:33.503 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (9331 ms total) 2024-09-21T17:47:33.503 INFO:tasks.workunit.client.0.smithi042.stdout: watch_notify: [ PASSED ] 2 tests. 2024-09-21T17:47:33.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-09-21T17:47:33.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-09-21T17:47:33.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-09-21T17:47:33.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-09-21T17:47:33.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: seed 71745 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (367 ms) 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (16 ms) 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (8 ms) 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (18 ms) 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (409 ms total) 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-09-21T17:47:33.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1111 ms) 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (12 ms) 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (3 ms) 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (7 ms) 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1133 ms total) 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (9647 ms total) 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: Running main() from gmock_main.cc 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-09-21T17:47:33.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [----------] Global test environment set-up. 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ OK ] LibRadosStat.Stat (374 ms) 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (12 ms) 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ OK ] LibRadosStat.StatNS (15 ms) 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (1 ms) 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (4 ms) 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [----------] 5 tests from LibRadosStat (406 ms total) 2024-09-21T17:47:33.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1135 ms) 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (8 ms) 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (2 ms) 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1145 ms total) 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [----------] Global test environment tear-down 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (9665 ms total) 2024-09-21T17:47:33.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_stat: [ PASSED ] 9 tests. 2024-09-21T17:47:33.508 INFO:tasks.workunit.client.0.smithi042.stdout:---] Global test environment tear-down 2024-09-21T17:47:33.508 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [==========] 24 tests from 2 test suites ran. (9804 ms total) 2024-09-21T17:47:33.508 INFO:tasks.workunit.client.0.smithi042.stdout: api_io: [ PASSED ] 24 tests. 2024-09-21T17:47:33.609 INFO:tasks.workunit.client.0.smithi042.stdout:": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-4", "overlaypool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:33.609 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.511577+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi042-71285-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T17:47:33.609 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.511973+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.609 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.512481+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.609 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.512741+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi042-71275-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.609 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.522087+0000 mon.a [INF] from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi042-72554-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:33.610 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.531728+0000 mon.b [INF] from='client.? 172.21.15.42:0/3040055960' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T17:47:33.610 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.531929+0000 client.admin [INF] threexx 2024-09-21T17:47:33.610 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: got: 2024-09-21T17:47:30.532395+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T17:47:33.610 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (7139 ms) 2024-09-21T17:47:33.610 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (9718 ms total) 2024-09-21T17:47:33.610 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: 2024-09-21T17:47:33.610 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [----------] Global test environment tear-down 2024-09-21T17:47:33.610 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (9718 ms total) 2024-09-21T17:47:33.610 INFO:tasks.workunit.client.0.smithi042.stdout: api_cmd: [ PASSED ] 4 tests. 2024-09-21T17:47:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71883-6", "pg_num": 4} : dispatch 2024-09-21T17:47:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71883-6", "pg_num": 4} : dispatch 2024-09-21T17:47:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-4"} : dispatch 2024-09-21T17:47:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-4"} : dispatch 2024-09-21T17:47:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: pgmap v62: 732 pgs: 40 creating+peering, 692 active+clean; 145 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 13 MiB/s wr, 11 op/s 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi042-72554-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi042-72554-2"}]': finished 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi042-71299-16"}]': finished 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi042-71745-7"}]': finished 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"}]': finished 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71883-6", "pg_num": 4}]': finished 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-4"}]': finished 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: osdmap e74: 8 total, 8 up, 8 in 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3717910507' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/843975073' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi042-71275-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71883-6", "pg_num": 4} : dispatch 2024-09-21T17:47:33.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71883-6", "pg_num": 4} : dispatch 2024-09-21T17:47:33.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-4"} : dispatch 2024-09-21T17:47:33.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-4"} : dispatch 2024-09-21T17:47:33.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: pgmap v62: 732 pgs: 40 creating+peering, 692 active+clean; 145 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 13 MiB/s wr, 11 op/s 2024-09-21T17:47:33.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:33.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi042-72554-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi042-72554-2"}]': finished 2024-09-21T17:47:33.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi042-71299-16"}]': finished 2024-09-21T17:47:33.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi042-71745-7"}]': finished 2024-09-21T17:47:33.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"}]': finished 2024-09-21T17:47:33.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71883-6", "pg_num": 4}]': finished 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-4"}]': finished 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: osdmap e74: 8 total, 8 up, 8 in 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3717910507' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/843975073' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi042-71275-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2245903473' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.883 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:33.884 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.884 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi042-71275-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.884 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.884 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:33.884 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:33.884 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2245903473' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.884 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:33.884 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.884 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi042-71275-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:33.884 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71883-6", "pg_num": 4} : dispatch 2024-09-21T17:47:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71883-6", "pg_num": 4} : dispatch 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-4"} : dispatch 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-4"} : dispatch 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: pgmap v62: 732 pgs: 40 creating+peering, 692 active+clean; 145 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 13 MiB/s wr, 11 op/s 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi042-72554-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi042-72554-2"}]': finished 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2444311105' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi042-71299-16"}]': finished 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3487258819' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi042-71745-7"}]': finished 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi042-71687-7"}]': finished 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71883-6", "pg_num": 4}]': finished 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-4"}]': finished 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/671485993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:34.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1125825042' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:34.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: osdmap e74: 8 total, 8 up, 8 in 2024-09-21T17:47:34.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3717910507' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:34.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/843975073' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi042-71275-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:34.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:34.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"} : dispatch 2024-09-21T17:47:34.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2245903473' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:34.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:34.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:34.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi042-71275-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:34.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:34.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:47:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:47:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:47:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: pool 'PoolQuotaPP_smithi042-71285-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-21T17:47:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T17:47:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:47:34.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:34.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"}]': finished 2024-09-21T17:47:34.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:34.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:34.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi042-71275-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:34.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:34.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: osdmap e75: 8 total, 8 up, 8 in 2024-09-21T17:47:34.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "overlaypool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:34.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:34.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "overlaypool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:34.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:34.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:34.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:34.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:34.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:34.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:34.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:34.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:34.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: pool 'PoolQuotaPP_smithi042-71285-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-21T17:47:34.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T17:47:34.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:47:34.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:34.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"}]': finished 2024-09-21T17:47:34.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:34.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:34.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi042-71275-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:34.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:34.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: osdmap e75: 8 total, 8 up, 8 in 2024-09-21T17:47:34.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "overlaypool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:34.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:34.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "overlaypool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:34.920 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:34.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:34.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:34.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:34.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:34.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:34.921 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:34.922 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: pool 'PoolQuotaPP_smithi042-71285-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-21T17:47:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T17:47:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-4", "tierpool": "test-rados-api-smithi042-71455-4-cache"}]': finished 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi042-71275-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: osdmap e75: 8 total, 8 up, 8 in 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "overlaypool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "overlaypool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:35.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:35.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:35.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:35.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:35.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:36.114 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: Running main() from gmock_main.cc 2024-09-21T17:47:36.114 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-09-21T17:47:36.114 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: [----------] Global test environment set-up. 2024-09-21T17:47:36.114 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-09-21T17:47:36.114 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-09-21T17:47:36.114 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (5380 ms) 2024-09-21T17:47:36.115 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-09-21T17:47:36.115 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (6638 ms) 2024-09-21T17:47:36.115 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (12018 ms total) 2024-09-21T17:47:36.115 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: 2024-09-21T17:47:36.115 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: [----------] Global test environment tear-down 2024-09-21T17:47:36.115 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (12018 ms total) 2024-09-21T17:47:36.115 INFO:tasks.workunit.client.0.smithi042.stdout: ec_io: [ PASSED ] 2 tests. 2024-09-21T17:47:36.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "overlaypool": "test-rados-api-smithi042-71883-6"}]': finished 2024-09-21T17:47:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi042-72437-2"}]': finished 2024-09-21T17:47:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71883-6", "mode": "writeback"} : dispatch 2024-09-21T17:47:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: osdmap e76: 8 total, 8 up, 8 in 2024-09-21T17:47:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/858693847' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi042-71622-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi042-72554-2"} : dispatch 2024-09-21T17:47:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71883-6", "mode": "writeback"} : dispatch 2024-09-21T17:47:36.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:36.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi042-71622-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:36.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:36.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:36.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:36.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:36.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:36.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: pgmap v66: 584 pgs: 132 unknown, 452 active+clean; 145 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 14 MiB/s wr, 5 op/s 2024-09-21T17:47:36.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:36.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "overlaypool": "test-rados-api-smithi042-71883-6"}]': finished 2024-09-21T17:47:36.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi042-72437-2"}]': finished 2024-09-21T17:47:36.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:36.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71883-6", "mode": "writeback"} : dispatch 2024-09-21T17:47:36.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:36.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: osdmap e76: 8 total, 8 up, 8 in 2024-09-21T17:47:36.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:36.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/858693847' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi042-71622-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:36.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:36.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi042-72554-2"} : dispatch 2024-09-21T17:47:36.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71883-6", "mode": "writeback"} : dispatch 2024-09-21T17:47:36.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:36.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi042-71622-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:36.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:36.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:36.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:36.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:36.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:36.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: pgmap v66: 584 pgs: 132 unknown, 452 active+clean; 145 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 14 MiB/s wr, 5 op/s 2024-09-21T17:47:36.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "overlaypool": "test-rados-api-smithi042-71883-6"}]': finished 2024-09-21T17:47:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi042-72437-2"}]': finished 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71883-6", "mode": "writeback"} : dispatch 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3333306269' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: osdmap e76: 8 total, 8 up, 8 in 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/858693847' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi042-71622-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi042-72554-2"} : dispatch 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71883-6", "mode": "writeback"} : dispatch 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi042-71622-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi042-72437-2"} : dispatch 2024-09-21T17:47:36.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:36.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:36.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:36.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: pgmap v66: 584 pgs: 132 unknown, 452 active+clean; 145 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 14 MiB/s wr, 5 op/s 2024-09-21T17:47:36.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:37.125 INFO:tasks.workunit.client.0.smithi042.stdout: pool: Running main() from gmock_main.cc 2024-09-21T17:47:37.126 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-09-21T17:47:37.126 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [----------] Global test environment set-up. 2024-09-21T17:47:37.126 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-09-21T17:47:37.126 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-09-21T17:47:37.126 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ OK ] NeoRadosPools.PoolList (1316 ms) 2024-09-21T17:47:37.126 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-09-21T17:47:37.126 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (2045 ms) 2024-09-21T17:47:37.126 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-09-21T17:47:37.126 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (1972 ms) 2024-09-21T17:47:37.126 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-09-21T17:47:37.126 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (4007 ms) 2024-09-21T17:47:37.127 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-09-21T17:47:37.127 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (1614 ms) 2024-09-21T17:47:37.127 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-09-21T17:47:37.127 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2019 ms) 2024-09-21T17:47:37.127 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [----------] 6 tests from NeoRadosPools (12973 ms total) 2024-09-21T17:47:37.127 INFO:tasks.workunit.client.0.smithi042.stdout: pool: 2024-09-21T17:47:37.127 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [----------] Global test environment tear-down 2024-09-21T17:47:37.127 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [==========] 6 tests from 1 test suite ran. (12974 ms total) 2024-09-21T17:47:37.127 INFO:tasks.workunit.client.0.smithi042.stdout: pool: [ PASSED ] 6 tests. 2024-09-21T17:47:37.153 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-09-21T17:47:37.153 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-09-21T17:47:37.154 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-09-21T17:47:37.154 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-09-21T17:47:37.154 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: seed 71379 2024-09-21T17:47:37.154 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-21T17:47:37.154 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (320 ms) 2024-09-21T17:47:37.154 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-09-21T17:47:37.154 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (65 ms) 2024-09-21T17:47:37.154 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-21T17:47:37.154 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1013 ms) 2024-09-21T17:47:37.155 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-21T17:47:37.155 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1007 ms) 2024-09-21T17:47:37.155 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-21T17:47:37.155 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (4 ms) 2024-09-21T17:47:37.155 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-09-21T17:47:37.155 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (5 ms) 2024-09-21T17:47:37.155 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-09-21T17:47:37.155 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (5 ms) 2024-09-21T17:47:37.155 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-09-21T17:47:37.155 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (4 ms) 2024-09-21T17:47:37.155 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2423 ms total) 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1123 ms) 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (15 ms) 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1027 ms) 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1005 ms) 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (4 ms) 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (5 ms) 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-21T17:47:37.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (4 ms) 2024-09-21T17:47:37.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-21T17:47:37.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (3 ms) 2024-09-21T17:47:37.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3186 ms total) 2024-09-21T17:47:37.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: 2024-09-21T17:47:37.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-09-21T17:47:37.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (13420 ms total) 2024-09-21T17:47:37.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-09-21T17:47:37.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: Running main() from gmock_main.cc 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [----------] Global test environment set-up. 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (374 ms) 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLock.LockShared (6 ms) 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1012 ms) 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1010 ms) 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (6 ms) 2024-09-21T17:47:37.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-09-21T17:47:37.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLock.Unlock (6 ms) 2024-09-21T17:47:37.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-09-21T17:47:37.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (5 ms) 2024-09-21T17:47:37.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-09-21T17:47:37.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (3 ms) 2024-09-21T17:47:37.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [----------] 8 tests from LibRadosLock (2422 ms total) 2024-09-21T17:47:37.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: 2024-09-21T17:47:37.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-09-21T17:47:37.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-09-21T17:47:37.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1092 ms) 2024-09-21T17:47:37.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (31 ms) 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1081 ms) 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1029 ms) 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (3 ms) 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (4 ms) 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (5 ms) 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (3 ms) 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3248 ms total) 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: 2024-09-21T17:47:37.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [----------] Global test environment tear-down 2024-09-21T17:47:37.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (13437 ms total) 2024-09-21T17:47:37.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_lock: [ PASSED ] 16 tests. 2024-09-21T17:47:37.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:47:37.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi042-72554-2"}]': finished 2024-09-21T17:47:37.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71883-6", "mode": "writeback"}]': finished 2024-09-21T17:47:37.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi042-71622-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"}]': finished 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi042-72437-2"}]': finished 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"}]': finished 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: osdmap e77: 8 total, 8 up, 8 in 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3387743740' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2219255362' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3720636436' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi042-71275-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi042-72554-2"} : dispatch 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi042-71275-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi042-72554-2"}]': finished 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71883-6", "mode": "writeback"}]': finished 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi042-71622-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"}]': finished 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi042-72437-2"}]': finished 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"}]': finished 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:37.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: osdmap e77: 8 total, 8 up, 8 in 2024-09-21T17:47:37.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3387743740' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2219255362' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3720636436' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi042-71275-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi042-72554-2"} : dispatch 2024-09-21T17:47:37.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:37.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:37.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi042-71275-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.418 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd dump"} : dispatch 2024-09-21T17:47:37.419 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.419 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:37.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd dump"} : dispatch 2024-09-21T17:47:37.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:47:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi042-72554-2"}]': finished 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71883-6", "mode": "writeback"}]': finished 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi042-71622-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi042-71368-10"}]': finished 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi042-72437-2"}]': finished 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi042-71379-10"}]': finished 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3286770576' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420621715' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: osdmap e77: 8 total, 8 up, 8 in 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3387743740' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2219255362' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3720636436' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi042-71275-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi042-72554-2"} : dispatch 2024-09-21T17:47:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"} : dispatch 2024-09-21T17:47:37.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"} : dispatch 2024-09-21T17:47:37.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi042-71275-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd dump"} : dispatch 2024-09-21T17:47:37.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:37.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:38.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:38.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi042-72554-2"}]': finished 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"}]': finished 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"}]': finished 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi042-71275-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: osdmap e78: 8 total, 8 up, 8 in 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app2"} : dispatch 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi042-72554-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi042-72554-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: pgmap v69: 656 pgs: 300 unknown, 356 active+clean; 145 MiB data, 757 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:38.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.422 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.422 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.422 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.422 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:38.422 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi042-72554-2"}]': finished 2024-09-21T17:47:38.422 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"}]': finished 2024-09-21T17:47:38.422 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"}]': finished 2024-09-21T17:47:38.422 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi042-71275-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: osdmap e78: 8 total, 8 up, 8 in 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app2"} : dispatch 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi042-72554-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi042-72554-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: pgmap v69: 656 pgs: 300 unknown, 356 active+clean; 145 MiB data, 757 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.423 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.424 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.424 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:38.424 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.424 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi042-72554-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:38.424 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:38.424 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: osdmap e79: 8 total, 8 up, 8 in 2024-09-21T17:47:38.424 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsManysmithi042-72554-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:38.424 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"dne","key":"key","value":"value"} : dispatch 2024-09-21T17:47:38.424 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.424 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.424 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:38.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi042-72554-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:38.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:38.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: osdmap e79: 8 total, 8 up, 8 in 2024-09-21T17:47:38.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsManysmithi042-72554-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:38.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"dne","key":"key","value":"value"} : dispatch 2024-09-21T17:47:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi042-71338-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3529680574' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi042-72554-2"}]': finished 2024-09-21T17:47:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi042-71368-10"}]': finished 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi042-71379-10"}]': finished 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi042-71275-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: osdmap e78: 8 total, 8 up, 8 in 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app2"} : dispatch 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi042-72554-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi042-72554-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: pgmap v69: 656 pgs: 300 unknown, 356 active+clean; 145 MiB data, 757 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:38.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:38.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:38.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi042-71397-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:38.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi042-72554-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:38.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:38.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: osdmap e79: 8 total, 8 up, 8 in 2024-09-21T17:47:38.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsManysmithi042-72554-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:38.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"dne","key":"key","value":"value"} : dispatch 2024-09-21T17:47:39.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:47:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:47:39.244 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-09-21T17:47:39.244 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-09-21T17:47:39.244 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: notify 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1110 ms) 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (5 ms) 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1115 ms total) 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: notify 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (147 ms) 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: notify 2024-09-21T17:47:39.245 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3573 ms) 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (5 ms) 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (4 ms) 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: handle_notify cookie 94153999582080 notify_id 330712481794 notifier_gid 25234 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (5 ms) 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: handle_notify cookie 94153999582080 notify_id 330712481796 notifier_gid 25234 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (4 ms) 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-21T17:47:39.246 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: handle_notify cookie 94153999582080 notify_id 330712481797 notifier_gid 25234 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (4 ms) 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: handle_notify cookie 94153999582080 notify_id 330712481798 notifier_gid 25234 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (5 ms) 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: handle_notify cookie 94153999582080 notify_id 330712481799 notifier_gid 25234 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (5 ms) 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: handle_notify cookie 94153999582080 notify_id 330712481795 notifier_gid 25234 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (5 ms) 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: trying... 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: handle_notify cookie 94153999582080 notify_id 330712481793 notifier_gid 25234 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: timed out 2024-09-21T17:47:39.247 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: flushing 2024-09-21T17:47:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsManysmithi042-72554-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T17:47:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi042-71854-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[29361]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi042-71854-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T17:47:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:39.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[29361]: osdmap e80: 8 total, 8 up, 8 in 2024-09-21T17:47:39.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsManysmithi042-72554-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:39.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T17:47:39.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi042-71854-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:39.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:39.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[38309]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:39.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi042-71854-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:39.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:39.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:39.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T17:47:39.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:39.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:39 smithi042 ceph-mon[38309]: osdmap e80: 8 total, 8 up, 8 in 2024-09-21T17:47:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsManysmithi042-72554-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T17:47:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi042-71854-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:39 smithi162 ceph-mon[32106]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi042-71854-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T17:47:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:39 smithi162 ceph-mon[32106]: osdmap e80: 8 total, 8 up, 8 in 2024-09-21T17:47:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2689386102' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/304092510' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3348866661' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi042-71684-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1927436395' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip3_smithi042-71275-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi042-71684-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: pgmap v72: 680 pgs: 64 creating+peering, 224 unknown, 392 active+clean; 145 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T17:47:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi042-72554-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi042-72554-3"}]': finished 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi042-71854-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"}]': finished 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1927436395' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi042-71275-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi042-71684-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: osdmap e81: 8 total, 8 up, 8 in 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1"} : dispatch 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2689386102' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/304092510' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3348866661' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi042-71684-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1927436395' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip3_smithi042-71275-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T17:47:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi042-71684-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: pgmap v72: 680 pgs: 64 creating+peering, 224 unknown, 392 active+clean; 145 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-21T17:47:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T17:47:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi042-72554-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi042-72554-3"}]': finished 2024-09-21T17:47:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi042-71854-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"}]': finished 2024-09-21T17:47:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1927436395' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi042-71275-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2689386102' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/304092510' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3348866661' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi042-71684-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1927436395' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip3_smithi042-71275-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi042-71684-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: pgmap v72: 680 pgs: 64 creating+peering, 224 unknown, 392 active+clean; 145 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T17:47:40.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi042-72554-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi042-72554-3"}]': finished 2024-09-21T17:47:40.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi042-71854-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"}]': finished 2024-09-21T17:47:40.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1927436395' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi042-71275-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T17:47:40.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:40.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi042-71684-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: osdmap e81: 8 total, 8 up, 8 in 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1"} : dispatch 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi042-71684-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/739238295' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: osdmap e81: 8 total, 8 up, 8 in 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1"} : dispatch 2024-09-21T17:47:40.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"} : dispatch 2024-09-21T17:47:40.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:40.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:41.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_watc_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-21T17:47:41.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (2 ms) 2024-09-21T17:47:41.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-21T17:47:41.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (2 ms) 2024-09-21T17:47:41.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-21T17:47:41.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (3 ms) 2024-09-21T17:47:41.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-21T17:47:41.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (4 ms) 2024-09-21T17:47:41.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-21T17:47:41.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (2 ms) 2024-09-21T17:47:41.156 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (4 ms) 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (3 ms) 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (3 ms) 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (3 ms) 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (10 ms) 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CrcZeroWrite (6495 ms) 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (1076 ms) 2024-09-21T17:47:41.157 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-21T17:47:41.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (34 ms) 2024-09-21T17:47:41.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-21T17:47:41.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (4 ms) 2024-09-21T17:47:41.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-21T17:47:41.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (6 ms) 2024-09-21T17:47:41.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (8797 ms total) 2024-09-21T17:47:41.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: 2024-09-21T17:47:41.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [----------] Global test environment tear-down 2024-09-21T17:47:41.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (17449 ms total) 2024-09-21T17:47:41.158 INFO:tasks.workunit.client.0.smithi042.stdout: api_io_pp: [ PASSED ] 40 tests. 2024-09-21T17:47:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1"}]': finished 2024-09-21T17:47:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:41 smithi162 ceph-mon[32106]: osdmap e82: 8 total, 8 up, 8 in 2024-09-21T17:47:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1"}]': finished 2024-09-21T17:47:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:41 smithi042 ceph-mon[29361]: osdmap e82: 8 total, 8 up, 8 in 2024-09-21T17:47:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/171802363' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi042-71397-1","app":"app1","key":"key1"}]': finished 2024-09-21T17:47:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi042-71338-24"}]': finished 2024-09-21T17:47:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:41 smithi042 ceph-mon[38309]: osdmap e82: 8 total, 8 up, 8 in 2024-09-21T17:47:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: pgmap v75: 504 pgs: 64 creating+peering, 112 unknown, 328 active+clean; 145 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T17:47:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: osdmap e83: 8 total, 8 up, 8 in 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2938777288' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1190942348' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3911244935' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi042-71275-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi042-71275-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: pgmap v75: 504 pgs: 64 creating+peering, 112 unknown, 328 active+clean; 145 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T17:47:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: osdmap e83: 8 total, 8 up, 8 in 2024-09-21T17:47:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2938777288' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1190942348' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3911244935' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi042-71275-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi042-71275-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: pgmap v75: 504 pgs: 64 creating+peering, 112 unknown, 328 active+clean; 145 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T17:47:42.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:42.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:42.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:42.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:42.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: osdmap e83: 8 total, 8 up, 8 in 2024-09-21T17:47:42.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:42.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:42.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:42.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:42.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2938777288' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1190942348' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3911244935' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi042-71275-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:42.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi042-71275-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-7"}]': finished 2024-09-21T17:47:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"}]': finished 2024-09-21T17:47:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2938777288' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi042-71275-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: osdmap e84: 8 total, 8 up, 8 in 2024-09-21T17:47:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-7"}]': finished 2024-09-21T17:47:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"}]': finished 2024-09-21T17:47:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2938777288' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi042-71275-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: osdmap e84: 8 total, 8 up, 8 in 2024-09-21T17:47:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:43.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:43.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:43.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-7"}]': finished 2024-09-21T17:47:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi042-71854-12"}]': finished 2024-09-21T17:47:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2938777288' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71978-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:43.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi042-71275-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:43.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: osdmap e84: 8 total, 8 up, 8 in 2024-09-21T17:47:43.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2847071025' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:43.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:43.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"} : dispatch 2024-09-21T17:47:43.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:47:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:47:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:47:44.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-09-21T17:47:44.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-09-21T17:47:44.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-09-21T17:47:44.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-09-21T17:47:44.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-21T17:47:44.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify_test_cb 2024-09-21T17:47:44.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (376 ms) 2024-09-21T17:47:44.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-21T17:47:44.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-09-21T17:47:44.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93987870719568 err -107 2024-09-21T17:47:44.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1006 ms) 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93987870720896 err -107 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1021 ms) 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_cb from 24706 notify_id 292057776128 cookie 93987870720896 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (6 ms) 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_cb from 24706 notify_id 292057776129 cookie 93987870738576 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (6 ms) 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-09-21T17:47:44.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_cb from 24706 notify_id 292057776129 cookie 93987870775584 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (21 ms) 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_cb from 24706 notify_id 292057776129 cookie 93987870755456 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_cb from 24706 notify_id 292057776129 cookie 93987870759648 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (35 ms) 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_cb from 24706 notify_id 292057776130 cookie 93987870755456 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_cb from 24706 notify_id 296352743427 cookie 93987870755456 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3005 ms) 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93987870757712 err -107 2024-09-21T17:47:44.167 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_cb from 24706 notify_id 326417514499 cookie 93987870757712 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5009 ms) 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93987870757712 err -107 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1005 ms) 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (11490 ms total) 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: watch_notify_test_cb 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1164 ms) 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1164 ms total) 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-09-21T17:47:44.168 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (20272 ms total) 2024-09-21T17:47:44.170 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-09-21T17:47:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: pgmap v78: 680 pgs: 2 active+clean+snaptrim, 71 creating+activating, 53 creating+peering, 175 unknown, 379 active+clean; 145 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T17:47:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"}]': finished 2024-09-21T17:47:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi042-72554-3"}]': finished 2024-09-21T17:47:44.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:47:44.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: osdmap e85: 8 total, 8 up, 8 in 2024-09-21T17:47:44.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:44.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:44.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:44.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1182331468' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:44.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:44.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: pgmap v78: 680 pgs: 2 active+clean+snaptrim, 71 creating+activating, 53 creating+peering, 175 unknown, 379 active+clean; 145 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T17:47:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"}]': finished 2024-09-21T17:47:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi042-72554-3"}]': finished 2024-09-21T17:47:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:47:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: osdmap e85: 8 total, 8 up, 8 in 2024-09-21T17:47:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:44.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:44.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1182331468' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:44.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:44.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:44.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: pgmap v78: 680 pgs: 2 active+clean+snaptrim, 71 creating+activating, 53 creating+peering, 175 unknown, 379 active+clean; 145 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T17:47:44.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:44.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:44.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:44.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:44.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi042-71854-12"}]': finished 2024-09-21T17:47:44.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi042-72554-3"}]': finished 2024-09-21T17:47:44.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:47:44.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: osdmap e85: 8 total, 8 up, 8 in 2024-09-21T17:47:44.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:44.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7"} : dispatch 2024-09-21T17:47:44.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1770019028' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:44.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1182331468' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:44.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi042-72554-3"} : dispatch 2024-09-21T17:47:44.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.167 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: Running main() from gmock_main.cc 2024-09-21T17:47:45.167 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-09-21T17:47:45.167 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [----------] Global test environment set-up. 2024-09-21T17:47:45.167 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-09-21T17:47:45.168 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-09-21T17:47:45.168 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (6342 ms) 2024-09-21T17:47:45.168 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-09-21T17:47:45.168 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (6640 ms) 2024-09-21T17:47:45.168 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-09-21T17:47:45.168 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (8051 ms) 2024-09-21T17:47:45.168 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [----------] 3 tests from NeoradosECList (21033 ms total) 2024-09-21T17:47:45.168 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: 2024-09-21T17:47:45.168 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [----------] Global test environment tear-down 2024-09-21T17:47:45.168 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (21033 ms total) 2024-09-21T17:47:45.168 INFO:tasks.workunit.client.0.smithi042.stdout: ec_list: [ PASSED ] 3 tests. 2024-09-21T17:47:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7"}]': finished 2024-09-21T17:47:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi042-72554-3"}]': finished 2024-09-21T17:47:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:45 smithi162 ceph-mon[32106]: osdmap e86: 8 total, 8 up, 8 in 2024-09-21T17:47:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2038028804' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3952630625' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi042-71275-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi042-71275-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7"}]': finished 2024-09-21T17:47:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi042-72554-3"}]': finished 2024-09-21T17:47:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[38309]: osdmap e86: 8 total, 8 up, 8 in 2024-09-21T17:47:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2038028804' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3952630625' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi042-71275-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi042-71275-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-7"}]': finished 2024-09-21T17:47:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi042-72554-3"}]': finished 2024-09-21T17:47:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[29361]: osdmap e86: 8 total, 8 up, 8 in 2024-09-21T17:47:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2038028804' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3952630625' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi042-71275-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi042-71275-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:46 smithi162 ceph-mon[32106]: pgmap v81: 680 pgs: 2 active+clean+snaptrim, 2 active, 36 creating+activating, 32 creating+peering, 160 unknown, 448 active+clean; 145 MiB data, 767 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-21T17:47:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi042-71275-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:46 smithi162 ceph-mon[32106]: osdmap e87: 8 total, 8 up, 8 in 2024-09-21T17:47:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:46 smithi042 ceph-mon[29361]: pgmap v81: 680 pgs: 2 active+clean+snaptrim, 2 active, 36 creating+activating, 32 creating+peering, 160 unknown, 448 active+clean; 145 MiB data, 767 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-21T17:47:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi042-71275-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:46 smithi042 ceph-mon[29361]: osdmap e87: 8 total, 8 up, 8 in 2024-09-21T17:47:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:46 smithi042 ceph-mon[38309]: pgmap v81: 680 pgs: 2 active+clean+snaptrim, 2 active, 36 creating+activating, 32 creating+peering, 160 unknown, 448 active+clean; 145 MiB data, 767 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-21T17:47:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi042-71285-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi042-71275-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:46 smithi042 ceph-mon[38309]: osdmap e87: 8 total, 8 up, 8 in 2024-09-21T17:47:47.189 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-09-21T17:47:47.189 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-09-21T17:47:47.189 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-09-21T17:47:47.189 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (2545 ms) 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3008 ms) 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3015 ms) 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (2614 ms) 2024-09-21T17:47:47.190 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-09-21T17:47:47.191 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3024 ms) 2024-09-21T17:47:47.191 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-09-21T17:47:47.191 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (3004 ms) 2024-09-21T17:47:47.191 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-09-21T17:47:47.191 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (6052 ms) 2024-09-21T17:47:47.191 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (23262 ms total) 2024-09-21T17:47:47.191 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: 2024-09-21T17:47:47.191 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-09-21T17:47:47.191 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (23262 ms total) 2024-09-21T17:47:47.191 INFO:tasks.workunit.client.0.smithi042.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-09-21T17:47:47.222 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: Running main() from gmock_main.cc 2024-09-21T17:47:47.222 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-09-21T17:47:47.222 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [----------] Global test environment set-up. 2024-09-21T17:47:47.222 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-09-21T17:47:47.222 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-09-21T17:47:47.222 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (2288 ms) 2024-09-21T17:47:47.222 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-09-21T17:47:47.222 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3017 ms) 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3030 ms) 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (2620 ms) 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (3005 ms) 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (3013 ms) 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (6061 ms) 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (23034 ms total) 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [----------] Global test environment tear-down 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (23034 ms total) 2024-09-21T17:47:47.223 INFO:tasks.workunit.client.0.smithi042.stdout: write_operations: [ PASSED ] 7 tests. 2024-09-21T17:47:47.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:47.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:47 smithi162 ceph-mon[32106]: osdmap e88: 8 total, 8 up, 8 in 2024-09-21T17:47:47.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:47.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:47.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:47.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:47 smithi042 ceph-mon[29361]: osdmap e88: 8 total, 8 up, 8 in 2024-09-21T17:47:47.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:47 smithi042 ceph-mon[38309]: osdmap e88: 8 total, 8 up, 8 in 2024-09-21T17:47:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:48.285 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:48 smithi162 ceph-mon[32106]: pgmap v84: 520 pgs: 2 active+clean+snaptrim, 32 creating+peering, 96 unknown, 390 active+clean; 145 MiB data, 767 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:48.285 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:48.285 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:48.285 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:48 smithi162 ceph-mon[32106]: osdmap e89: 8 total, 8 up, 8 in 2024-09-21T17:47:48.285 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1822383946' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi042-71275-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:48.285 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2673371643' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi042-71285-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:48.286 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi042-71285-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:48.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[38309]: pgmap v84: 520 pgs: 2 active+clean+snaptrim, 32 creating+peering, 96 unknown, 390 active+clean; 145 MiB data, 767 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:48.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[38309]: osdmap e89: 8 total, 8 up, 8 in 2024-09-21T17:47:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1822383946' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi042-71275-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2673371643' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi042-71285-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi042-71285-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[29361]: pgmap v84: 520 pgs: 2 active+clean+snaptrim, 32 creating+peering, 96 unknown, 390 active+clean; 145 MiB data, 767 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[29361]: osdmap e89: 8 total, 8 up, 8 in 2024-09-21T17:47:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1822383946' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi042-71275-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:48.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2673371643' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi042-71285-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:48.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi042-71285-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:49.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:47:48 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:47:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4"} : dispatch 2024-09-21T17:47:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4"} : dispatch 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1822383946' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi042-71275-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi042-71285-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4"}]': finished 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: osdmap e90: 8 total, 8 up, 8 in 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4120997074' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4"} : dispatch 2024-09-21T17:47:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4"} : dispatch 2024-09-21T17:47:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1822383946' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi042-71275-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi042-71285-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4"}]': finished 2024-09-21T17:47:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: osdmap e90: 8 total, 8 up, 8 in 2024-09-21T17:47:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4120997074' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4"} : dispatch 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4"} : dispatch 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1822383946' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi042-71275-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi042-71285-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4"}]': finished 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: osdmap e90: 8 total, 8 up, 8 in 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6"} : dispatch 2024-09-21T17:47:49.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:49.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4120997074' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: pgmap v87: 616 pgs: 64 unknown, 2 active+clean+snaptrim_wait, 22 creating+activating, 128 creating+peering, 400 active+clean; 145 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:47:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:47:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6"}]': finished 2024-09-21T17:47:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-9"}]': finished 2024-09-21T17:47:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4120997074' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: osdmap e91: 8 total, 8 up, 8 in 2024-09-21T17:47:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-9", "mode": "writeback"} : dispatch 2024-09-21T17:47:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-9", "mode": "writeback"} : dispatch 2024-09-21T17:47:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi042-71883-6", "pool2": "test-rados-api-smithi042-71883-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T17:47:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi042-71883-6", "pool2": "test-rados-api-smithi042-71883-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T17:47:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: pgmap v87: 616 pgs: 64 unknown, 2 active+clean+snaptrim_wait, 22 creating+activating, 128 creating+peering, 400 active+clean; 145 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:47:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:47:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6"}]': finished 2024-09-21T17:47:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-9"}]': finished 2024-09-21T17:47:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4120997074' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: osdmap e91: 8 total, 8 up, 8 in 2024-09-21T17:47:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-9", "mode": "writeback"} : dispatch 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-9", "mode": "writeback"} : dispatch 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi042-71883-6", "pool2": "test-rados-api-smithi042-71883-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi042-71883-6", "pool2": "test-rados-api-smithi042-71883-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: pgmap v87: 616 pgs: 64 unknown, 2 active+clean+snaptrim_wait, 22 creating+activating, 128 creating+peering, 400 active+clean; 145 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:47:50.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:50.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:47:50.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi042-71883-4", "tierpool": "test-rados-api-smithi042-71883-6"}]': finished 2024-09-21T17:47:50.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-9"}]': finished 2024-09-21T17:47:50.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4120997074' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:50.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: osdmap e91: 8 total, 8 up, 8 in 2024-09-21T17:47:50.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-9", "mode": "writeback"} : dispatch 2024-09-21T17:47:50.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-9", "mode": "writeback"} : dispatch 2024-09-21T17:47:50.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3107860475' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi042-71883-6", "pool2": "test-rados-api-smithi042-71883-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T17:47:50.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi042-71883-6", "pool2": "test-rados-api-smithi042-71883-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T17:47:50.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:50.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:50.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:47:51.075 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:47:50 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=infra.usagestats t=2024-09-21T17:47:50.813488368Z level=info msg="Usage stats are ready to report" 2024-09-21T17:47:51.224 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-09-21T17:47:51.224 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [----------] Global test environment set-up. 2024-09-21T17:47:51.224 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [----------] 4 tests from LibRadosService 2024-09-21T17:47:51.224 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-09-21T17:47:51.224 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5040 ms) 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [ OK ] LibRadosService.RegisterLate (15 ms) 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: cluster: 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: id: 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: health: HEALTH_WARN 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 10 pool(s) do not have an application enabled 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: services: 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 5m) 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: mgr: y(active, since 91s), standbys: x 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-09-21T17:47:51.225 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: data: 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: pools: 24 pools, 636 pgs 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: objects: 199 objects, 583 KiB 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: usage: 230 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: pgs: 79.245% pgs unknown 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 504 unknown 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 132 active+clean 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: io: 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: cluster: 2024-09-21T17:47:51.226 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: id: 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: health: HEALTH_WARN 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 12 pool(s) do not have an application enabled 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: services: 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 5m) 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: mgr: y(active, since 93s), standbys: x 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: data: 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: pools: 29 pools, 868 pgs 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: objects: 254 objects, 97 MiB 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: usage: 278 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:47:51.227 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: pgs: 14.747% pgs unknown 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 40.553% pgs not active 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 388 active+clean 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 352 creating+peering 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 128 unknown 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: io: 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: client: 12 MiB/s rd, 24 MiB/s wr, 256 op/s rd, 289 op/s wr 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [ OK ] LibRadosService.StatusFormat (2182 ms) 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [ RUN ] LibRadosService.Status 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [ OK ] LibRadosService.Status (20050 ms) 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [----------] 4 tests from LibRadosService (27287 ms total) 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [----------] Global test environment tear-down 2024-09-21T17:47:51.228 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [==========] 4 tests from 1 test suite ran. (27287 ms total) 2024-09-21T17:47:51.229 INFO:tasks.workunit.client.0.smithi042.stdout: api_service: [ PASSED ] 4 tests. 2024-09-21T17:47:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:47:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-9", "mode": "writeback"}]': finished 2024-09-21T17:47:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi042-71883-6", "pool2": "test-rados-api-smithi042-71883-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T17:47:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: osdmap e92: 8 total, 8 up, 8 in 2024-09-21T17:47:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi042-71622-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:51.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1726453762' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi042-71275-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/392961143' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP_smithi042-71285-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi042-71622-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:51.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi042-71275-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP_smithi042-71285-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:47:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-9", "mode": "writeback"}]': finished 2024-09-21T17:47:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi042-71883-6", "pool2": "test-rados-api-smithi042-71883-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T17:47:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:51.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: osdmap e92: 8 total, 8 up, 8 in 2024-09-21T17:47:51.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi042-71622-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:51.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1726453762' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi042-71275-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/392961143' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP_smithi042-71285-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi042-71622-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:51.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi042-71275-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP_smithi042-71285-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:51.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:51.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:47:51.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-9", "mode": "writeback"}]': finished 2024-09-21T17:47:51.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi042-71883-6", "pool2": "test-rados-api-smithi042-71883-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T17:47:51.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:47:51.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: osdmap e92: 8 total, 8 up, 8 in 2024-09-21T17:47:51.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi042-71622-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:51.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1726453762' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi042-71275-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/392961143' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP_smithi042-71285-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi042-71622-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:47:51.671 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi042-71275-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.671 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP_smithi042-71285-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:51.671 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout:h_notify_pp: flushed 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3005 ms) 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: trying... 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: handle_notify cookie 94153999582080 notify_id 343597383682 notifier_gid 25234 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: timed out 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: flushing 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: flushed 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3004 ms) 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: List watches 2024-09-21T17:47:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: notify2 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: handle_notify cookie 94153999582080 notify_id 356482285577 notifier_gid 25234 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: notify2 done 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: watch_check 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: unwatch2 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: flushing 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: done 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3012 ms) 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: List watches 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: notify2 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: handle_notify cookie 94153999582080 notify_id 369367187466 notifier_gid 25234 2024-09-21T17:47:52.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: notify2 done 2024-09-21T17:47:52.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: watch_check 2024-09-21T17:47:52.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: unwatch2 2024-09-21T17:47:52.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: flushing 2024-09-21T17:47:52.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: done 2024-09-21T17:47:52.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3016 ms) 2024-09-21T17:47:52.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (15795 ms total) 2024-09-21T17:47:52.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: 2024-09-21T17:47:52.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-09-21T17:47:52.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (28267 ms total) 2024-09-21T17:47:52.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-09-21T17:47:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:52 smithi162 ceph-mon[32106]: pgmap v90: 612 pgs: 224 unknown, 2 active+clean+snaptrim_wait, 22 creating+activating, 364 active+clean; 145 MiB data, 770 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi042-71275-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi042-71285-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:47:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:52 smithi162 ceph-mon[32106]: osdmap e93: 8 total, 8 up, 8 in 2024-09-21T17:47:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[29361]: pgmap v90: 612 pgs: 224 unknown, 2 active+clean+snaptrim_wait, 22 creating+activating, 364 active+clean; 145 MiB data, 770 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi042-71275-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi042-71285-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:47:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[29361]: osdmap e93: 8 total, 8 up, 8 in 2024-09-21T17:47:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:52.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[38309]: pgmap v90: 612 pgs: 224 unknown, 2 active+clean+snaptrim_wait, 22 creating+activating, 364 active+clean; 145 MiB data, 770 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:52.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:47:52.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi042-71275-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi042-71285-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:47:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[38309]: osdmap e93: 8 total, 8 up, 8 in 2024-09-21T17:47:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9"} : dispatch 2024-09-21T17:47:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:53 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:53 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:47:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi042-71622-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi042-71622-10"}]': finished 2024-09-21T17:47:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9"}]': finished 2024-09-21T17:47:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:53 smithi162 ceph-mon[32106]: osdmap e94: 8 total, 8 up, 8 in 2024-09-21T17:47:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:53 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:53 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:47:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi042-71622-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi042-71622-10"}]': finished 2024-09-21T17:47:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9"}]': finished 2024-09-21T17:47:53.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:53 smithi042 ceph-mon[29361]: osdmap e94: 8 total, 8 up, 8 in 2024-09-21T17:47:53.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:53 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:53.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:53 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:47:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi042-71622-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi042-71622-10"}]': finished 2024-09-21T17:47:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-9"}]': finished 2024-09-21T17:47:53.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:53 smithi042 ceph-mon[38309]: osdmap e94: 8 total, 8 up, 8 in 2024-09-21T17:47:54.167 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:47:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:47:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:47:54.304 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-09-21T17:47:54.304 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [----------] Global test environment set-up. 2024-09-21T17:47:54.304 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-09-21T17:47:54.304 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-09-21T17:47:54.304 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5073 ms) 2024-09-21T17:47:54.304 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-09-21T17:47:54.304 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (38 ms) 2024-09-21T17:47:54.304 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-09-21T17:47:54.304 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20068 ms) 2024-09-21T17:47:54.304 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-09-21T17:47:54.304 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: attempt 0 of 20 2024-09-21T17:47:54.305 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5140 ms) 2024-09-21T17:47:54.305 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (30319 ms total) 2024-09-21T17:47:54.305 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: 2024-09-21T17:47:54.305 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [----------] Global test environment tear-down 2024-09-21T17:47:54.305 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (30319 ms total) 2024-09-21T17:47:54.305 INFO:tasks.workunit.client.0.smithi042.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-09-21T17:47:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:54 smithi162 ceph-mon[32106]: pgmap v93: 396 pgs: 36 unknown, 2 active+clean+snaptrim_wait, 1 creating+peering, 17 creating+activating, 340 active+clean; 145 MiB data, 770 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:54 smithi162 ceph-mon[32106]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:54 smithi162 ceph-mon[32106]: osdmap e95: 8 total, 8 up, 8 in 2024-09-21T17:47:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1185495806' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi042-71275-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3626289016' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi042-71285-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi042-71285-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi042-71275-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2886545609' entity='client.admin' cmd={"prefix": "service dump"} : dispatch 2024-09-21T17:47:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[29361]: pgmap v93: 396 pgs: 36 unknown, 2 active+clean+snaptrim_wait, 1 creating+peering, 17 creating+activating, 340 active+clean; 145 MiB data, 770 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[29361]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[29361]: osdmap e95: 8 total, 8 up, 8 in 2024-09-21T17:47:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1185495806' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi042-71275-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3626289016' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi042-71285-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi042-71285-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi042-71275-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2886545609' entity='client.admin' cmd={"prefix": "service dump"} : dispatch 2024-09-21T17:47:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[38309]: pgmap v93: 396 pgs: 36 unknown, 2 active+clean+snaptrim_wait, 1 creating+peering, 17 creating+activating, 340 active+clean; 145 MiB data, 770 MiB used, 714 GiB / 715 GiB avail 2024-09-21T17:47:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[38309]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:47:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[38309]: osdmap e95: 8 total, 8 up, 8 in 2024-09-21T17:47:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1185495806' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi042-71275-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3626289016' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi042-71285-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi042-71285-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi042-71275-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2886545609' entity='client.admin' cmd={"prefix": "service dump"} : dispatch 2024-09-21T17:47:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:55 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-21T17:47:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi042-71285-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi042-71275-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:55 smithi162 ceph-mon[32106]: osdmap e96: 8 total, 8 up, 8 in 2024-09-21T17:47:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:55.615 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-21T17:47:55.616 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:55.616 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi042-71285-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:55.616 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:55.616 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi042-71275-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:55.616 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[38309]: osdmap e96: 8 total, 8 up, 8 in 2024-09-21T17:47:55.616 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:55.616 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:55.616 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-21T17:47:55.616 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:55.616 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi042-71285-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:55.617 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71586-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:55.617 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi042-71275-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:55.617 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[29361]: osdmap e96: 8 total, 8 up, 8 in 2024-09-21T17:47:55.617 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:55.617 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:56.140 INFO:tasks.workunit.client.0.smithi042.stdout: misc: Running main() from gmock_main.cc 2024-09-21T17:47:56.140 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [----------] Global test environment set-up. 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.Version (1357 ms) 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (1973 ms) 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.LongName (3033 ms) 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (2998 ms) 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (2628 ms) 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-09-21T17:47:56.141 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (3023 ms) 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.Exec (2998 ms) 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (3017 ms) 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (3024 ms) 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.BigObject (2967 ms) 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (2001 ms) 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (2969 ms) 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [----------] 12 tests from NeoRadosMisc (31988 ms total) 2024-09-21T17:47:56.142 INFO:tasks.workunit.client.0.smithi042.stdout: misc: 2024-09-21T17:47:56.143 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [----------] Global test environment tear-down 2024-09-21T17:47:56.143 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [==========] 12 tests from 1 test suite ran. (31988 ms total) 2024-09-21T17:47:56.143 INFO:tasks.workunit.client.0.smithi042.stdout: misc: [ PASSED ] 12 tests. 2024-09-21T17:47:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[29361]: pgmap v96: 588 pgs: 256 unknown, 8 creating+peering, 324 active+clean; 145 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-09-21T17:47:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[29361]: osdmap e97: 8 total, 8 up, 8 in 2024-09-21T17:47:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache", "force_nonempty":""} : dispatch 2024-09-21T17:47:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache", "force_nonempty":""} : dispatch 2024-09-21T17:47:56.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[38309]: pgmap v96: 588 pgs: 256 unknown, 8 creating+peering, 324 active+clean; 145 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-09-21T17:47:56.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:56.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:56.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[38309]: osdmap e97: 8 total, 8 up, 8 in 2024-09-21T17:47:56.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache", "force_nonempty":""} : dispatch 2024-09-21T17:47:56.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache", "force_nonempty":""} : dispatch 2024-09-21T17:47:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:56 smithi162 ceph-mon[32106]: pgmap v96: 588 pgs: 256 unknown, 8 creating+peering, 324 active+clean; 145 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-09-21T17:47:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:56 smithi162 ceph-mon[32106]: osdmap e97: 8 total, 8 up, 8 in 2024-09-21T17:47:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache", "force_nonempty":""} : dispatch 2024-09-21T17:47:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache", "force_nonempty":""} : dispatch 2024-09-21T17:47:57.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:57.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache", "force_nonempty":""}]': finished 2024-09-21T17:47:57.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[29361]: osdmap e98: 8 total, 8 up, 8 in 2024-09-21T17:47:57.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1924001537' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71586-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1932998150' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi042-71275-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71586-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi042-71275-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:57.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:57.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:57.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache", "force_nonempty":""}]': finished 2024-09-21T17:47:57.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[38309]: osdmap e98: 8 total, 8 up, 8 in 2024-09-21T17:47:57.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1924001537' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71586-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1932998150' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi042-71275-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71586-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi042-71275-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:57.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache", "force_nonempty":""}]': finished 2024-09-21T17:47:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:57 smithi162 ceph-mon[32106]: osdmap e98: 8 total, 8 up, 8 in 2024-09-21T17:47:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1924001537' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71586-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1932998150' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi042-71275-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71586-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi042-71275-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:47:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:57.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:47:58.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: pgmap v99: 588 pgs: 256 unknown, 8 creating+peering, 324 active+clean; 145 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-09-21T17:47:58.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:58.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:58.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:58.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:58.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71586-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:58.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi042-71275-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:58.662 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:58.662 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: osdmap e99: 8 total, 8 up, 8 in 2024-09-21T17:47:58.662 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:47:58.662 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:47:58.662 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache"} : dispatch 2024-09-21T17:47:58.662 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache"} : dispatch 2024-09-21T17:47:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: pgmap v99: 588 pgs: 256 unknown, 8 creating+peering, 324 active+clean; 145 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-09-21T17:47:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71586-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi042-71275-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: osdmap e99: 8 total, 8 up, 8 in 2024-09-21T17:47:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:47:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:47:58.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache"} : dispatch 2024-09-21T17:47:58.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache"} : dispatch 2024-09-21T17:47:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: pgmap v99: 588 pgs: 256 unknown, 8 creating+peering, 324 active+clean; 145 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-09-21T17:47:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:47:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:47:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:58.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71586-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:58.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi042-71275-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:47:58.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:47:58.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: osdmap e99: 8 total, 8 up, 8 in 2024-09-21T17:47:58.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:47:58.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:47:58.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4078271885' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache"} : dispatch 2024-09-21T17:47:58.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache"} : dispatch 2024-09-21T17:47:59.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:47:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:47:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.0"} : dispatch 2024-09-21T17:47:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.1"} : dispatch 2024-09-21T17:47:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.2"} : dispatch 2024-09-21T17:47:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.3"} : dispatch 2024-09-21T17:47:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.4"} : dispatch 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.5"} : dispatch 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.6"} : dispatch 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.7"} : dispatch 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.8"} : dispatch 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.9"} : dispatch 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: 18.2 deep-scrub starts 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: 18.2 deep-scrub ok 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-11"}]': finished 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache"}]': finished 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-11", "mode": "writeback"} : dispatch 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: osdmap e100: 8 total, 8 up, 8 in 2024-09-21T17:47:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-11", "mode": "writeback"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.0"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.1"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.2"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.3"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.4"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.5"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.6"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.7"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.8"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.9"} : dispatch 2024-09-21T17:47:59.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: 18.2 deep-scrub starts 2024-09-21T17:47:59.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: 18.2 deep-scrub ok 2024-09-21T17:47:59.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-11"}]': finished 2024-09-21T17:47:59.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache"}]': finished 2024-09-21T17:47:59.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-11", "mode": "writeback"} : dispatch 2024-09-21T17:47:59.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: osdmap e100: 8 total, 8 up, 8 in 2024-09-21T17:47:59.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:47:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-11", "mode": "writeback"} : dispatch 2024-09-21T17:47:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:47:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.0"} : dispatch 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.1"} : dispatch 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.2"} : dispatch 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.3"} : dispatch 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.4"} : dispatch 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.5"} : dispatch 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.6"} : dispatch 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.7"} : dispatch 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.8"} : dispatch 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "18.9"} : dispatch 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: 18.2 deep-scrub starts 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: 18.2 deep-scrub ok 2024-09-21T17:47:59.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-11"}]': finished 2024-09-21T17:47:59.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71586-10", "tierpool":"test-rados-api-smithi042-71586-10-cache"}]': finished 2024-09-21T17:47:59.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-11", "mode": "writeback"} : dispatch 2024-09-21T17:47:59.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: osdmap e100: 8 total, 8 up, 8 in 2024-09-21T17:47:59.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:47:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-11", "mode": "writeback"} : dispatch 2024-09-21T17:48:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-09-21T17:48:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-09-21T17:48:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-09-21T17:48:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: 18.7 deep-scrub starts 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: 18.7 deep-scrub ok 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: 18.0 deep-scrub starts 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: 18.0 deep-scrub ok 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: pgmap v102: 460 pgs: 460 active+clean; 145 MiB data, 808 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 260 KiB/s wr, 7 op/s 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: 18.3 deep-scrub starts 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: 18.3 deep-scrub ok 2024-09-21T17:48:00.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: 18.1 deep-scrub starts 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: 18.1 deep-scrub ok 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: 18.6 deep-scrub starts 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: 18.6 deep-scrub ok 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-11", "mode": "writeback"}]': finished 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: osdmap e101: 8 total, 8 up, 8 in 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3876156524' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi042-71285-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi042-71285-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3627428213' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi042-71275-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:00.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi042-71275-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: 18.7 deep-scrub starts 2024-09-21T17:48:00.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: 18.7 deep-scrub ok 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: 18.0 deep-scrub starts 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: 18.0 deep-scrub ok 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: pgmap v102: 460 pgs: 460 active+clean; 145 MiB data, 808 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 260 KiB/s wr, 7 op/s 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: 18.3 deep-scrub starts 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: 18.3 deep-scrub ok 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: 18.1 deep-scrub starts 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: 18.1 deep-scrub ok 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: 18.6 deep-scrub starts 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: 18.6 deep-scrub ok 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-11", "mode": "writeback"}]': finished 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: osdmap e101: 8 total, 8 up, 8 in 2024-09-21T17:48:00.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3876156524' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi042-71285-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:00.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi042-71285-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:00.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3627428213' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi042-71275-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:00.670 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi042-71275-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-09-21T17:48:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-09-21T17:48:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-09-21T17:48:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-09-21T17:48:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-09-21T17:48:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-09-21T17:48:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-09-21T17:48:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-09-21T17:48:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-09-21T17:48:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-09-21T17:48:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: 18.7 deep-scrub starts 2024-09-21T17:48:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: 18.7 deep-scrub ok 2024-09-21T17:48:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: 18.0 deep-scrub starts 2024-09-21T17:48:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: 18.0 deep-scrub ok 2024-09-21T17:48:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: pgmap v102: 460 pgs: 460 active+clean; 145 MiB data, 808 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 260 KiB/s wr, 7 op/s 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: 18.3 deep-scrub starts 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: 18.3 deep-scrub ok 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: 18.1 deep-scrub starts 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: 18.1 deep-scrub ok 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: 18.6 deep-scrub starts 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: 18.6 deep-scrub ok 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-11", "mode": "writeback"}]': finished 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: osdmap e101: 8 total, 8 up, 8 in 2024-09-21T17:48:00.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3876156524' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi042-71285-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:00.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi042-71285-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:00.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3627428213' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi042-71275-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:00.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi042-71275-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: Running main() from gmock_main.cc 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [----------] Global test environment set-up. 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ OK ] LibRadosPools.PoolList (2668 ms) 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3019 ms) 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3011 ms) 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-21T17:48:01.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (2628 ms) 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3015 ms) 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5012 ms) 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5044 ms) 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (4954 ms) 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8014 ms) 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [----------] 9 tests from LibRadosPools (37365 ms total) 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [----------] Global test environment tear-down 2024-09-21T17:48:01.165 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (37365 ms total) 2024-09-21T17:48:01.166 INFO:tasks.workunit.client.0.smithi042.stdout: api_pool: [ PASSED ] 9 tests. 2024-09-21T17:48:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: 18.4 deep-scrub starts 2024-09-21T17:48:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: 18.4 deep-scrub ok 2024-09-21T17:48:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: 18.5 deep-scrub starts 2024-09-21T17:48:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: 18.5 deep-scrub ok 2024-09-21T17:48:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: 18.9 deep-scrub starts 2024-09-21T17:48:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: 18.9 deep-scrub ok 2024-09-21T17:48:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi042-71285-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:01.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi042-71275-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:01.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"}]': finished 2024-09-21T17:48:01.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: osdmap e102: 8 total, 8 up, 8 in 2024-09-21T17:48:01.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:01.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:01.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:01.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:01.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: 18.4 deep-scrub starts 2024-09-21T17:48:01.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: 18.4 deep-scrub ok 2024-09-21T17:48:01.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: 18.5 deep-scrub starts 2024-09-21T17:48:01.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: 18.5 deep-scrub ok 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: 18.9 deep-scrub starts 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: 18.9 deep-scrub ok 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi042-71285-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi042-71275-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"}]': finished 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: osdmap e102: 8 total, 8 up, 8 in 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:01.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: 18.4 deep-scrub starts 2024-09-21T17:48:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: 18.4 deep-scrub ok 2024-09-21T17:48:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: 18.5 deep-scrub starts 2024-09-21T17:48:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: 18.5 deep-scrub ok 2024-09-21T17:48:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: 18.9 deep-scrub starts 2024-09-21T17:48:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: 18.9 deep-scrub ok 2024-09-21T17:48:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi042-71285-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi042-71275-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"}]': finished 2024-09-21T17:48:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: osdmap e102: 8 total, 8 up, 8 in 2024-09-21T17:48:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:01.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:01.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:01.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[38309]: 18.8 deep-scrub starts 2024-09-21T17:48:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[38309]: 18.8 deep-scrub ok 2024-09-21T17:48:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[38309]: pgmap v105: 524 pgs: 160 unknown, 364 active+clean; 145 MiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-09-21T17:48:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:02.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:02.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T17:48:02.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:48:02.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[38309]: osdmap e103: 8 total, 8 up, 8 in 2024-09-21T17:48:02.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:02.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:48:02.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:48:02.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[29361]: 18.8 deep-scrub starts 2024-09-21T17:48:02.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[29361]: 18.8 deep-scrub ok 2024-09-21T17:48:02.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[29361]: pgmap v105: 524 pgs: 160 unknown, 364 active+clean; 145 MiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-09-21T17:48:02.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:02.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:02.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T17:48:02.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:48:02.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[29361]: osdmap e103: 8 total, 8 up, 8 in 2024-09-21T17:48:02.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:02.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:48:02.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:48:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:02 smithi162 ceph-mon[32106]: 18.8 deep-scrub starts 2024-09-21T17:48:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:02 smithi162 ceph-mon[32106]: 18.8 deep-scrub ok 2024-09-21T17:48:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:02 smithi162 ceph-mon[32106]: pgmap v105: 524 pgs: 160 unknown, 364 active+clean; 145 MiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-09-21T17:48:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T17:48:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:48:02.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:02 smithi162 ceph-mon[32106]: osdmap e103: 8 total, 8 up, 8 in 2024-09-21T17:48:02.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:02.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:48:02.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11"} : dispatch 2024-09-21T17:48:03.209 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-09-21T17:48:03.209 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [----------] Global test environment set-up. 2024-09-21T17:48:03.209 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-09-21T17:48:03.209 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-09-21T17:48:03.209 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: 2024-09-21T17:47:23.812+0000 7f2edc60c780 -1 failed for service _ceph-mon._tcp 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: 2024-09-21T17:47:23.812+0000 7f2edc60c780 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (59 ms) 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5014 ms) 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5073 ms total) 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: 2024-09-21T17:48:03.210 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: started 0x7f2ec406a550 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: started 0x55f4c5ea1150 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: started 2 aios 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: waiting 0x7f2ec406a550 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: waiting 0x55f4c5ea1150 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: done. 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (5275 ms) 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (5275 ms total) 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-21T17:48:03.211 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMisc.Exec (69 ms) 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (5 ms) 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (2 ms) 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4927 ms) 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (21692 ms) 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [----------] 8 tests from LibRadosMisc (26695 ms total) 2024-09-21T17:48:03.212 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: 2024-09-21T17:48:03.213 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [----------] Global test environment tear-down 2024-09-21T17:48:03.213 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (39430 ms total) 2024-09-21T17:48:03.213 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc: [ PASSED ] 12 tests. 2024-09-21T17:48:03.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:48:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11"}]': finished 2024-09-21T17:48:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[29361]: osdmap e104: 8 total, 8 up, 8 in 2024-09-21T17:48:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4182973397' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsCompletePP_smithi042-71285-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3379039224' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi042-71275-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsCompletePP_smithi042-71285-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi042-71275-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:03.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:48:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11"}]': finished 2024-09-21T17:48:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[38309]: osdmap e104: 8 total, 8 up, 8 in 2024-09-21T17:48:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4182973397' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsCompletePP_smithi042-71285-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3379039224' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi042-71275-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsCompletePP_smithi042-71285-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi042-71275-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:03 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:48:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-11"}]': finished 2024-09-21T17:48:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:03 smithi162 ceph-mon[32106]: osdmap e104: 8 total, 8 up, 8 in 2024-09-21T17:48:03.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:03.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4182973397' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsCompletePP_smithi042-71285-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:03.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:03.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3379039224' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi042-71275-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:03.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:03.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsCompletePP_smithi042-71285-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:03.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi042-71275-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:48:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:48:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:48:04.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[29361]: pgmap v108: 484 pgs: 31 creating+peering, 123 unknown, 330 active+clean; 169 MiB data, 884 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:48:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"}]': finished 2024-09-21T17:48:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi042-71285-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi042-71275-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[29361]: osdmap e105: 8 total, 8 up, 8 in 2024-09-21T17:48:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:04.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[38309]: pgmap v108: 484 pgs: 31 creating+peering, 123 unknown, 330 active+clean; 169 MiB data, 884 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:48:04.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"}]': finished 2024-09-21T17:48:04.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi042-71285-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi042-71275-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[38309]: osdmap e105: 8 total, 8 up, 8 in 2024-09-21T17:48:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:04 smithi162 ceph-mon[32106]: pgmap v108: 484 pgs: 31 creating+peering, 123 unknown, 330 active+clean; 169 MiB data, 884 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:48:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi042-71622-10"}]': finished 2024-09-21T17:48:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi042-71285-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi042-71275-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:04 smithi162 ceph-mon[32106]: osdmap e105: 8 total, 8 up, 8 in 2024-09-21T17:48:04.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3978665958' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:04.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"} : dispatch 2024-09-21T17:48:04.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:05.124 INFO:tasks.workunit.client.0.smithi042.stdout: io: Running main() from gmock_main.cc 2024-09-21T17:48:05.124 INFO:tasks.workunit.client.0.smithi042.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-09-21T17:48:05.124 INFO:tasks.workunit.client.0.smithi042.stdout: io: [----------] Global test environment set-up. 2024-09-21T17:48:05.124 INFO:tasks.workunit.client.0.smithi042.stdout: io: [----------] 14 tests from NeoRadosIo 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.Limits (2382 ms) 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (3011 ms) 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.ReadOp (3022 ms) 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.SparseRead (2612 ms) 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.RoundTrip (3016 ms) 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (3014 ms) 2024-09-21T17:48:05.125 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3022 ms) 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (3035 ms) 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (2941 ms) 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.Trunc (3026 ms) 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.Remove (2975 ms) 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3052 ms) 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.RmXattr (3003 ms) 2024-09-21T17:48:05.126 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-09-21T17:48:05.127 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ OK ] NeoRadosIo.GetXattrs (2928 ms) 2024-09-21T17:48:05.127 INFO:tasks.workunit.client.0.smithi042.stdout: io: [----------] 14 tests from NeoRadosIo (41040 ms total) 2024-09-21T17:48:05.127 INFO:tasks.workunit.client.0.smithi042.stdout: io: 2024-09-21T17:48:05.127 INFO:tasks.workunit.client.0.smithi042.stdout: io: [----------] Global test environment tear-down 2024-09-21T17:48:05.127 INFO:tasks.workunit.client.0.smithi042.stdout: io: [==========] 14 tests from 1 test suite ran. (41040 ms total) 2024-09-21T17:48:05.127 INFO:tasks.workunit.client.0.smithi042.stdout: io: [ PASSED ] 14 tests. 2024-09-21T17:48:05.132 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: Running main() from gmock_main.cc 2024-09-21T17:48:05.132 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-09-21T17:48:05.132 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [----------] Global test environment set-up. 2024-09-21T17:48:05.132 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-09-21T17:48:05.132 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-09-21T17:48:05.132 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (2300 ms) 2024-09-21T17:48:05.132 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-09-21T17:48:05.132 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (3015 ms) 2024-09-21T17:48:05.132 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3033 ms) 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (2607 ms) 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (3014 ms) 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (3007 ms) 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (3029 ms) 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (3022 ms) 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (2989 ms) 2024-09-21T17:48:05.133 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (2986 ms) 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (2969 ms) 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3020 ms) 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (3029 ms) 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (2940 ms) 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (40960 ms total) 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [----------] Global test environment tear-down 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (40960 ms total) 2024-09-21T17:48:05.134 INFO:tasks.workunit.client.0.smithi042.stdout: read_operations: [ PASSED ] 14 tests. 2024-09-21T17:48:06.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"}]': finished 2024-09-21T17:48:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: osdmap e106: 8 total, 8 up, 8 in 2024-09-21T17:48:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[29361]: pgmap v111: 356 pgs: 32 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 4 op/s 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"}]': finished 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: osdmap e106: 8 total, 8 up, 8 in 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:06.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:06 smithi042 ceph-mon[38309]: pgmap v111: 356 pgs: 32 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 4 op/s 2024-09-21T17:48:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi042-71622-10"}]': finished 2024-09-21T17:48:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: osdmap e106: 8 total, 8 up, 8 in 2024-09-21T17:48:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:06 smithi162 ceph-mon[32106]: pgmap v111: 356 pgs: 32 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 4 op/s 2024-09-21T17:48:07.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:07.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: osdmap e107: 8 total, 8 up, 8 in 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2213233150' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi042-71285-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3715092491' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi042-71275-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi042-71285-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi042-71275-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:07.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:07.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: osdmap e107: 8 total, 8 up, 8 in 2024-09-21T17:48:07.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:07.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:07.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2213233150' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi042-71285-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3715092491' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi042-71275-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi042-71285-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi042-71275-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:07.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:07 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:48:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: osdmap e107: 8 total, 8 up, 8 in 2024-09-21T17:48:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2213233150' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi042-71285-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3715092491' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi042-71275-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi042-71285-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi042-71275-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:07.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:07.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:07 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:48:08.126 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi042-71285-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:08.126 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi042-71275-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:08.126 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:08 smithi042 ceph-mon[29361]: osdmap e108: 8 total, 8 up, 8 in 2024-09-21T17:48:08.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:08.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:08 smithi042 ceph-mon[29361]: pgmap v114: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 12 MiB/s wr, 2 op/s 2024-09-21T17:48:08.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi042-71285-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:08.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi042-71275-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:08.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:08 smithi042 ceph-mon[38309]: osdmap e108: 8 total, 8 up, 8 in 2024-09-21T17:48:08.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:08.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:08 smithi042 ceph-mon[38309]: pgmap v114: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 12 MiB/s wr, 2 op/s 2024-09-21T17:48:08.456 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi042-71285-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:08.456 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi042-71275-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:08.456 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:08 smithi162 ceph-mon[32106]: osdmap e108: 8 total, 8 up, 8 in 2024-09-21T17:48:08.456 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:08.456 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:08 smithi162 ceph-mon[32106]: pgmap v114: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 12 MiB/s wr, 2 op/s 2024-09-21T17:48:08.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:48:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:48:09.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"}]': finished 2024-09-21T17:48:09.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:09 smithi162 ceph-mon[32106]: osdmap e109: 8 total, 8 up, 8 in 2024-09-21T17:48:09.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:09.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:09 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:09.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:09 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:09.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:09 smithi162 ceph-mon[32106]: osdmap e110: 8 total, 8 up, 8 in 2024-09-21T17:48:09.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3463735933' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi042-71285-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:09.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi042-71285-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:09.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2535098652' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi042-71275-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:09.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi042-71275-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:09.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"}]': finished 2024-09-21T17:48:09.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[29361]: osdmap e109: 8 total, 8 up, 8 in 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[29361]: osdmap e110: 8 total, 8 up, 8 in 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3463735933' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi042-71285-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi042-71285-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2535098652' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi042-71275-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi042-71275-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi042-71622-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"}]': finished 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[38309]: osdmap e109: 8 total, 8 up, 8 in 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:09.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:09.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:09.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[38309]: osdmap e110: 8 total, 8 up, 8 in 2024-09-21T17:48:09.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3463735933' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi042-71285-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:09.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi042-71285-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:09.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2535098652' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi042-71275-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:09.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi042-71275-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:10.412 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:10.412 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:10.412 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:10 smithi162 ceph-mon[32106]: pgmap v117: 428 pgs: 96 unknown, 8 creating+peering, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T17:48:10.412 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi042-71285-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:10.412 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi042-71275-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:10.412 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:10 smithi162 ceph-mon[32106]: osdmap e111: 8 total, 8 up, 8 in 2024-09-21T17:48:10.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:10.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:10.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[29361]: pgmap v117: 428 pgs: 96 unknown, 8 creating+peering, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T17:48:10.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi042-71285-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:10.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi042-71275-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:10.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[29361]: osdmap e111: 8 total, 8 up, 8 in 2024-09-21T17:48:10.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:10.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:10.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[38309]: pgmap v117: 428 pgs: 96 unknown, 8 creating+peering, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T17:48:10.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi042-71285-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:10.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi042-71275-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:10.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:10 smithi042 ceph-mon[38309]: osdmap e111: 8 total, 8 up, 8 in 2024-09-21T17:48:11.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:48:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:48:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:48:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: osdmap e112: 8 total, 8 up, 8 in 2024-09-21T17:48:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:11.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: osdmap e112: 8 total, 8 up, 8 in 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:11.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:48:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:48:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:48:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: osdmap e112: 8 total, 8 up, 8 in 2024-09-21T17:48:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[29361]: pgmap v120: 364 pgs: 32 unknown, 8 creating+peering, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-13"}]': finished 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[29361]: osdmap e113: 8 total, 8 up, 8 in 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-13", "mode": "writeback"} : dispatch 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-13", "mode": "writeback"} : dispatch 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1429022176' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi042-71275-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2222620130' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushPP_smithi042-71285-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi042-71275-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushPP_smithi042-71285-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:12.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[38309]: pgmap v120: 364 pgs: 32 unknown, 8 creating+peering, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T17:48:12.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-13"}]': finished 2024-09-21T17:48:12.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[38309]: osdmap e113: 8 total, 8 up, 8 in 2024-09-21T17:48:12.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-13", "mode": "writeback"} : dispatch 2024-09-21T17:48:12.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-13", "mode": "writeback"} : dispatch 2024-09-21T17:48:12.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1429022176' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi042-71275-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:12.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2222620130' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushPP_smithi042-71285-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:12.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi042-71275-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:12.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushPP_smithi042-71285-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:12 smithi162 ceph-mon[32106]: pgmap v120: 364 pgs: 32 unknown, 8 creating+peering, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T17:48:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-13"}]': finished 2024-09-21T17:48:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:12 smithi162 ceph-mon[32106]: osdmap e113: 8 total, 8 up, 8 in 2024-09-21T17:48:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-13", "mode": "writeback"} : dispatch 2024-09-21T17:48:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-13", "mode": "writeback"} : dispatch 2024-09-21T17:48:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1429022176' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi042-71275-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2222620130' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushPP_smithi042-71285-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi042-71275-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushPP_smithi042-71285-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:13.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:13.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:13.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:13.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:48:13.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-13", "mode": "writeback"}]': finished 2024-09-21T17:48:13.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi042-71275-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:13.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi042-71285-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:13.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[29361]: osdmap e114: 8 total, 8 up, 8 in 2024-09-21T17:48:13.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:13.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:13.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:13.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:48:13.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-13", "mode": "writeback"}]': finished 2024-09-21T17:48:13.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi042-71275-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:13.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi042-71285-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:13.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-mon[38309]: osdmap e114: 8 total, 8 up, 8 in 2024-09-21T17:48:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:13 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:13 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:48:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-13", "mode": "writeback"}]': finished 2024-09-21T17:48:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi042-71275-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi042-71285-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:13 smithi162 ceph-mon[32106]: osdmap e114: 8 total, 8 up, 8 in 2024-09-21T17:48:14.163 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:48:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:48:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:48:14.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:14.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: pgmap v123: 428 pgs: 63 unknown, 5 creating+peering, 360 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 19 KiB/s wr, 23 op/s 2024-09-21T17:48:14.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.0"} : dispatch 2024-09-21T17:48:14.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.1"} : dispatch 2024-09-21T17:48:14.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.2"} : dispatch 2024-09-21T17:48:14.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.3"} : dispatch 2024-09-21T17:48:14.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.4"} : dispatch 2024-09-21T17:48:14.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.5"} : dispatch 2024-09-21T17:48:14.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.6"} : dispatch 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.7"} : dispatch 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.8"} : dispatch 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.9"} : dispatch 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[29361]: osdmap e115: 8 total, 8 up, 8 in 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: pgmap v123: 428 pgs: 63 unknown, 5 creating+peering, 360 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 19 KiB/s wr, 23 op/s 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.0"} : dispatch 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.1"} : dispatch 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.2"} : dispatch 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.3"} : dispatch 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.4"} : dispatch 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.5"} : dispatch 2024-09-21T17:48:14.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.6"} : dispatch 2024-09-21T17:48:14.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.7"} : dispatch 2024-09-21T17:48:14.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.8"} : dispatch 2024-09-21T17:48:14.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.9"} : dispatch 2024-09-21T17:48:14.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:14 smithi042 ceph-mon[38309]: osdmap e115: 8 total, 8 up, 8 in 2024-09-21T17:48:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: pgmap v123: 428 pgs: 63 unknown, 5 creating+peering, 360 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 19 KiB/s wr, 23 op/s 2024-09-21T17:48:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.0"} : dispatch 2024-09-21T17:48:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.1"} : dispatch 2024-09-21T17:48:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.2"} : dispatch 2024-09-21T17:48:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.3"} : dispatch 2024-09-21T17:48:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.4"} : dispatch 2024-09-21T17:48:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.5"} : dispatch 2024-09-21T17:48:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.6"} : dispatch 2024-09-21T17:48:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.7"} : dispatch 2024-09-21T17:48:14.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.8"} : dispatch 2024-09-21T17:48:14.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "173.9"} : dispatch 2024-09-21T17:48:14.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:14 smithi162 ceph-mon[32106]: osdmap e115: 8 total, 8 up, 8 in 2024-09-21T17:48:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.0"}]: dispatch 2024-09-21T17:48:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.1"}]: dispatch 2024-09-21T17:48:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.2"}]: dispatch 2024-09-21T17:48:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.3"}]: dispatch 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.4"}]: dispatch 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.5"}]: dispatch 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.6"}]: dispatch 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.7"}]: dispatch 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.8"}]: dispatch 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.9"}]: dispatch 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: 173.2 scrub starts 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: 173.2 scrub ok 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: 173.8 scrub starts 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: 173.8 scrub ok 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: 173.0 scrub starts 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: 173.0 scrub ok 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: 173.9 scrub starts 2024-09-21T17:48:15.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: 173.9 scrub ok 2024-09-21T17:48:15.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: 173.6 scrub starts 2024-09-21T17:48:15.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: 173.6 scrub ok 2024-09-21T17:48:15.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: osdmap e116: 8 total, 8 up, 8 in 2024-09-21T17:48:15.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/161717347' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi042-71285-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:15.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3706166580' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi042-71275-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:15.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi042-71285-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.0"}]: dispatch 2024-09-21T17:48:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.1"}]: dispatch 2024-09-21T17:48:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.2"}]: dispatch 2024-09-21T17:48:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.3"}]: dispatch 2024-09-21T17:48:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.4"}]: dispatch 2024-09-21T17:48:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.5"}]: dispatch 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.6"}]: dispatch 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.7"}]: dispatch 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.8"}]: dispatch 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.9"}]: dispatch 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: 173.2 scrub starts 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: 173.2 scrub ok 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: 173.8 scrub starts 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: 173.8 scrub ok 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: 173.0 scrub starts 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: 173.0 scrub ok 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: 173.9 scrub starts 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: 173.9 scrub ok 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: 173.6 scrub starts 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: 173.6 scrub ok 2024-09-21T17:48:15.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: osdmap e116: 8 total, 8 up, 8 in 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/161717347' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi042-71285-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3706166580' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi042-71275-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi042-71285-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.0"}]: dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.1"}]: dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.2"}]: dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.3"}]: dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.4"}]: dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.5"}]: dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.6"}]: dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.7"}]: dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.8"}]: dispatch 2024-09-21T17:48:15.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "173.9"}]: dispatch 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: 173.2 scrub starts 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: 173.2 scrub ok 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: 173.8 scrub starts 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: 173.8 scrub ok 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: 173.0 scrub starts 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: 173.0 scrub ok 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: 173.9 scrub starts 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: 173.9 scrub ok 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: 173.6 scrub starts 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: 173.6 scrub ok 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: osdmap e116: 8 total, 8 up, 8 in 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/161717347' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi042-71285-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3706166580' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi042-71275-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:15.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi042-71285-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:16 smithi162 ceph-mon[32106]: 173.4 scrub starts 2024-09-21T17:48:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:16 smithi162 ceph-mon[32106]: 173.4 scrub ok 2024-09-21T17:48:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:16 smithi162 ceph-mon[32106]: 173.1 scrub starts 2024-09-21T17:48:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:16 smithi162 ceph-mon[32106]: 173.1 scrub ok 2024-09-21T17:48:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:16 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:16 smithi162 ceph-mon[32106]: pgmap v126: 428 pgs: 96 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 10 KiB/s rd, 61 KiB/s wr, 71 op/s 2024-09-21T17:48:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:16 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3706166580' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi042-71275-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:16 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi042-71285-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:16 smithi162 ceph-mon[32106]: osdmap e117: 8 total, 8 up, 8 in 2024-09-21T17:48:16.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[29361]: 173.4 scrub starts 2024-09-21T17:48:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[29361]: 173.4 scrub ok 2024-09-21T17:48:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[29361]: 173.1 scrub starts 2024-09-21T17:48:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[29361]: 173.1 scrub ok 2024-09-21T17:48:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[29361]: pgmap v126: 428 pgs: 96 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 10 KiB/s rd, 61 KiB/s wr, 71 op/s 2024-09-21T17:48:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3706166580' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi042-71275-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi042-71285-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[29361]: osdmap e117: 8 total, 8 up, 8 in 2024-09-21T17:48:16.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[38309]: 173.4 scrub starts 2024-09-21T17:48:16.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[38309]: 173.4 scrub ok 2024-09-21T17:48:16.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[38309]: 173.1 scrub starts 2024-09-21T17:48:16.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[38309]: 173.1 scrub ok 2024-09-21T17:48:16.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:16.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[38309]: pgmap v126: 428 pgs: 96 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 10 KiB/s rd, 61 KiB/s wr, 71 op/s 2024-09-21T17:48:16.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3706166580' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi042-71275-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:16.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi042-71285-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:16.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:16 smithi042 ceph-mon[38309]: osdmap e117: 8 total, 8 up, 8 in 2024-09-21T17:48:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:17 smithi162 ceph-mon[32106]: 173.5 scrub starts 2024-09-21T17:48:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:17 smithi162 ceph-mon[32106]: 173.5 scrub ok 2024-09-21T17:48:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:17 smithi162 ceph-mon[32106]: 173.3 scrub starts 2024-09-21T17:48:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:17 smithi162 ceph-mon[32106]: 173.3 scrub ok 2024-09-21T17:48:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:17 smithi162 ceph-mon[32106]: osdmap e118: 8 total, 8 up, 8 in 2024-09-21T17:48:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:17.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[29361]: 173.5 scrub starts 2024-09-21T17:48:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[29361]: 173.5 scrub ok 2024-09-21T17:48:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[29361]: 173.3 scrub starts 2024-09-21T17:48:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[29361]: 173.3 scrub ok 2024-09-21T17:48:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[29361]: osdmap e118: 8 total, 8 up, 8 in 2024-09-21T17:48:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[38309]: 173.5 scrub starts 2024-09-21T17:48:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[38309]: 173.5 scrub ok 2024-09-21T17:48:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[38309]: 173.3 scrub starts 2024-09-21T17:48:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[38309]: 173.3 scrub ok 2024-09-21T17:48:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[38309]: osdmap e118: 8 total, 8 up, 8 in 2024-09-21T17:48:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-mon[32106]: 173.7 scrub starts 2024-09-21T17:48:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-mon[32106]: 173.7 scrub ok 2024-09-21T17:48:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-mon[32106]: pgmap v129: 356 pgs: 32 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.5 KiB/s rd, 36 KiB/s wr, 46 op/s 2024-09-21T17:48:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"}]': finished 2024-09-21T17:48:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-mon[32106]: osdmap e119: 8 total, 8 up, 8 in 2024-09-21T17:48:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:18.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:18.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/206767900' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStat_smithi042-71275-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:18.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStat_smithi042-71275-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:18.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1120797323' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi042-71285-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:18.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[29361]: 173.7 scrub starts 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[29361]: 173.7 scrub ok 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[29361]: pgmap v129: 356 pgs: 32 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.5 KiB/s rd, 36 KiB/s wr, 46 op/s 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"}]': finished 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[29361]: osdmap e119: 8 total, 8 up, 8 in 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/206767900' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStat_smithi042-71275-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStat_smithi042-71275-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1120797323' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi042-71285-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[38309]: 173.7 scrub starts 2024-09-21T17:48:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[38309]: 173.7 scrub ok 2024-09-21T17:48:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[38309]: pgmap v129: 356 pgs: 32 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.5 KiB/s rd, 36 KiB/s wr, 46 op/s 2024-09-21T17:48:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"}]': finished 2024-09-21T17:48:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[38309]: osdmap e119: 8 total, 8 up, 8 in 2024-09-21T17:48:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2029183880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"} : dispatch 2024-09-21T17:48:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/206767900' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStat_smithi042-71275-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStat_smithi042-71275-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1120797323' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi042-71285-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:19.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:48:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:48:19.139 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: Running main() from gmock_main.cc 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [----------] Global test environment set-up. 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (2012 ms) 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2014 ms) 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2012 ms) 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (1998 ms) 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (8036 ms total) 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-21T17:48:19.140 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4106 ms) 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (4086 ms) 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (4870 ms) 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (13062 ms total) 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (2975 ms) 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2053 ms) 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (1958 ms) 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2019 ms) 2024-09-21T17:48:19.141 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (9005 ms total) 2024-09-21T17:48:19.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: 2024-09-21T17:48:19.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-21T17:48:19.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-21T17:48:19.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4001 ms) 2024-09-21T17:48:19.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-21T17:48:19.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4018 ms) 2024-09-21T17:48:19.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8019 ms total) 2024-09-21T17:48:19.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: 2024-09-21T17:48:19.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [----------] Global test environment tear-down 2024-09-21T17:48:19.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (55325 ms total) 2024-09-21T17:48:19.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-09-21T17:48:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:19 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"}]': finished 2024-09-21T17:48:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi042-71275-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1120797323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi042-71285-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:19 smithi162 ceph-mon[32106]: osdmap e120: 8 total, 8 up, 8 in 2024-09-21T17:48:19.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:19.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:19.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"}]': finished 2024-09-21T17:48:19.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi042-71275-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1120797323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi042-71285-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[29361]: osdmap e120: 8 total, 8 up, 8 in 2024-09-21T17:48:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi042-71622-15"}]': finished 2024-09-21T17:48:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi042-71275-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1120797323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi042-71285-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:19 smithi042 ceph-mon[38309]: osdmap e120: 8 total, 8 up, 8 in 2024-09-21T17:48:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:20 smithi162 ceph-mon[32106]: pgmap v132: 388 pgs: 32 unknown, 64 creating+peering, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 47 KiB/s rd, 59 op/s 2024-09-21T17:48:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:20 smithi162 ceph-mon[32106]: osdmap e121: 8 total, 8 up, 8 in 2024-09-21T17:48:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3876804401' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71684-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71684-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[29361]: pgmap v132: 388 pgs: 32 unknown, 64 creating+peering, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 47 KiB/s rd, 59 op/s 2024-09-21T17:48:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[29361]: osdmap e121: 8 total, 8 up, 8 in 2024-09-21T17:48:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3876804401' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71684-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71684-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[38309]: pgmap v132: 388 pgs: 32 unknown, 64 creating+peering, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 47 KiB/s rd, 59 op/s 2024-09-21T17:48:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[38309]: osdmap e121: 8 total, 8 up, 8 in 2024-09-21T17:48:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3876804401' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71684-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71684-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71684-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:21 smithi162 ceph-mon[32106]: osdmap e122: 8 total, 8 up, 8 in 2024-09-21T17:48:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3292580892' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71275-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2545543594' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71275-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:21.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71684-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[29361]: osdmap e122: 8 total, 8 up, 8 in 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3292580892' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71275-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2545543594' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71275-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71684-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[38309]: osdmap e122: 8 total, 8 up, 8 in 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3292580892' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71275-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2545543594' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71275-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:22 smithi162 ceph-mon[32106]: pgmap v135: 420 pgs: 128 unknown, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 49 KiB/s rd, 60 op/s 2024-09-21T17:48:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71275-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:22 smithi162 ceph-mon[32106]: osdmap e123: 8 total, 8 up, 8 in 2024-09-21T17:48:22.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:22 smithi042 ceph-mon[29361]: pgmap v135: 420 pgs: 128 unknown, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 49 KiB/s rd, 60 op/s 2024-09-21T17:48:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71275-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:22 smithi042 ceph-mon[29361]: osdmap e123: 8 total, 8 up, 8 in 2024-09-21T17:48:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:22 smithi042 ceph-mon[38309]: pgmap v135: 420 pgs: 128 unknown, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 49 KiB/s rd, 60 op/s 2024-09-21T17:48:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71275-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:22 smithi042 ceph-mon[38309]: osdmap e123: 8 total, 8 up, 8 in 2024-09-21T17:48:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:24.133 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:48:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:48:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:48:24.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:24 smithi042 ceph-mon[29361]: osdmap e124: 8 total, 8 up, 8 in 2024-09-21T17:48:24.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:24.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:24 smithi042 ceph-mon[29361]: pgmap v138: 356 pgs: 41 unknown, 315 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:48:24.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:24 smithi042 ceph-mon[29361]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:24.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:24 smithi042 ceph-mon[38309]: osdmap e124: 8 total, 8 up, 8 in 2024-09-21T17:48:24.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:24.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:24 smithi042 ceph-mon[38309]: pgmap v138: 356 pgs: 41 unknown, 315 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:48:24.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:24 smithi042 ceph-mon[38309]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:24 smithi162 ceph-mon[32106]: osdmap e124: 8 total, 8 up, 8 in 2024-09-21T17:48:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:24 smithi162 ceph-mon[32106]: pgmap v138: 356 pgs: 41 unknown, 315 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:48:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:24 smithi162 ceph-mon[32106]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:25.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[29361]: osdmap e125: 8 total, 8 up, 8 in 2024-09-21T17:48:25.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3485767271' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi042-71275-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi042-71275-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3066876978' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi042-71285-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi042-71285-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:25.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:25.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:25.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:25.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[38309]: osdmap e125: 8 total, 8 up, 8 in 2024-09-21T17:48:25.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3485767271' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi042-71275-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi042-71275-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3066876978' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi042-71285-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi042-71285-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:25.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:25.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:25.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:25 smithi162 ceph-mon[32106]: osdmap e125: 8 total, 8 up, 8 in 2024-09-21T17:48:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3485767271' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi042-71275-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi042-71275-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3066876978' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi042-71285-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi042-71285-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:25.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:25.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:26.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi042-71275-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:26.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi042-71285-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:26.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:26.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[38309]: osdmap e126: 8 total, 8 up, 8 in 2024-09-21T17:48:26.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi042-71684-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:26.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:26.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[38309]: pgmap v141: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:48:26.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi042-71275-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:26.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi042-71285-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:26.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:26.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[29361]: osdmap e126: 8 total, 8 up, 8 in 2024-09-21T17:48:26.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi042-71684-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:26.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:26.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:26 smithi042 ceph-mon[29361]: pgmap v141: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:48:26.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi042-71275-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi042-71285-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:26 smithi162 ceph-mon[32106]: osdmap e126: 8 total, 8 up, 8 in 2024-09-21T17:48:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi042-71684-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:26 smithi162 ceph-mon[32106]: pgmap v141: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:48:27.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[29361]: osdmap e127: 8 total, 8 up, 8 in 2024-09-21T17:48:27.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:27.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi042-71684-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"}]': finished 2024-09-21T17:48:27.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[29361]: osdmap e128: 8 total, 8 up, 8 in 2024-09-21T17:48:27.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/297465877' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi042-71285-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:27.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi042-71285-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:27.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4186153515' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi042-71275-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:27.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[38309]: osdmap e127: 8 total, 8 up, 8 in 2024-09-21T17:48:27.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:27.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi042-71684-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"}]': finished 2024-09-21T17:48:27.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[38309]: osdmap e128: 8 total, 8 up, 8 in 2024-09-21T17:48:27.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/297465877' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi042-71285-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:27.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi042-71285-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:27.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4186153515' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi042-71275-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:27 smithi162 ceph-mon[32106]: osdmap e127: 8 total, 8 up, 8 in 2024-09-21T17:48:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi042-71684-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"}]': finished 2024-09-21T17:48:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:27 smithi162 ceph-mon[32106]: osdmap e128: 8 total, 8 up, 8 in 2024-09-21T17:48:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/297465877' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi042-71285-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi042-71285-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4186153515' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi042-71275-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:28 smithi162 ceph-mon[32106]: pgmap v144: 396 pgs: 72 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:48:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi042-71285-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4186153515' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi042-71275-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:28 smithi162 ceph-mon[32106]: osdmap e129: 8 total, 8 up, 8 in 2024-09-21T17:48:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[29361]: pgmap v144: 396 pgs: 72 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi042-71285-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4186153515' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi042-71275-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[29361]: osdmap e129: 8 total, 8 up, 8 in 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[38309]: pgmap v144: 396 pgs: 72 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi042-71285-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4186153515' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi042-71275-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:28 smithi042 ceph-mon[38309]: osdmap e129: 8 total, 8 up, 8 in 2024-09-21T17:48:29.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:48:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:48:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T17:48:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:29 smithi162 ceph-mon[32106]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:29 smithi162 ceph-mon[32106]: osdmap e130: 8 total, 8 up, 8 in 2024-09-21T17:48:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2"} : dispatch 2024-09-21T17:48:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:29.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:29.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T17:48:29.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[29361]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[29361]: osdmap e130: 8 total, 8 up, 8 in 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2"} : dispatch 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[38309]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[38309]: osdmap e130: 8 total, 8 up, 8 in 2024-09-21T17:48:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2"} : dispatch 2024-09-21T17:48:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: pgmap v147: 332 pgs: 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:48:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "31"} : dispatch 2024-09-21T17:48:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-21T17:48:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: osdmap e131: 8 total, 8 up, 8 in 2024-09-21T17:48:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"dne","key":"key1","value":"value1"} : dispatch 2024-09-21T17:48:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2785018798' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi042-71275-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T17:48:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi042-71275-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T17:48:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1837338695' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi042-71285-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:30.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: pgmap v147: 332 pgs: 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "31"} : dispatch 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: osdmap e131: 8 total, 8 up, 8 in 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"dne","key":"key1","value":"value1"} : dispatch 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2785018798' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi042-71275-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi042-71275-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T17:48:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1837338695' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi042-71285-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: pgmap v147: 332 pgs: 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "31"} : dispatch 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi042-71531-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: osdmap e131: 8 total, 8 up, 8 in 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"dne","key":"key1","value":"value1"} : dispatch 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2785018798' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi042-71275-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi042-71275-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T17:48:30.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1837338695' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi042-71285-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi042-71275-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T17:48:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1837338695' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi042-71285-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:31 smithi162 ceph-mon[32106]: osdmap e132: 8 total, 8 up, 8 in 2024-09-21T17:48:31.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T17:48:31.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T17:48:31.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:31.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi042-71275-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:31.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T17:48:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1837338695' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi042-71285-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[29361]: osdmap e132: 8 total, 8 up, 8 in 2024-09-21T17:48:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T17:48:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T17:48:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi042-71275-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T17:48:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1837338695' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi042-71285-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[38309]: osdmap e132: 8 total, 8 up, 8 in 2024-09-21T17:48:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T17:48:31.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T17:48:32.128 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2024-09-21T17:48:32.128 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: seed 71684 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (2021 ms) 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2009 ms) 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2015 ms) 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1994 ms) 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3637 ms) 2024-09-21T17:48:32.129 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (11676 ms total) 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4172 ms) 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3877 ms) 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (5948 ms) 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4041 ms) 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2101 ms) 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-21T17:48:32.130 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5129-g0ecbb435/rpm/el9/BUILD/ceph-19.3.0-5129-g0ecbb435/src/test/librados/snapshots_cxx.cc:460: Skipped 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi042-71684-7 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: waiting for snaps to purge 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17897 ms) 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (38036 ms total) 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (10 ms) 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5031 ms) 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5041 ms total) 2024-09-21T17:48:32.131 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: 2024-09-21T17:48:32.132 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-09-21T17:48:32.132 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-21T17:48:32.132 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (2972 ms) 2024-09-21T17:48:32.132 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-21T17:48:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: pgmap v150: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:48:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T17:48:32.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"}]': finished 2024-09-21T17:48:32.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: osdmap e133: 8 total, 8 up, 8 in 2024-09-21T17:48:32.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:32.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:32.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:32.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:32.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1"} : dispatch 2024-09-21T17:48:32.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1"} : dispatch 2024-09-21T17:48:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: pgmap v150: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"}]': finished 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: osdmap e133: 8 total, 8 up, 8 in 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1"} : dispatch 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1"} : dispatch 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T17:48:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: pgmap v150: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:48:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T17:48:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pg_num","val":"11"}]': finished 2024-09-21T17:48:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: osdmap e133: 8 total, 8 up, 8 in 2024-09-21T17:48:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T17:48:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4136282019' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1"} : dispatch 2024-09-21T17:48:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1"} : dispatch 2024-09-21T17:48:34.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRados api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-09-21T17:48:34.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-09-21T17:48:34.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-09-21T17:48:34.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-09-21T17:48:34.142 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-21T17:48:34.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-21T17:48:34.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: 2024-09-21T17:48:34.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-09-21T17:48:34.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: seed 71531 2024-09-21T17:48:34.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-21T17:48:34.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (2 ms) 2024-09-21T17:48:34.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-09-21T17:48:34.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (369 ms) 2024-09-21T17:48:34.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-21T17:48:34.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (17 ms) 2024-09-21T17:48:34.143 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (17 ms) 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (14 ms) 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (5 ms) 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (3 ms) 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (7 ms) 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (4 ms) 2024-09-21T17:48:34.144 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (10 ms) 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (3 ms) 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (5 ms) 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (11 ms) 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: osd_max_attr_size = 0 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (1826 ms) 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-09-21T17:48:34.145 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (349 ms) 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: done waiting, doing copies 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: waiting for final deep scrubs... 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: done waiting 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60656 ms) 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (5 ms) 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (2 ms) 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4387 ms) 2024-09-21T17:48:34.146 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-21T17:48:34.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-21T17:48:34.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-21T17:48:34.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-21T17:48:34.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-09-21T17:48:34.147 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-21T17:48:34.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T17:48:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1"}]': finished 2024-09-21T17:48:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[29361]: osdmap e134: 8 total, 8 up, 8 in 2024-09-21T17:48:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2122935336' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClass_smithi042-71275-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2167751186' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi042-71285-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[29361]: pgmap v153: 396 pgs: 25 creating+peering, 39 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s; 31 B/s, 0 objects/s recovering 2024-09-21T17:48:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pg_num_actual", "val": "31"} : dispatch 2024-09-21T17:48:34.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:34.165 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:48:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:48:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:48:34.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T17:48:34.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1"}]': finished 2024-09-21T17:48:34.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[38309]: osdmap e134: 8 total, 8 up, 8 in 2024-09-21T17:48:34.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2122935336' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClass_smithi042-71275-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:34.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2167751186' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi042-71285-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:34.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:34.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[38309]: pgmap v153: 396 pgs: 25 creating+peering, 39 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s; 31 B/s, 0 objects/s recovering 2024-09-21T17:48:34.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pg_num_actual", "val": "31"} : dispatch 2024-09-21T17:48:34.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:34 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi042-71351-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T17:48:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi042-71531-1","app":"app1","key":"key1"}]': finished 2024-09-21T17:48:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:34 smithi162 ceph-mon[32106]: osdmap e134: 8 total, 8 up, 8 in 2024-09-21T17:48:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2122935336' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClass_smithi042-71275-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2167751186' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi042-71285-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:34 smithi162 ceph-mon[32106]: pgmap v153: 396 pgs: 25 creating+peering, 39 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s; 31 B/s, 0 objects/s recovering 2024-09-21T17:48:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:34 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pg_num_actual", "val": "31"} : dispatch 2024-09-21T17:48:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:34 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2122935336' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi042-71275-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2167751186' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi042-71285-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-21T17:48:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[29361]: osdmap e135: 8 total, 8 up, 8 in 2024-09-21T17:48:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71531-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:35.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71531-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:35.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2122935336' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi042-71275-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:35.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2167751186' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi042-71285-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:35.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-21T17:48:35.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[38309]: osdmap e135: 8 total, 8 up, 8 in 2024-09-21T17:48:35.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:35.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71531-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:35.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71531-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2122935336' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi042-71275-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2167751186' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi042-71285-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:35 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-21T17:48:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:35 smithi162 ceph-mon[32106]: osdmap e135: 8 total, 8 up, 8 in 2024-09-21T17:48:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:35.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:35.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71531-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:35.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71531-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71531-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[29361]: osdmap e136: 8 total, 8 up, 8 in 2024-09-21T17:48:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71531-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71531-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[29361]: pgmap v156: 300 pgs: 300 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 31 B/s, 0 objects/s recovering 2024-09-21T17:48:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "30"} : dispatch 2024-09-21T17:48:36.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-21T17:48:36.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71531-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:36.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[38309]: osdmap e136: 8 total, 8 up, 8 in 2024-09-21T17:48:36.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71531-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:36.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:36.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71531-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:36.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[38309]: pgmap v156: 300 pgs: 300 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 31 B/s, 0 objects/s recovering 2024-09-21T17:48:36.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "30"} : dispatch 2024-09-21T17:48:36.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:36 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-21T17:48:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71531-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:36 smithi162 ceph-mon[32106]: osdmap e136: 8 total, 8 up, 8 in 2024-09-21T17:48:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71531-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71531-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:36 smithi162 ceph-mon[32106]: pgmap v156: 300 pgs: 300 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 31 B/s, 0 objects/s recovering 2024-09-21T17:48:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:36 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "30"} : dispatch 2024-09-21T17:48:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:36 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi042-71351-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-21T17:48:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: osdmap e137: 8 total, 8 up, 8 in 2024-09-21T17:48:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/721995694' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71285-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2920132631' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWrite_smithi042-71275-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWrite_smithi042-71275-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71285-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71531-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71531-24"}]': finished 2024-09-21T17:48:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi042-71275-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71285-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: osdmap e138: 8 total, 8 up, 8 in 2024-09-21T17:48:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:37.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: osdmap e137: 8 total, 8 up, 8 in 2024-09-21T17:48:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/721995694' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71285-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2920132631' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWrite_smithi042-71275-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWrite_smithi042-71275-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71285-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71531-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71531-24"}]': finished 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi042-71275-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71285-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: osdmap e138: 8 total, 8 up, 8 in 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: osdmap e137: 8 total, 8 up, 8 in 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/721995694' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71285-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2920132631' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWrite_smithi042-71275-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWrite_smithi042-71275-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71285-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71531-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71531-24"}]': finished 2024-09-21T17:48:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi042-71275-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi042-71285-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: osdmap e138: 8 total, 8 up, 8 in 2024-09-21T17:48:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3846296497' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T17:48:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:38.151 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscP snapshots: Running main() from gmock_main.cc 2024-09-21T17:48:38.151 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-09-21T17:48:38.151 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [----------] Global test environment set-up. 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (4339 ms) 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (4993 ms) 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (3632 ms) 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (5023 ms) 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (6984 ms) 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (24971 ms total) 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-09-21T17:48:38.152 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (5003 ms) 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (6036 ms) 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (7973 ms) 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5979 ms) 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4011 ms) 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi042-72651-11. 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: Waiting for snaps to purge. 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (20019 ms) 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (49021 ms total) 2024-09-21T17:48:38.153 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: 2024-09-21T17:48:38.154 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [----------] Global test environment tear-down 2024-09-21T17:48:38.154 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (73992 ms total) 2024-09-21T17:48:38.154 INFO:tasks.workunit.client.0.smithi042.stdout: snapshots: [ PASSED ] 11 tests. 2024-09-21T17:48:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:38 smithi162 ceph-mon[32106]: pgmap v159: 363 pgs: 72 unknown, 291 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T17:48:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"}]': finished 2024-09-21T17:48:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:38 smithi162 ceph-mon[32106]: osdmap e139: 8 total, 8 up, 8 in 2024-09-21T17:48:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:38.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[29361]: pgmap v159: 363 pgs: 72 unknown, 291 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T17:48:38.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"}]': finished 2024-09-21T17:48:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[29361]: osdmap e139: 8 total, 8 up, 8 in 2024-09-21T17:48:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[38309]: pgmap v159: 363 pgs: 72 unknown, 291 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T17:48:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi042-71684-16"}]': finished 2024-09-21T17:48:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[38309]: osdmap e139: 8 total, 8 up, 8 in 2024-09-21T17:48:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi042-71684-16"} : dispatch 2024-09-21T17:48:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:48:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:48:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi042-71351-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi042-71351-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi042-71684-16"}]': finished 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi042-71351-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosListEC_smithi042-71351-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: osdmap e140: 8 total, 8 up, 8 in 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/542683147' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi042-71285-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosListEC_smithi042-71351-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi042-71285-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2837151024' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi042-71275-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi042-71275-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:39.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:39.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi042-71351-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi042-71351-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi042-71684-16"}]': finished 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi042-71351-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosListEC_smithi042-71351-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: osdmap e140: 8 total, 8 up, 8 in 2024-09-21T17:48:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/542683147' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi042-71285-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosListEC_smithi042-71351-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi042-71285-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2837151024' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi042-71275-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi042-71351-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi042-71351-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2286121214' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi042-71684-16"}]': finished 2024-09-21T17:48:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi042-71351-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosListEC_smithi042-71351-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: osdmap e140: 8 total, 8 up, 8 in 2024-09-21T17:48:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/542683147' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi042-71285-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosListEC_smithi042-71351-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi042-71285-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2837151024' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi042-71275-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi042-71275-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:39.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:39.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:39.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi042-71275-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:39.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:39.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:39.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:40 smithi162 ceph-mon[32106]: pgmap v162: 332 pgs: 64 unknown, 32 creating+peering, 236 active+clean; 590 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:48:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi042-71285-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi042-71275-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:40 smithi162 ceph-mon[32106]: osdmap e141: 8 total, 8 up, 8 in 2024-09-21T17:48:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[29361]: pgmap v162: 332 pgs: 64 unknown, 32 creating+peering, 236 active+clean; 590 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:48:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi042-71285-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi042-71275-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[29361]: osdmap e141: 8 total, 8 up, 8 in 2024-09-21T17:48:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[38309]: pgmap v162: 332 pgs: 64 unknown, 32 creating+peering, 236 active+clean; 590 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:48:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71531-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi042-71285-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi042-71275-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:40.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:40.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[38309]: osdmap e141: 8 total, 8 up, 8 in 2024-09-21T17:48:40.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:41 smithi162 ceph-mon[32106]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi042-71351-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi042-71351-2"}]': finished 2024-09-21T17:48:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:41 smithi162 ceph-mon[32106]: osdmap e142: 8 total, 8 up, 8 in 2024-09-21T17:48:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:41 smithi042 ceph-mon[29361]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi042-71351-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi042-71351-2"}]': finished 2024-09-21T17:48:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:41 smithi042 ceph-mon[29361]: osdmap e142: 8 total, 8 up, 8 in 2024-09-21T17:48:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:41 smithi042 ceph-mon[38309]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi042-71351-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi042-71351-2"}]': finished 2024-09-21T17:48:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:41 smithi042 ceph-mon[38309]: osdmap e142: 8 total, 8 up, 8 in 2024-09-21T17:48:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.214 INFO:tasks.workunit.client.0.smithi042.stdout:st: : entry=2 expected=2 2024-09-21T17:48:42.214 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:89d3ae78:::11:head 2024-09-21T17:48:42.214 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:89d3ae78:::11:head expected=13:89d3ae78:::11:head 2024-09-21T17:48:42.214 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:89d3ae78:::11:head -> 11 2024-09-21T17:48:42.214 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=11 expected=11 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:863748b0:::15:head 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:863748b0:::15:head expected=13:863748b0:::15:head 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:863748b0:::15:head -> 15 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=15 expected=15 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:6cac518f:::0:head 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:6cac518f:::0:head expected=13:6cac518f:::0:head 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:6cac518f:::0:head -> 0 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=0 expected=0 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:02547ec2:::1:head 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:02547ec2:::1:head expected=13:02547ec2:::1:head 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:02547ec2:::1:head -> 1 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=1 expected=1 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:d83876eb:::4:head 2024-09-21T17:48:42.215 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:d83876eb:::4:head expected=13:d83876eb:::4:head 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:d83876eb:::4:head -> 4 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=4 expected=4 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:cfc208b3:::3:head 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:cfc208b3:::3:head expected=13:cfc208b3:::3:head 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:cfc208b3:::3:head -> 3 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=3 expected=3 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:c4fdafeb:::6:head 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:c4fdafeb:::6:head expected=13:c4fdafeb:::6:head 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:c4fdafeb:::6:head -> 6 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=6 expected=6 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : seek to 13:bd63b0f1:::8:head 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : cursor()=13:bd63b0f1:::8:head expected=13:bd63b0f1:::8:head 2024-09-21T17:48:42.216 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: > 13:bd63b0f1:::8:head -> 8 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: : entry=8 expected=8 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (224 ms) 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (64910 ms) 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: split 0/5 -> MIN 13:33333333::::head 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: split 1/5 -> 13:33333333::::head 13:66666666::::head 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: split 2/5 -> 13:66666666::::head 13:99999999::::head 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: split 3/5 -> 13:99999999::::head 13:cccccccc::::head 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: split 4/5 -> 13:cccccccc::::head MAX 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (6028 ms) 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [----------] 7 tests from LibRadosList (71773 ms total) 2024-09-21T17:48:42.217 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1028 ms) 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: myset foo1,foo2,foo3 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo1 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo2 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo3 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: myset foo1,foo4,foo5 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo4 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo5 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo1 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: myset foo6,foo7 2024-09-21T17:48:42.218 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo7 2024-09-21T17:48:42.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: foo6 2024-09-21T17:48:42.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-21T17:48:42.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: ns1:foo4 2024-09-21T17:48:42.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: ns1:foo5 2024-09-21T17:48:42.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: ns2:foo7 2024-09-21T17:48:42.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: ns2:foo6 2024-09-21T17:48:42.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: ns1:foo1 2024-09-21T17:48:42.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: :foo1 2024-09-21T17:48:42.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: :foo2 2024-09-21T17:48:42.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: :foo3 2024-09-21T17:48:42.219 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (33 ms) 2024-09-21T17:48:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi042-71275-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi042-71275-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: pgmap v165: 244 pgs: 8 unknown, 236 active+clean; 590 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:48:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"}]': finished 2024-09-21T17:48:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi042-71275-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: osdmap e143: 8 total, 8 up, 8 in 2024-09-21T17:48:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWrite_smithi042-71275-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2120280029' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemovePP_smithi042-71285-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemovePP_smithi042-71285-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWrite_smithi042-71275-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi042-71275-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi042-71275-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: pgmap v165: 244 pgs: 8 unknown, 236 active+clean; 590 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:48:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"}]': finished 2024-09-21T17:48:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi042-71275-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: osdmap e143: 8 total, 8 up, 8 in 2024-09-21T17:48:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWrite_smithi042-71275-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2120280029' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemovePP_smithi042-71285-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:42.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemovePP_smithi042-71285-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:42.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:42.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWrite_smithi042-71275-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:42.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi042-71275-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:42.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi042-71275-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:42.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: pgmap v165: 244 pgs: 8 unknown, 236 active+clean; 590 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:48:42.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"}]': finished 2024-09-21T17:48:42.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi042-71275-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:42.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: osdmap e143: 8 total, 8 up, 8 in 2024-09-21T17:48:42.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWrite_smithi042-71275-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2120280029' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemovePP_smithi042-71285-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:42.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemovePP_smithi042-71285-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:42.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:42.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWrite_smithi042-71275-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:42.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi042-71285-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"}]': finished 2024-09-21T17:48:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:43 smithi162 ceph-mon[32106]: osdmap e144: 8 total, 8 up, 8 in 2024-09-21T17:48:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi042-71285-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"}]': finished 2024-09-21T17:48:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[29361]: osdmap e144: 8 total, 8 up, 8 in 2024-09-21T17:48:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi042-71285-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71531-24"}]': finished 2024-09-21T17:48:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3599699085' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[38309]: osdmap e144: 8 total, 8 up, 8 in 2024-09-21T17:48:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"} : dispatch 2024-09-21T17:48:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:43.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:44.165 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:48:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:48:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:48:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:44 smithi162 ceph-mon[32106]: pgmap v168: 268 pgs: 27 unknown, 241 active+clean; 590 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:48:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi042-71275-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi042-71275-27"}]': finished 2024-09-21T17:48:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"}]': finished 2024-09-21T17:48:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"}]': finished 2024-09-21T17:48:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:44 smithi162 ceph-mon[32106]: osdmap e145: 8 total, 8 up, 8 in 2024-09-21T17:48:44.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:44.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:44.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[29361]: pgmap v168: 268 pgs: 27 unknown, 241 active+clean; 590 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:48:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi042-71275-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi042-71275-27"}]': finished 2024-09-21T17:48:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"}]': finished 2024-09-21T17:48:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"}]': finished 2024-09-21T17:48:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[29361]: osdmap e145: 8 total, 8 up, 8 in 2024-09-21T17:48:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[38309]: pgmap v168: 268 pgs: 27 unknown, 241 active+clean; 590 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:48:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi042-71275-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi042-71275-27"}]': finished 2024-09-21T17:48:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71531-24"}]': finished 2024-09-21T17:48:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi042-71351-2"}]': finished 2024-09-21T17:48:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[38309]: osdmap e145: 8 total, 8 up, 8 in 2024-09-21T17:48:44.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2042585850' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:44.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"} : dispatch 2024-09-21T17:48:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"}]': finished 2024-09-21T17:48:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:46 smithi162 ceph-mon[32106]: osdmap e146: 8 total, 8 up, 8 in 2024-09-21T17:48:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4022383718' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi042-71285-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi042-71285-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:46.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3690996238' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi042-71531-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:46.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:46 smithi162 ceph-mon[32106]: pgmap v171: 308 pgs: 72 unknown, 236 active+clean; 598 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-09-21T17:48:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"}]': finished 2024-09-21T17:48:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[29361]: osdmap e146: 8 total, 8 up, 8 in 2024-09-21T17:48:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4022383718' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi042-71285-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi042-71285-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3690996238' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi042-71531-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[29361]: pgmap v171: 308 pgs: 72 unknown, 236 active+clean; 598 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-09-21T17:48:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi042-71351-2"}]': finished 2024-09-21T17:48:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[38309]: osdmap e146: 8 total, 8 up, 8 in 2024-09-21T17:48:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4022383718' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi042-71285-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi042-71285-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3690996238' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi042-71531-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:46 smithi042 ceph-mon[38309]: pgmap v171: 308 pgs: 72 unknown, 236 active+clean; 598 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-09-21T17:48:47.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:47.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi042-71285-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:47.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3690996238' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi042-71531-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:47.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: osdmap e147: 8 total, 8 up, 8 in 2024-09-21T17:48:47.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/555245635' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71351-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:47.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:47.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71351-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:47.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:47.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71351-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:47.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"}]': finished 2024-09-21T17:48:47.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: osdmap e148: 8 total, 8 up, 8 in 2024-09-21T17:48:47.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:47.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:47.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:47.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi042-71285-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3690996238' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi042-71531-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: osdmap e147: 8 total, 8 up, 8 in 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/555245635' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71351-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71351-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71351-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"}]': finished 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: osdmap e148: 8 total, 8 up, 8 in 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi042-71285-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3690996238' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi042-71531-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: osdmap e147: 8 total, 8 up, 8 in 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/555245635' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71351-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71351-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71351-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi042-71275-27"}]': finished 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: osdmap e148: 8 total, 8 up, 8 in 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3254203238' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:47.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"} : dispatch 2024-09-21T17:48:48.177 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ RUN ] LibRadosListEC.List api_aio: Running main() from gmock_main.cc 2024-09-21T17:48:48.177 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-09-21T17:48:48.177 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [----------] Global test environment set-up. 2024-09-21T17:48:48.177 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.TooBig (2767 ms) 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (3022 ms) 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (3024 ms) 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (2610 ms) 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (3022 ms) 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3002 ms) 2024-09-21T17:48:48.178 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3046 ms) 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (3004 ms) 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (2946 ms) 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (3041 ms) 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (2963 ms) 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3024 ms) 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3029 ms) 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-09-21T17:48:48.179 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2934 ms) 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.Flush (3018 ms) 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2979 ms) 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3003 ms) 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3004 ms) 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3018 ms) 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3003 ms) 2024-09-21T17:48:48.180 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3012 ms) 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (2972 ms) 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3004 ms) 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3012 ms) 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3011 ms) 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3008 ms) 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [----------] 26 tests from LibRadosAio (77479 ms total) 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-09-21T17:48:48.181 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: ObjectsStart 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 1 0 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 10 0 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 13 0 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 7 0 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 14 0 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 0 0 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 15 0 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 11 0 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 5 0 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 8 0 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 6 0 2024-09-21T17:48:48.183 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 3 0 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 4 0 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 12 0 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 9 0 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 2 0 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (42 ms) 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [----------] 3 tests from LibRadosListEC (1103 ms total) 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3014 ms) 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [----------] 1 test from LibRadosListNP (3015 ms total) 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: 2024-09-21T17:48:48.184 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [----------] Global test environment tear-down 2024-09-21T17:48:48.185 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [==========] 11 tests from 3 test suites ran. (84439 ms total) 2024-09-21T17:48:48.185 INFO:tasks.workunit.client.0.smithi042.stdout: api_list: [ PASSED ] 11 tests. 2024-09-21T17:48:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/555245635' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi042-71351-3","pool2":"test-rados-api-smithi042-71351-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T17:48:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: pgmap v174: 268 pgs: 32 unknown, 236 active+clean; 598 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s wr, 0 op/s 2024-09-21T17:48:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi042-71351-3","pool2":"test-rados-api-smithi042-71351-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T17:48:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"}]': finished 2024-09-21T17:48:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi042-71351-3","pool2":"test-rados-api-smithi042-71351-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-21T17:48:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:48:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: osdmap e149: 8 total, 8 up, 8 in 2024-09-21T17:48:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2223303229' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi042-71531-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3135164034' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OmapPP_smithi042-71285-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/555245635' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi042-71351-3","pool2":"test-rados-api-smithi042-71351-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T17:48:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: pgmap v174: 268 pgs: 32 unknown, 236 active+clean; 598 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s wr, 0 op/s 2024-09-21T17:48:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi042-71351-3","pool2":"test-rados-api-smithi042-71351-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T17:48:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"}]': finished 2024-09-21T17:48:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi042-71351-3","pool2":"test-rados-api-smithi042-71351-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-21T17:48:48.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:48:48.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: osdmap e149: 8 total, 8 up, 8 in 2024-09-21T17:48:48.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:48.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2223303229' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi042-71531-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:48.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3135164034' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OmapPP_smithi042-71285-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/555245635' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi042-71351-3","pool2":"test-rados-api-smithi042-71351-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T17:48:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: pgmap v174: 268 pgs: 32 unknown, 236 active+clean; 598 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s wr, 0 op/s 2024-09-21T17:48:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi042-71351-3","pool2":"test-rados-api-smithi042-71351-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T17:48:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi042-71275-27"}]': finished 2024-09-21T17:48:48.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi042-71351-3","pool2":"test-rados-api-smithi042-71351-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-21T17:48:48.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:48:48.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: osdmap e149: 8 total, 8 up, 8 in 2024-09-21T17:48:48.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:48.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2223303229' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi042-71531-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:48.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3135164034' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OmapPP_smithi042-71285-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:49.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:48:48 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:48:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi042-71275-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi042-71275-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2223303229' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi042-71531-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3135164034' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi042-71285-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13"}]': finished 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi042-71275-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi042-71275-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: osdmap e150: 8 total, 8 up, 8 in 2024-09-21T17:48:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi042-71275-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi042-71275-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi042-71275-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:48:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2223303229' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi042-71531-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3135164034' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi042-71285-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13"}]': finished 2024-09-21T17:48:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi042-71275-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi042-71275-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: osdmap e150: 8 total, 8 up, 8 in 2024-09-21T17:48:49.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi042-71275-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13"} : dispatch 2024-09-21T17:48:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi042-71275-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi042-71275-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:48:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2223303229' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi042-71531-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:49.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3135164034' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi042-71285-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:49.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-13"}]': finished 2024-09-21T17:48:49.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi042-71275-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:49.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi042-71275-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:49.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: osdmap e150: 8 total, 8 up, 8 in 2024-09-21T17:48:49.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi042-71275-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:50 smithi162 ceph-mon[32106]: pgmap v177: 300 pgs: 64 creating+peering, 236 active+clean; 608 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 24 op/s 2024-09-21T17:48:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:50 smithi162 ceph-mon[32106]: osdmap e151: 8 total, 8 up, 8 in 2024-09-21T17:48:50.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:50.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:50 smithi042 ceph-mon[29361]: pgmap v177: 300 pgs: 64 creating+peering, 236 active+clean; 608 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 24 op/s 2024-09-21T17:48:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:50 smithi042 ceph-mon[29361]: osdmap e151: 8 total, 8 up, 8 in 2024-09-21T17:48:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:48:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:50 smithi042 ceph-mon[38309]: pgmap v177: 300 pgs: 64 creating+peering, 236 active+clean; 608 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 24 op/s 2024-09-21T17:48:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:50 smithi042 ceph-mon[38309]: osdmap e151: 8 total, 8 up, 8 in 2024-09-21T17:48:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi042-71275-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi042-71275-28"}]': finished 2024-09-21T17:48:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:52 smithi162 ceph-mon[32106]: osdmap e152: 8 total, 8 up, 8 in 2024-09-21T17:48:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2664066302' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi042-71285-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3850146262' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi042-71531-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi042-71285-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi042-71531-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:52 smithi162 ceph-mon[32106]: pgmap v180: 308 pgs: 104 unknown, 204 active+clean; 608 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-09-21T17:48:52.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi042-71275-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi042-71275-28"}]': finished 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[38309]: osdmap e152: 8 total, 8 up, 8 in 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2664066302' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi042-71285-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3850146262' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi042-71531-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi042-71285-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi042-71531-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[38309]: pgmap v180: 308 pgs: 104 unknown, 204 active+clean; 608 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi042-71275-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi042-71275-28"}]': finished 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[29361]: osdmap e152: 8 total, 8 up, 8 in 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2664066302' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi042-71285-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3850146262' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi042-71531-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi042-71285-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi042-71531-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:52 smithi042 ceph-mon[29361]: pgmap v180: 308 pgs: 104 unknown, 204 active+clean; 608 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-09-21T17:48:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:53 smithi162 ceph-mon[32106]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi042-71285-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi042-71531-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:53 smithi162 ceph-mon[32106]: osdmap e153: 8 total, 8 up, 8 in 2024-09-21T17:48:53.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:53 smithi042 ceph-mon[29361]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:53.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:53.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi042-71285-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:53.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi042-71531-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:53 smithi042 ceph-mon[29361]: osdmap e153: 8 total, 8 up, 8 in 2024-09-21T17:48:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:53 smithi042 ceph-mon[38309]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi042-71285-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi042-71531-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:53 smithi042 ceph-mon[38309]: osdmap e153: 8 total, 8 up, 8 in 2024-09-21T17:48:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:48:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:48:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:48:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: osdmap e154: 8 total, 8 up, 8 in 2024-09-21T17:48:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: pgmap v183: 236 pgs: 25 unknown, 211 active+clean; 608 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"}]': finished 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: osdmap e155: 8 total, 8 up, 8 in 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi042-71531-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:48:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/862114972' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi042-71285-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:54.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:54.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi042-71285-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: osdmap e154: 8 total, 8 up, 8 in 2024-09-21T17:48:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:48:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: pgmap v183: 236 pgs: 25 unknown, 211 active+clean; 608 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:48:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:48:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"}]': finished 2024-09-21T17:48:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:48:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: osdmap e155: 8 total, 8 up, 8 in 2024-09-21T17:48:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi042-71531-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:48:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/862114972' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi042-71285-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:54.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi042-71285-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: osdmap e154: 8 total, 8 up, 8 in 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: pgmap v183: 236 pgs: 25 unknown, 211 active+clean; 608 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi042-71275-28"}]': finished 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3652437130' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: osdmap e155: 8 total, 8 up, 8 in 2024-09-21T17:48:54.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:54.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi042-71531-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:48:54.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/862114972' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi042-71285-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:54.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"} : dispatch 2024-09-21T17:48:54.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:54.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi042-71285-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"}]': finished 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-15"}]': finished 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi042-71285-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-15", "mode": "writeback"} : dispatch 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: osdmap e156: 8 total, 8 up, 8 in 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-15", "mode": "writeback"} : dispatch 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi042-71275-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:56.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi042-71275-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[29361]: pgmap v186: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"}]': finished 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-15"}]': finished 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi042-71285-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-15", "mode": "writeback"} : dispatch 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: osdmap e156: 8 total, 8 up, 8 in 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-15", "mode": "writeback"} : dispatch 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi042-71275-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:56.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi042-71275-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:56.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:56 smithi042 ceph-mon[38309]: pgmap v186: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:48:56.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi042-71275-28"}]': finished 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-15"}]': finished 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi042-71285-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-15", "mode": "writeback"} : dispatch 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: osdmap e156: 8 total, 8 up, 8 in 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-15", "mode": "writeback"} : dispatch 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi042-71275-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi042-71275-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:48:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:56 smithi162 ceph-mon[32106]: pgmap v186: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:48:57.162 INFO:tasks.workunit.client.0.smithi042.stdout:SnapshotsECPP.SnapRemovePP (2003 ms) 2024-09-21T17:48:57.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-21T17:48:57.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2011 ms) 2024-09-21T17:48:57.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-21T17:48:57.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2012 ms) 2024-09-21T17:48:57.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8998 ms total) 2024-09-21T17:48:57.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: 2024-09-21T17:48:57.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-21T17:48:57.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-21T17:48:57.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4039 ms) 2024-09-21T17:48:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-21T17:48:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3989 ms) 2024-09-21T17:48:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-21T17:48:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3948 ms) 2024-09-21T17:48:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11976 ms total) 2024-09-21T17:48:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: 2024-09-21T17:48:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-09-21T17:48:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (93326 ms total) 2024-09-21T17:48:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-09-21T17:48:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-09-21T17:48:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-21T17:48:57.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:48:57.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi042-71531-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi042-71531-36"}]': finished 2024-09-21T17:48:57.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-15", "mode": "writeback"}]': finished 2024-09-21T17:48:57.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"}]': finished 2024-09-21T17:48:57.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi042-71275-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:57.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[29361]: osdmap e157: 8 total, 8 up, 8 in 2024-09-21T17:48:57.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:57.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip_smithi042-71275-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:57.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip_smithi042-71275-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:57.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:48:57.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi042-71531-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi042-71531-36"}]': finished 2024-09-21T17:48:57.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-15", "mode": "writeback"}]': finished 2024-09-21T17:48:57.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"}]': finished 2024-09-21T17:48:57.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi042-71275-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:57.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[38309]: osdmap e157: 8 total, 8 up, 8 in 2024-09-21T17:48:57.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:57.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip_smithi042-71275-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:57.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip_smithi042-71275-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:57 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:48:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi042-71531-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi042-71531-36"}]': finished 2024-09-21T17:48:57.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-15", "mode": "writeback"}]': finished 2024-09-21T17:48:57.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"}]': finished 2024-09-21T17:48:57.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi042-71275-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:48:57.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:57 smithi162 ceph-mon[32106]: osdmap e157: 8 total, 8 up, 8 in 2024-09-21T17:48:57.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"} : dispatch 2024-09-21T17:48:57.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip_smithi042-71275-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:57.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip_smithi042-71275-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:48:58.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"}]': finished 2024-09-21T17:48:58.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[29361]: osdmap e158: 8 total, 8 up, 8 in 2024-09-21T17:48:58.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1760403416' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi042-71285-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:58.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:58.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:58.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[29361]: pgmap v189: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:48:58.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:58.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"}]': finished 2024-09-21T17:48:58.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[38309]: osdmap e158: 8 total, 8 up, 8 in 2024-09-21T17:48:58.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1760403416' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi042-71285-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:58.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:58.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:58.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[38309]: pgmap v189: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:48:58.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/979843236' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi042-71684-21"}]': finished 2024-09-21T17:48:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:58 smithi162 ceph-mon[32106]: osdmap e158: 8 total, 8 up, 8 in 2024-09-21T17:48:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1760403416' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi042-71285-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:48:58.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:58.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:48:58.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:58 smithi162 ceph-mon[32106]: pgmap v189: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:48:58.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:48:59.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:48:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:48:59.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-09-21T17:48:59.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-09-21T17:48:59.160 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (2774 ms) 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (14677 ms) 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (6049 ms) 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (2968 ms) 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (2991 ms) 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2983 ms) 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-09-21T17:48:59.161 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3034 ms) 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3010 ms) 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2955 ms) 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3009 ms) 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2980 ms) 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (2999 ms) 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3007 ms) 2024-09-21T17:48:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3010 ms) 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3002 ms) 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3015 ms) 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (2969 ms) 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3011 ms) 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3009 ms) 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3025 ms) 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-09-21T17:48:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (2998 ms) 2024-09-21T17:48:59.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-09-21T17:48:59.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (2997 ms) 2024-09-21T17:48:59.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-09-21T17:48:59.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3018 ms) 2024-09-21T17:48:59.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-09-21T17:48:59.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3007 ms) 2024-09-21T17:48:59.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-09-21T17:48:59.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3004 ms) 2024-09-21T17:48:59.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-09-21T17:48:59.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (2954 ms) 2024-09-21T17:48:59.164 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-21T17:48:59.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi042-71275-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi042-71275-29"}]': finished 2024-09-21T17:48:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1760403416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi042-71285-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:48:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[29361]: osdmap e159: 8 total, 8 up, 8 in 2024-09-21T17:48:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:59.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:48:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi042-71275-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi042-71275-29"}]': finished 2024-09-21T17:48:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1760403416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi042-71285-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:59.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:48:59.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[38309]: osdmap e159: 8 total, 8 up, 8 in 2024-09-21T17:48:59.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:59.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:59.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:48:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:48:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:59 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:48:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi042-71275-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi042-71275-29"}]': finished 2024-09-21T17:48:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1760403416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi042-71285-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:48:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:48:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:59 smithi162 ceph-mon[32106]: osdmap e159: 8 total, 8 up, 8 in 2024-09-21T17:48:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15"} : dispatch 2024-09-21T17:48:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:48:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:49:00.171 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioP (67692 ms total) 2024-09-21T17:49:00.171 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: 2024-09-21T17:49:00.171 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-09-21T17:49:00.171 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (123 ms) 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (123 ms total) 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (31 ms) 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (9 ms) 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (40 ms total) 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (27 ms) 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-09-21T17:49:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (6 ms) 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (33 ms total) 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (41 ms) 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (3 ms) 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (44 ms total) 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1025 ms) 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1025 ms total) 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: 2024-09-21T17:49:00.173 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-09-21T17:49:00.174 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (96357 ms total) 2024-09-21T17:49:00.174 INFO:tasks.workunit.client.0.smithi042.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-09-21T17:49:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15"}]': finished 2024-09-21T17:49:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36"}]': finished 2024-09-21T17:49:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: osdmap e160: 8 total, 8 up, 8 in 2024-09-21T17:49:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:49:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: pgmap v192: 236 pgs: 8 creating+peering, 228 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:49:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi042-71531-36"}]': finished 2024-09-21T17:49:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: osdmap e161: 8 total, 8 up, 8 in 2024-09-21T17:49:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2978471530' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi042-71285-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi042-71285-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15"}]': finished 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36"}]': finished 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: osdmap e160: 8 total, 8 up, 8 in 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: pgmap v192: 236 pgs: 8 creating+peering, 228 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi042-71531-36"}]': finished 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: osdmap e161: 8 total, 8 up, 8 in 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2978471530' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi042-71285-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi042-71285-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-15"}]': finished 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi042-71531-36"}]': finished 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: osdmap e160: 8 total, 8 up, 8 in 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi042-71531-36"} : dispatch 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: pgmap v192: 236 pgs: 8 creating+peering, 228 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3486072104' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi042-71531-36"}]': finished 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: osdmap e161: 8 total, 8 up, 8 in 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2978471530' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi042-71285-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:00.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi042-71285-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:02.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"}]': finished 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi042-71285-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[29361]: osdmap e162: 8 total, 8 up, 8 in 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[29361]: pgmap v195: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"}]': finished 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi042-71285-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[38309]: osdmap e162: 8 total, 8 up, 8 in 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:02.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:02.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:02.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:02.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:02 smithi042 ceph-mon[38309]: pgmap v195: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi042-71275-29"}]': finished 2024-09-21T17:49:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi042-71285-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:02 smithi162 ceph-mon[32106]: osdmap e162: 8 total, 8 up, 8 in 2024-09-21T17:49:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1750022557' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"} : dispatch 2024-09-21T17:49:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:02 smithi162 ceph-mon[32106]: pgmap v195: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"}]': finished 2024-09-21T17:49:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[29361]: osdmap e163: 8 total, 8 up, 8 in 2024-09-21T17:49:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:03.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi042-71275-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:03.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"}]': finished 2024-09-21T17:49:03.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:03.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[38309]: osdmap e163: 8 total, 8 up, 8 in 2024-09-21T17:49:03.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:03.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:03.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:03.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:03.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi042-71275-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi042-71275-29"}]': finished 2024-09-21T17:49:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:03 smithi162 ceph-mon[32106]: osdmap e163: 8 total, 8 up, 8 in 2024-09-21T17:49:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi042-71275-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:49:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:49:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:49:04.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:04.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi042-71275-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:04.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: osdmap e164: 8 total, 8 up, 8 in 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip2_smithi042-71275-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3265443193' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi042-71285-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi042-71285-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: pgmap v198: 260 pgs: 15 creating+peering, 34 unknown, 211 active+clean; 584 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-17"}]': finished 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi042-71285-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-17", "mode": "writeback"} : dispatch 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: osdmap e165: 8 total, 8 up, 8 in 2024-09-21T17:49:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-17", "mode": "writeback"} : dispatch 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi042-71275-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: osdmap e164: 8 total, 8 up, 8 in 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip2_smithi042-71275-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3265443193' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi042-71285-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi042-71285-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: pgmap v198: 260 pgs: 15 creating+peering, 34 unknown, 211 active+clean; 584 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-17"}]': finished 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi042-71285-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-17", "mode": "writeback"} : dispatch 2024-09-21T17:49:04.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: osdmap e165: 8 total, 8 up, 8 in 2024-09-21T17:49:04.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-17", "mode": "writeback"} : dispatch 2024-09-21T17:49:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi042-71275-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: osdmap e164: 8 total, 8 up, 8 in 2024-09-21T17:49:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip2_smithi042-71275-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3265443193' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi042-71285-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi042-71285-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: pgmap v198: 260 pgs: 15 creating+peering, 34 unknown, 211 active+clean; 584 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:04.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:04.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-17"}]': finished 2024-09-21T17:49:04.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi042-71285-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:04.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-17", "mode": "writeback"} : dispatch 2024-09-21T17:49:04.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: osdmap e165: 8 total, 8 up, 8 in 2024-09-21T17:49:04.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-17", "mode": "writeback"} : dispatch 2024-09-21T17:49:05.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:05 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:05.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:05 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi042-71275-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi042-71275-30"}]': finished 2024-09-21T17:49:05.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-17", "mode": "writeback"}]': finished 2024-09-21T17:49:05.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:05 smithi162 ceph-mon[32106]: osdmap e166: 8 total, 8 up, 8 in 2024-09-21T17:49:05.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:05 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:05.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:05 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi042-71275-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi042-71275-30"}]': finished 2024-09-21T17:49:05.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-17", "mode": "writeback"}]': finished 2024-09-21T17:49:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:05 smithi042 ceph-mon[29361]: osdmap e166: 8 total, 8 up, 8 in 2024-09-21T17:49:05.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:05 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:05.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:05 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi042-71275-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi042-71275-30"}]': finished 2024-09-21T17:49:05.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-17", "mode": "writeback"}]': finished 2024-09-21T17:49:05.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:05 smithi042 ceph-mon[38309]: osdmap e166: 8 total, 8 up, 8 in 2024-09-21T17:49:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:06 smithi162 ceph-mon[32106]: pgmap v201: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:06 smithi162 ceph-mon[32106]: osdmap e167: 8 total, 8 up, 8 in 2024-09-21T17:49:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1272032091' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi042-71285-32","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi042-71285-32","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[29361]: pgmap v201: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[29361]: osdmap e167: 8 total, 8 up, 8 in 2024-09-21T17:49:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1272032091' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi042-71285-32","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi042-71285-32","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[38309]: pgmap v201: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[38309]: osdmap e167: 8 total, 8 up, 8 in 2024-09-21T17:49:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17"} : dispatch 2024-09-21T17:49:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1272032091' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi042-71285-32","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi042-71285-32","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:07 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17"}]': finished 2024-09-21T17:49:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi042-71285-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:07 smithi162 ceph-mon[32106]: osdmap e168: 8 total, 8 up, 8 in 2024-09-21T17:49:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:07.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:07 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:07.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17"}]': finished 2024-09-21T17:49:07.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi042-71285-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:07.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:07 smithi042 ceph-mon[29361]: osdmap e168: 8 total, 8 up, 8 in 2024-09-21T17:49:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:07 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-17"}]': finished 2024-09-21T17:49:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi042-71285-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:07 smithi042 ceph-mon[38309]: osdmap e168: 8 total, 8 up, 8 in 2024-09-21T17:49:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:08 smithi162 ceph-mon[32106]: pgmap v204: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:49:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi042-71275-30"}]': finished 2024-09-21T17:49:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:08 smithi162 ceph-mon[32106]: osdmap e169: 8 total, 8 up, 8 in 2024-09-21T17:49:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:08.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:08 smithi042 ceph-mon[29361]: pgmap v204: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:49:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi042-71275-30"}]': finished 2024-09-21T17:49:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:08 smithi042 ceph-mon[29361]: osdmap e169: 8 total, 8 up, 8 in 2024-09-21T17:49:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:08.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:08 smithi042 ceph-mon[38309]: pgmap v204: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:49:08.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi042-71275-30"}]': finished 2024-09-21T17:49:08.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:08 smithi042 ceph-mon[38309]: osdmap e169: 8 total, 8 up, 8 in 2024-09-21T17:49:08.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi042-71275-30"} : dispatch 2024-09-21T17:49:09.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:49:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:49:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi042-71275-30"}]': finished 2024-09-21T17:49:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: osdmap e170: 8 total, 8 up, 8 in 2024-09-21T17:49:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3683898101' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi042-71285-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi042-71285-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi042-71275-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi042-71275-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:09.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi042-71275-30"}]': finished 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: osdmap e170: 8 total, 8 up, 8 in 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3683898101' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi042-71285-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi042-71285-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi042-71275-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi042-71275-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:09.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3177516780' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi042-71275-30"}]': finished 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: osdmap e170: 8 total, 8 up, 8 in 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3683898101' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi042-71285-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi042-71285-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi042-71275-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi042-71275-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:10 smithi162 ceph-mon[32106]: pgmap v207: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi042-71285-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi042-71275-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:10 smithi162 ceph-mon[32106]: osdmap e171: 8 total, 8 up, 8 in 2024-09-21T17:49:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppend_smithi042-71275-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppend_smithi042-71275-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:10.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:10.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[29361]: pgmap v207: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:10.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:10.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi042-71285-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi042-71275-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[29361]: osdmap e171: 8 total, 8 up, 8 in 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppend_smithi042-71275-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppend_smithi042-71275-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[38309]: pgmap v207: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi042-71285-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi042-71275-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[38309]: osdmap e171: 8 total, 8 up, 8 in 2024-09-21T17:49:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppend_smithi042-71275-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:10.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:10.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:10.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppend_smithi042-71275-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3683898101' entity='client.admin' cmd={ 2024-09-21T17:49:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "prefix": "osd pool set", 2024-09-21T17:49:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "pool": "PoolEIOFlag_smithi042-71285-33", 2024-09-21T17:49:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "var": "eio", 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "val": "true" 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: } : dispatch 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={ 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "prefix": "osd pool set", 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "pool": "PoolEIOFlag_smithi042-71285-33", 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "var": "eio", 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "val": "true" 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: } : dispatch 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{ 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "prefix": "osd pool set", 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "pool": "PoolEIOFlag_smithi042-71285-33", 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "var": "eio", 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: "val": "true" 2024-09-21T17:49:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: }]': finished 2024-09-21T17:49:11.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:11.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: osdmap e172: 8 total, 8 up, 8 in 2024-09-21T17:49:11.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:11.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3683898101' entity='client.admin' cmd={ 2024-09-21T17:49:11.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "prefix": "osd pool set", 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "pool": "PoolEIOFlag_smithi042-71285-33", 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "var": "eio", 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "val": "true" 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: } : dispatch 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={ 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "prefix": "osd pool set", 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "pool": "PoolEIOFlag_smithi042-71285-33", 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "var": "eio", 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "val": "true" 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: } : dispatch 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{ 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "prefix": "osd pool set", 2024-09-21T17:49:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "pool": "PoolEIOFlag_smithi042-71285-33", 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "var": "eio", 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: "val": "true" 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: }]': finished 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: osdmap e172: 8 total, 8 up, 8 in 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3683898101' entity='client.admin' cmd={ 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "prefix": "osd pool set", 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "pool": "PoolEIOFlag_smithi042-71285-33", 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "var": "eio", 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "val": "true" 2024-09-21T17:49:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: } : dispatch 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={ 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "prefix": "osd pool set", 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "pool": "PoolEIOFlag_smithi042-71285-33", 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "var": "eio", 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "val": "true" 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: } : dispatch 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{ 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "prefix": "osd pool set", 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "pool": "PoolEIOFlag_smithi042-71285-33", 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "var": "eio", 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: "val": "true" 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: }]': finished 2024-09-21T17:49:11.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:11.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: osdmap e172: 8 total, 8 up, 8 in 2024-09-21T17:49:11.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:12 smithi162 ceph-mon[32106]: pgmap v210: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:12 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:49:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:12 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:49:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:12 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:49:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:12 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:49:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi042-71275-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi042-71275-31"}]': finished 2024-09-21T17:49:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-19"}]': finished 2024-09-21T17:49:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:12 smithi162 ceph-mon[32106]: osdmap e173: 8 total, 8 up, 8 in 2024-09-21T17:49:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-19", "mode": "writeback"} : dispatch 2024-09-21T17:49:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-19", "mode": "writeback"} : dispatch 2024-09-21T17:49:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[29361]: pgmap v210: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:49:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:49:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:49:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:49:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi042-71275-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi042-71275-31"}]': finished 2024-09-21T17:49:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-19"}]': finished 2024-09-21T17:49:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[29361]: osdmap e173: 8 total, 8 up, 8 in 2024-09-21T17:49:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-19", "mode": "writeback"} : dispatch 2024-09-21T17:49:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-19", "mode": "writeback"} : dispatch 2024-09-21T17:49:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[38309]: pgmap v210: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:12.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:49:12.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:49:12.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:49:12.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:49:12.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi042-71275-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi042-71275-31"}]': finished 2024-09-21T17:49:12.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-19"}]': finished 2024-09-21T17:49:12.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[38309]: osdmap e173: 8 total, 8 up, 8 in 2024-09-21T17:49:12.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-19", "mode": "writeback"} : dispatch 2024-09-21T17:49:12.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-19", "mode": "writeback"} : dispatch 2024-09-21T17:49:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:49:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-19", "mode": "writeback"}]': finished 2024-09-21T17:49:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[29361]: osdmap e174: 8 total, 8 up, 8 in 2024-09-21T17:49:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3532886756' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi042-71285-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi042-71285-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[29361]: pgmap v213: 268 pgs: 17 creating+peering, 39 unknown, 212 active+clean; 584 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:49:14.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:49:14.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:14.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:14.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-19", "mode": "writeback"}]': finished 2024-09-21T17:49:14.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[38309]: osdmap e174: 8 total, 8 up, 8 in 2024-09-21T17:49:14.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3532886756' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi042-71285-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:14.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi042-71285-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:14.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:14.167 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:14.167 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-mon[38309]: pgmap v213: 268 pgs: 17 creating+peering, 39 unknown, 212 active+clean; 584 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:49:14.167 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:49:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:49:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:49:14.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:49:14.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:14.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:13 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:14.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-19", "mode": "writeback"}]': finished 2024-09-21T17:49:14.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:13 smithi162 ceph-mon[32106]: osdmap e174: 8 total, 8 up, 8 in 2024-09-21T17:49:14.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3532886756' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi042-71285-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:14.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi042-71285-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:14.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:14.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:14.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:13 smithi162 ceph-mon[32106]: pgmap v213: 268 pgs: 17 creating+peering, 39 unknown, 212 active+clean; 584 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:49:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi042-71285-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[29361]: osdmap e175: 8 total, 8 up, 8 in 2024-09-21T17:49:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:15.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:15.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi042-71285-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:15.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:15.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[38309]: osdmap e175: 8 total, 8 up, 8 in 2024-09-21T17:49:15.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:15.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:15.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:15.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:14 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi042-71285-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:14 smithi162 ceph-mon[32106]: osdmap e175: 8 total, 8 up, 8 in 2024-09-21T17:49:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19"} : dispatch 2024-09-21T17:49:15.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:15.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:16.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:16.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19"}]': finished 2024-09-21T17:49:16.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"}]': finished 2024-09-21T17:49:16.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[29361]: osdmap e176: 8 total, 8 up, 8 in 2024-09-21T17:49:16.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:16.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:16.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[29361]: pgmap v216: 228 pgs: 228 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:49:16.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:16.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19"}]': finished 2024-09-21T17:49:16.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"}]': finished 2024-09-21T17:49:16.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[38309]: osdmap e176: 8 total, 8 up, 8 in 2024-09-21T17:49:16.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:16.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:16.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:15 smithi042 ceph-mon[38309]: pgmap v216: 228 pgs: 228 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:49:16.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:15 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:16.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-19"}]': finished 2024-09-21T17:49:16.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi042-71275-31"}]': finished 2024-09-21T17:49:16.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:15 smithi162 ceph-mon[32106]: osdmap e176: 8 total, 8 up, 8 in 2024-09-21T17:49:16.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/76828609' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:16.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"} : dispatch 2024-09-21T17:49:16.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:15 smithi162 ceph-mon[32106]: pgmap v216: 228 pgs: 228 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:49:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"}]': finished 2024-09-21T17:49:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:17 smithi162 ceph-mon[32106]: osdmap e177: 8 total, 8 up, 8 in 2024-09-21T17:49:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/896827952' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi042-71285-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi042-71285-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi042-71275-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi042-71275-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:17.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"}]': finished 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[29361]: osdmap e177: 8 total, 8 up, 8 in 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/896827952' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi042-71285-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi042-71285-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi042-71275-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi042-71275-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi042-71275-31"}]': finished 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[38309]: osdmap e177: 8 total, 8 up, 8 in 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/896827952' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi042-71285-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi042-71285-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi042-71275-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi042-71275-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi042-71285-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi042-71275-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi042-71275-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:18 smithi162 ceph-mon[32106]: osdmap e178: 8 total, 8 up, 8 in 2024-09-21T17:49:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi042-71275-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:18.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:18.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:18 smithi162 ceph-mon[32106]: pgmap v219: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:49:18.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:18.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi042-71285-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi042-71275-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi042-71275-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[29361]: osdmap e178: 8 total, 8 up, 8 in 2024-09-21T17:49:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi042-71275-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[29361]: pgmap v219: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:49:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi042-71285-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi042-71275-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi042-71275-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[38309]: osdmap e178: 8 total, 8 up, 8 in 2024-09-21T17:49:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi042-71275-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[38309]: pgmap v219: 260 pgs: 64 unknown, 196 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:49:18.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:19.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:49:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:49:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:19 smithi162 ceph-mon[32106]: osdmap e179: 8 total, 8 up, 8 in 2024-09-21T17:49:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi042-71275-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi042-71275-32"}]': finished 2024-09-21T17:49:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:19 smithi162 ceph-mon[32106]: osdmap e180: 8 total, 8 up, 8 in 2024-09-21T17:49:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3128058622' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[29361]: osdmap e179: 8 total, 8 up, 8 in 2024-09-21T17:49:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi042-71275-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi042-71275-32"}]': finished 2024-09-21T17:49:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:19.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[29361]: osdmap e180: 8 total, 8 up, 8 in 2024-09-21T17:49:19.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3128058622' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:19.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:19.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:19.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:19.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[38309]: osdmap e179: 8 total, 8 up, 8 in 2024-09-21T17:49:19.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:19.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:19.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi042-71275-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi042-71275-32"}]': finished 2024-09-21T17:49:19.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:19.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[38309]: osdmap e180: 8 total, 8 up, 8 in 2024-09-21T17:49:19.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3128058622' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:19.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:19.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:19.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:20 smithi162 ceph-mon[32106]: pgmap v222: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:49:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-21"}]': finished 2024-09-21T17:49:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:20 smithi162 ceph-mon[32106]: osdmap e181: 8 total, 8 up, 8 in 2024-09-21T17:49:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-21", "mode": "writeback"} : dispatch 2024-09-21T17:49:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-21", "mode": "writeback"} : dispatch 2024-09-21T17:49:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[29361]: pgmap v222: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:49:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-21"}]': finished 2024-09-21T17:49:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[29361]: osdmap e181: 8 total, 8 up, 8 in 2024-09-21T17:49:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-21", "mode": "writeback"} : dispatch 2024-09-21T17:49:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-21", "mode": "writeback"} : dispatch 2024-09-21T17:49:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[38309]: pgmap v222: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:49:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-21"}]': finished 2024-09-21T17:49:20.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[38309]: osdmap e181: 8 total, 8 up, 8 in 2024-09-21T17:49:20.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-21", "mode": "writeback"} : dispatch 2024-09-21T17:49:20.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-21", "mode": "writeback"} : dispatch 2024-09-21T17:49:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:21 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:21 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-21", "mode": "writeback"}]': finished 2024-09-21T17:49:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:21 smithi162 ceph-mon[32106]: osdmap e182: 8 total, 8 up, 8 in 2024-09-21T17:49:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1578271180' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:21.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:21.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:21.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:21.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-21", "mode": "writeback"}]': finished 2024-09-21T17:49:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[29361]: osdmap e182: 8 total, 8 up, 8 in 2024-09-21T17:49:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1578271180' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-21", "mode": "writeback"}]': finished 2024-09-21T17:49:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[38309]: osdmap e182: 8 total, 8 up, 8 in 2024-09-21T17:49:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1578271180' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:22 smithi162 ceph-mon[32106]: pgmap v225: 292 pgs: 64 unknown, 228 active+clean; 584 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"}]': finished 2024-09-21T17:49:22.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:22.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:22.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:22.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:22 smithi162 ceph-mon[32106]: osdmap e183: 8 total, 8 up, 8 in 2024-09-21T17:49:22.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:22.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[29361]: pgmap v225: 292 pgs: 64 unknown, 228 active+clean; 584 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"}]': finished 2024-09-21T17:49:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[29361]: osdmap e183: 8 total, 8 up, 8 in 2024-09-21T17:49:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:22.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[38309]: pgmap v225: 292 pgs: 64 unknown, 228 active+clean; 584 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:22.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:22.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi042-71275-32"}]': finished 2024-09-21T17:49:22.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:22.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:22.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1061715520' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:22.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[38309]: osdmap e183: 8 total, 8 up, 8 in 2024-09-21T17:49:22.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21"} : dispatch 2024-09-21T17:49:22.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"} : dispatch 2024-09-21T17:49:23.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:23 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:23.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21"}]': finished 2024-09-21T17:49:23.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"}]': finished 2024-09-21T17:49:23.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:23 smithi162 ceph-mon[32106]: osdmap e184: 8 total, 8 up, 8 in 2024-09-21T17:49:23.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:23 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/670973576' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-38","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:23.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-38","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21"}]': finished 2024-09-21T17:49:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"}]': finished 2024-09-21T17:49:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[29361]: osdmap e184: 8 total, 8 up, 8 in 2024-09-21T17:49:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/670973576' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-38","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-38","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-21"}]': finished 2024-09-21T17:49:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi042-71275-32"}]': finished 2024-09-21T17:49:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[38309]: osdmap e184: 8 total, 8 up, 8 in 2024-09-21T17:49:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/670973576' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-38","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-38","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:49:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:49:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:49:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi042-71275-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi042-71275-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:24.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: pgmap v228: 324 pgs: 17 creating+peering, 49 unknown, 258 active+clean; 584 KiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:24.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:24.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi042-71275-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:24.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi042-71275-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: osdmap e185: 8 total, 8 up, 8 in 2024-09-21T17:49:24.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi042-71275-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi042-71275-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi042-71275-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: pgmap v228: 324 pgs: 17 creating+peering, 49 unknown, 258 active+clean; 584 KiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi042-71275-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi042-71275-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: osdmap e185: 8 total, 8 up, 8 in 2024-09-21T17:49:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi042-71275-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi042-71275-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:24.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi042-71275-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:24.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: pgmap v228: 324 pgs: 17 creating+peering, 49 unknown, 258 active+clean; 584 KiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:49:24.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi042-71285-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:24.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi042-71275-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:24.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi042-71275-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:24.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: osdmap e185: 8 total, 8 up, 8 in 2024-09-21T17:49:24.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi042-71275-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:26.469 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:26.469 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:26 smithi042 ceph-mon[29361]: osdmap e186: 8 total, 8 up, 8 in 2024-09-21T17:49:26.469 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:26.469 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:26 smithi042 ceph-mon[29361]: pgmap v231: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:49:26.470 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:26.470 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:26 smithi042 ceph-mon[38309]: osdmap e186: 8 total, 8 up, 8 in 2024-09-21T17:49:26.470 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:26.470 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:26 smithi042 ceph-mon[38309]: pgmap v231: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:49:26.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:26.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:26 smithi162 ceph-mon[32106]: osdmap e186: 8 total, 8 up, 8 in 2024-09-21T17:49:26.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:26.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:26 smithi162 ceph-mon[32106]: pgmap v231: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:49:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi042-71275-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi042-71275-33"}]': finished 2024-09-21T17:49:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:27 smithi162 ceph-mon[32106]: osdmap e187: 8 total, 8 up, 8 in 2024-09-21T17:49:27.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi042-71275-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi042-71275-33"}]': finished 2024-09-21T17:49:27.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:27 smithi042 ceph-mon[38309]: osdmap e187: 8 total, 8 up, 8 in 2024-09-21T17:49:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi042-71275-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi042-71275-33"}]': finished 2024-09-21T17:49:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:27 smithi042 ceph-mon[29361]: osdmap e187: 8 total, 8 up, 8 in 2024-09-21T17:49:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:28 smithi162 ceph-mon[32106]: osdmap e188: 8 total, 8 up, 8 in 2024-09-21T17:49:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:28 smithi162 ceph-mon[32106]: pgmap v234: 236 pgs: 40 unknown, 196 active+clean; 584 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-09-21T17:49:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:28 smithi042 ceph-mon[29361]: osdmap e188: 8 total, 8 up, 8 in 2024-09-21T17:49:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:28 smithi042 ceph-mon[29361]: pgmap v234: 236 pgs: 40 unknown, 196 active+clean; 584 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-09-21T17:49:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:28 smithi042 ceph-mon[38309]: osdmap e188: 8 total, 8 up, 8 in 2024-09-21T17:49:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:28 smithi042 ceph-mon[38309]: pgmap v234: 236 pgs: 40 unknown, 196 active+clean; 584 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-09-21T17:49:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:29.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:49:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:49:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:29 smithi162 ceph-mon[32106]: osdmap e189: 8 total, 8 up, 8 in 2024-09-21T17:49:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:29.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1643925482' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:29 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[29361]: osdmap e189: 8 total, 8 up, 8 in 2024-09-21T17:49:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1643925482' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[38309]: osdmap e189: 8 total, 8 up, 8 in 2024-09-21T17:49:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1643925482' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:29 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-23"}]': finished 2024-09-21T17:49:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"}]': finished 2024-09-21T17:49:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: osdmap e190: 8 total, 8 up, 8 in 2024-09-21T17:49:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-23", "mode": "writeback"} : dispatch 2024-09-21T17:49:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-23", "mode": "writeback"} : dispatch 2024-09-21T17:49:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: pgmap v237: 260 pgs: 32 creating+peering, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T17:49:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-23", "mode": "writeback"}]': finished 2024-09-21T17:49:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"}]': finished 2024-09-21T17:49:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:30 smithi162 ceph-mon[32106]: osdmap e191: 8 total, 8 up, 8 in 2024-09-21T17:49:30.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-23"}]': finished 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"}]': finished 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: osdmap e190: 8 total, 8 up, 8 in 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-23", "mode": "writeback"} : dispatch 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-23", "mode": "writeback"} : dispatch 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: pgmap v237: 260 pgs: 32 creating+peering, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-23", "mode": "writeback"}]': finished 2024-09-21T17:49:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"}]': finished 2024-09-21T17:49:30.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[29361]: osdmap e191: 8 total, 8 up, 8 in 2024-09-21T17:49:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-23"}]': finished 2024-09-21T17:49:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi042-71275-33"}]': finished 2024-09-21T17:49:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: osdmap e190: 8 total, 8 up, 8 in 2024-09-21T17:49:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1800431029' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-23", "mode": "writeback"} : dispatch 2024-09-21T17:49:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-23", "mode": "writeback"} : dispatch 2024-09-21T17:49:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"} : dispatch 2024-09-21T17:49:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: pgmap v237: 260 pgs: 32 creating+peering, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T17:49:30.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:30.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-23", "mode": "writeback"}]': finished 2024-09-21T17:49:30.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi042-71275-33"}]': finished 2024-09-21T17:49:30.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:30 smithi042 ceph-mon[38309]: osdmap e191: 8 total, 8 up, 8 in 2024-09-21T17:49:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1104198921' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-40","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-40","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:31.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi042-71275-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:31.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi042-71275-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:31.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:31.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi042-71275-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:31.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: osdmap e192: 8 total, 8 up, 8 in 2024-09-21T17:49:31.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValue_smithi042-71275-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValue_smithi042-71275-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1104198921' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-40","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-40","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi042-71275-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi042-71275-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi042-71275-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: osdmap e192: 8 total, 8 up, 8 in 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValue_smithi042-71275-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValue_smithi042-71275-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1104198921' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-40","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:31.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-40","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:31.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi042-71275-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:31.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi042-71275-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:31.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:31.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi042-71275-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:31.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: osdmap e192: 8 total, 8 up, 8 in 2024-09-21T17:49:31.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValue_smithi042-71275-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:31.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValue_smithi042-71275-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:32 smithi162 ceph-mon[32106]: pgmap v240: 292 pgs: 32 unknown, 32 creating+peering, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:49:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:32 smithi162 ceph-mon[32106]: osdmap e193: 8 total, 8 up, 8 in 2024-09-21T17:49:32.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:32.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/176783264' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:32.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[29361]: pgmap v240: 292 pgs: 32 unknown, 32 creating+peering, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:49:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[29361]: osdmap e193: 8 total, 8 up, 8 in 2024-09-21T17:49:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/176783264' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[38309]: pgmap v240: 292 pgs: 32 unknown, 32 creating+peering, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:49:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[38309]: osdmap e193: 8 total, 8 up, 8 in 2024-09-21T17:49:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23"} : dispatch 2024-09-21T17:49:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/176783264' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:33 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi042-71275-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi042-71275-34"}]': finished 2024-09-21T17:49:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23"}]': finished 2024-09-21T17:49:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:33 smithi162 ceph-mon[32106]: osdmap e194: 8 total, 8 up, 8 in 2024-09-21T17:49:33.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:33 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi042-71275-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi042-71275-34"}]': finished 2024-09-21T17:49:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23"}]': finished 2024-09-21T17:49:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:33 smithi042 ceph-mon[29361]: osdmap e194: 8 total, 8 up, 8 in 2024-09-21T17:49:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:33 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi042-71275-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi042-71275-34"}]': finished 2024-09-21T17:49:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-23"}]': finished 2024-09-21T17:49:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:33 smithi042 ceph-mon[38309]: osdmap e194: 8 total, 8 up, 8 in 2024-09-21T17:49:34.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:49:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:49:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:49:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:34 smithi162 ceph-mon[32106]: pgmap v243: 332 pgs: 31 unknown, 1 active, 15 creating+activating, 19 creating+peering, 266 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T17:49:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:34 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:34 smithi162 ceph-mon[32106]: osdmap e195: 8 total, 8 up, 8 in 2024-09-21T17:49:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1708096822' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-42","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:34 smithi042 ceph-mon[29361]: pgmap v243: 332 pgs: 31 unknown, 1 active, 15 creating+activating, 19 creating+peering, 266 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T17:49:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:34 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:34 smithi042 ceph-mon[29361]: osdmap e195: 8 total, 8 up, 8 in 2024-09-21T17:49:34.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1708096822' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-42","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:34 smithi042 ceph-mon[38309]: pgmap v243: 332 pgs: 31 unknown, 1 active, 15 creating+activating, 19 creating+peering, 266 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T17:49:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:34 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:34 smithi042 ceph-mon[38309]: osdmap e195: 8 total, 8 up, 8 in 2024-09-21T17:49:34.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1708096822' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-42","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1708096822' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:36 smithi162 ceph-mon[32106]: osdmap e196: 8 total, 8 up, 8 in 2024-09-21T17:49:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:36 smithi162 ceph-mon[32106]: pgmap v246: 356 pgs: 64 unknown, 1 active, 15 creating+activating, 276 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T17:49:36.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1708096822' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:36.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[29361]: osdmap e196: 8 total, 8 up, 8 in 2024-09-21T17:49:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[29361]: pgmap v246: 356 pgs: 64 unknown, 1 active, 15 creating+activating, 276 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T17:49:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1708096822' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[38309]: osdmap e196: 8 total, 8 up, 8 in 2024-09-21T17:49:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:36 smithi042 ceph-mon[38309]: pgmap v246: 356 pgs: 64 unknown, 1 active, 15 creating+activating, 276 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T17:49:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"}]': finished 2024-09-21T17:49:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:37 smithi162 ceph-mon[32106]: osdmap e197: 8 total, 8 up, 8 in 2024-09-21T17:49:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4030394319' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"}]': finished 2024-09-21T17:49:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[29361]: osdmap e197: 8 total, 8 up, 8 in 2024-09-21T17:49:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4030394319' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi042-71275-34"}]': finished 2024-09-21T17:49:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[38309]: osdmap e197: 8 total, 8 up, 8 in 2024-09-21T17:49:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1998721566' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4030394319' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"} : dispatch 2024-09-21T17:49:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"}]': finished 2024-09-21T17:49:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:38 smithi162 ceph-mon[32106]: osdmap e198: 8 total, 8 up, 8 in 2024-09-21T17:49:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:38 smithi162 ceph-mon[32106]: pgmap v249: 388 pgs: 96 unknown, 1 active, 15 creating+activating, 276 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:49:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:38.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi042-71275-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:38.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"}]': finished 2024-09-21T17:49:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[29361]: osdmap e198: 8 total, 8 up, 8 in 2024-09-21T17:49:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[29361]: pgmap v249: 388 pgs: 96 unknown, 1 active, 15 creating+activating, 276 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:49:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi042-71275-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi042-71275-34"}]': finished 2024-09-21T17:49:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi042-71285-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[38309]: osdmap e198: 8 total, 8 up, 8 in 2024-09-21T17:49:38.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:38.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:38.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[38309]: pgmap v249: 388 pgs: 96 unknown, 1 active, 15 creating+activating, 276 active+clean; 584 KiB data, 587 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:49:38.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:38.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:38.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi042-71275-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:39.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:49:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:49:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi042-71275-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:39 smithi162 ceph-mon[32106]: osdmap e199: 8 total, 8 up, 8 in 2024-09-21T17:49:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "Flush_smithi042-71275-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-25"}]': finished 2024-09-21T17:49:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-25", "mode": "writeback"} : dispatch 2024-09-21T17:49:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:39 smithi162 ceph-mon[32106]: osdmap e200: 8 total, 8 up, 8 in 2024-09-21T17:49:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-25", "mode": "writeback"} : dispatch 2024-09-21T17:49:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi042-71275-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[29361]: osdmap e199: 8 total, 8 up, 8 in 2024-09-21T17:49:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "Flush_smithi042-71275-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-25"}]': finished 2024-09-21T17:49:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-25", "mode": "writeback"} : dispatch 2024-09-21T17:49:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[29361]: osdmap e200: 8 total, 8 up, 8 in 2024-09-21T17:49:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-25", "mode": "writeback"} : dispatch 2024-09-21T17:49:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi042-71275-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[38309]: osdmap e199: 8 total, 8 up, 8 in 2024-09-21T17:49:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "Flush_smithi042-71275-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-25"}]': finished 2024-09-21T17:49:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-25", "mode": "writeback"} : dispatch 2024-09-21T17:49:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[38309]: osdmap e200: 8 total, 8 up, 8 in 2024-09-21T17:49:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-25", "mode": "writeback"} : dispatch 2024-09-21T17:49:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:40 smithi162 ceph-mon[32106]: pgmap v252: 324 pgs: 324 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 765 B/s wr, 2 op/s 2024-09-21T17:49:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:40 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi042-71275-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi042-71275-35"}]': finished 2024-09-21T17:49:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-25", "mode": "writeback"}]': finished 2024-09-21T17:49:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:40 smithi162 ceph-mon[32106]: osdmap e201: 8 total, 8 up, 8 in 2024-09-21T17:49:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[29361]: pgmap v252: 324 pgs: 324 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 765 B/s wr, 2 op/s 2024-09-21T17:49:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi042-71275-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi042-71275-35"}]': finished 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-25", "mode": "writeback"}]': finished 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[29361]: osdmap e201: 8 total, 8 up, 8 in 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[38309]: pgmap v252: 324 pgs: 324 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 765 B/s wr, 2 op/s 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi042-71275-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi042-71275-35"}]': finished 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-25", "mode": "writeback"}]': finished 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[38309]: osdmap e201: 8 total, 8 up, 8 in 2024-09-21T17:49:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:40.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:42.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:42.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:42 smithi042 ceph-mon[38309]: osdmap e202: 8 total, 8 up, 8 in 2024-09-21T17:49:42.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:42.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:42.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:42 smithi042 ceph-mon[38309]: pgmap v255: 268 pgs: 8 unknown, 260 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:49:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:42 smithi042 ceph-mon[29361]: osdmap e202: 8 total, 8 up, 8 in 2024-09-21T17:49:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:42 smithi042 ceph-mon[29361]: pgmap v255: 268 pgs: 8 unknown, 260 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:49:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:42 smithi162 ceph-mon[32106]: osdmap e202: 8 total, 8 up, 8 in 2024-09-21T17:49:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25"} : dispatch 2024-09-21T17:49:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:42 smithi162 ceph-mon[32106]: pgmap v255: 268 pgs: 8 unknown, 260 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:49:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25"}]': finished 2024-09-21T17:49:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[29361]: osdmap e203: 8 total, 8 up, 8 in 2024-09-21T17:49:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:43.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:43.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:43.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:43.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25"}]': finished 2024-09-21T17:49:43.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[38309]: osdmap e203: 8 total, 8 up, 8 in 2024-09-21T17:49:43.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:43.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:43 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:43 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-25"}]': finished 2024-09-21T17:49:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:43 smithi162 ceph-mon[32106]: osdmap e203: 8 total, 8 up, 8 in 2024-09-21T17:49:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:43.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:44.166 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:49:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:49:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:49:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi042-71275-35"}]': finished 2024-09-21T17:49:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:44 smithi162 ceph-mon[32106]: osdmap e204: 8 total, 8 up, 8 in 2024-09-21T17:49:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/827232220' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi042-71285-44","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:44 smithi162 ceph-mon[32106]: pgmap v258: 228 pgs: 17 creating+peering, 15 unknown, 196 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi042-71275-35"}]': finished 2024-09-21T17:49:44.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi042-71275-35"}]': finished 2024-09-21T17:49:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[29361]: osdmap e204: 8 total, 8 up, 8 in 2024-09-21T17:49:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/827232220' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi042-71285-44","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[29361]: pgmap v258: 228 pgs: 17 creating+peering, 15 unknown, 196 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi042-71275-35"}]': finished 2024-09-21T17:49:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi042-71275-35"}]': finished 2024-09-21T17:49:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[38309]: osdmap e204: 8 total, 8 up, 8 in 2024-09-21T17:49:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi042-71275-35"} : dispatch 2024-09-21T17:49:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/827232220' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi042-71285-44","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[38309]: pgmap v258: 228 pgs: 17 creating+peering, 15 unknown, 196 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:44.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1327629138' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi042-71275-35"}]': finished 2024-09-21T17:49:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/827232220' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi042-71285-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: osdmap e205: 8 total, 8 up, 8 in 2024-09-21T17:49:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi042-71275-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:45.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi042-71275-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:45.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:45.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi042-71275-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:45.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: osdmap e206: 8 total, 8 up, 8 in 2024-09-21T17:49:45.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi042-71275-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi042-71275-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/827232220' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi042-71285-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: osdmap e205: 8 total, 8 up, 8 in 2024-09-21T17:49:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi042-71275-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi042-71275-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi042-71275-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: osdmap e206: 8 total, 8 up, 8 in 2024-09-21T17:49:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi042-71275-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi042-71275-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/827232220' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi042-71285-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:45.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: osdmap e205: 8 total, 8 up, 8 in 2024-09-21T17:49:45.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:45.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:45.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi042-71275-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:45.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi042-71275-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:45.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:45.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi042-71275-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:45.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: osdmap e206: 8 total, 8 up, 8 in 2024-09-21T17:49:45.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi042-71275-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:45.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi042-71275-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:46 smithi162 ceph-mon[32106]: pgmap v261: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:46 smithi162 ceph-mon[32106]: osdmap e207: 8 total, 8 up, 8 in 2024-09-21T17:49:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2978621629' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi042-71285-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi042-71285-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[29361]: pgmap v261: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[29361]: osdmap e207: 8 total, 8 up, 8 in 2024-09-21T17:49:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2978621629' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi042-71285-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi042-71285-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[38309]: pgmap v261: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[38309]: osdmap e207: 8 total, 8 up, 8 in 2024-09-21T17:49:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2978621629' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi042-71285-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi042-71285-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:48.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi042-71275-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi042-71275-36"}]': finished 2024-09-21T17:49:48.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi042-71285-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:48.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:48.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[38309]: osdmap e208: 8 total, 8 up, 8 in 2024-09-21T17:49:48.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:48.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:48.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[38309]: pgmap v264: 268 pgs: 72 unknown, 196 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-09-21T17:49:48.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi042-71275-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi042-71275-36"}]': finished 2024-09-21T17:49:48.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi042-71285-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:48.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:48.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[29361]: osdmap e208: 8 total, 8 up, 8 in 2024-09-21T17:49:48.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:48.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:48.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:48 smithi042 ceph-mon[29361]: pgmap v264: 268 pgs: 72 unknown, 196 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-09-21T17:49:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi042-71275-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi042-71275-36"}]': finished 2024-09-21T17:49:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi042-71285-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:48 smithi162 ceph-mon[32106]: osdmap e208: 8 total, 8 up, 8 in 2024-09-21T17:49:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:48 smithi162 ceph-mon[32106]: pgmap v264: 268 pgs: 72 unknown, 196 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-09-21T17:49:49.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:49:48 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:49:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:49 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-27"}]': finished 2024-09-21T17:49:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-27", "mode": "writeback"} : dispatch 2024-09-21T17:49:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:49 smithi162 ceph-mon[32106]: osdmap e209: 8 total, 8 up, 8 in 2024-09-21T17:49:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-27", "mode": "writeback"} : dispatch 2024-09-21T17:49:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:49.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-27"}]': finished 2024-09-21T17:49:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-27", "mode": "writeback"} : dispatch 2024-09-21T17:49:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[29361]: osdmap e209: 8 total, 8 up, 8 in 2024-09-21T17:49:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-27", "mode": "writeback"} : dispatch 2024-09-21T17:49:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:49.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-27"}]': finished 2024-09-21T17:49:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-27", "mode": "writeback"} : dispatch 2024-09-21T17:49:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[38309]: osdmap e209: 8 total, 8 up, 8 in 2024-09-21T17:49:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-27", "mode": "writeback"} : dispatch 2024-09-21T17:49:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:50 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-27", "mode": "writeback"}]': finished 2024-09-21T17:49:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:50 smithi162 ceph-mon[32106]: osdmap e210: 8 total, 8 up, 8 in 2024-09-21T17:49:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:50 smithi162 ceph-mon[32106]: pgmap v267: 228 pgs: 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:49:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"}]': finished 2024-09-21T17:49:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-27", "mode": "writeback"}]': finished 2024-09-21T17:49:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[29361]: osdmap e210: 8 total, 8 up, 8 in 2024-09-21T17:49:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[29361]: pgmap v267: 228 pgs: 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:49:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"}]': finished 2024-09-21T17:49:50.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:49:50.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:49:50.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-27", "mode": "writeback"}]': finished 2024-09-21T17:49:50.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:50.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[38309]: osdmap e210: 8 total, 8 up, 8 in 2024-09-21T17:49:50.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:50.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:50.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:50.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:50.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[38309]: pgmap v267: 228 pgs: 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:49:50.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi042-71275-36"}]': finished 2024-09-21T17:49:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:51 smithi162 ceph-mon[32106]: osdmap e211: 8 total, 8 up, 8 in 2024-09-21T17:49:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-46"}]': finished 2024-09-21T17:49:51.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"}]': finished 2024-09-21T17:49:51.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:51.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:51 smithi162 ceph-mon[32106]: osdmap e212: 8 total, 8 up, 8 in 2024-09-21T17:49:51.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:51.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:51.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:51.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[29361]: osdmap e211: 8 total, 8 up, 8 in 2024-09-21T17:49:51.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:51.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:51.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:51.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-46"}]': finished 2024-09-21T17:49:51.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"}]': finished 2024-09-21T17:49:51.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:51.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[29361]: osdmap e212: 8 total, 8 up, 8 in 2024-09-21T17:49:51.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1485048513' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[38309]: osdmap e211: 8 total, 8 up, 8 in 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"} : dispatch 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-46"}]': finished 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi042-71275-36"}]': finished 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[38309]: osdmap e212: 8 total, 8 up, 8 in 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:51.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27"} : dispatch 2024-09-21T17:49:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:52 smithi162 ceph-mon[32106]: pgmap v270: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:49:52.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:52 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:52.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27"}]': finished 2024-09-21T17:49:52.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:52.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:52 smithi162 ceph-mon[32106]: osdmap e213: 8 total, 8 up, 8 in 2024-09-21T17:49:52.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi042-71275-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[29361]: pgmap v270: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:49:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27"}]': finished 2024-09-21T17:49:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[29361]: osdmap e213: 8 total, 8 up, 8 in 2024-09-21T17:49:52.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi042-71275-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[38309]: pgmap v270: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:49:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:49:52.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-27"}]': finished 2024-09-21T17:49:52.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:52.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[38309]: osdmap e213: 8 total, 8 up, 8 in 2024-09-21T17:49:52.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi042-71275-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:54.165 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:49:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:49:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:49:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:54 smithi162 ceph-mon[32106]: osdmap e214: 8 total, 8 up, 8 in 2024-09-21T17:49:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:54 smithi162 ceph-mon[32106]: pgmap v273: 196 pgs: 196 active+clean; 584 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:54.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:54 smithi042 ceph-mon[29361]: osdmap e214: 8 total, 8 up, 8 in 2024-09-21T17:49:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:54 smithi042 ceph-mon[29361]: pgmap v273: 196 pgs: 196 active+clean; 584 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:54 smithi042 ceph-mon[38309]: osdmap e214: 8 total, 8 up, 8 in 2024-09-21T17:49:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:54 smithi042 ceph-mon[38309]: pgmap v273: 196 pgs: 196 active+clean; 584 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:55 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi042-71275-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi042-71275-37"}]': finished 2024-09-21T17:49:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"}]': finished 2024-09-21T17:49:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:55 smithi162 ceph-mon[32106]: osdmap e215: 8 total, 8 up, 8 in 2024-09-21T17:49:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:55.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:55.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi042-71275-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi042-71275-37"}]': finished 2024-09-21T17:49:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"}]': finished 2024-09-21T17:49:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[29361]: osdmap e215: 8 total, 8 up, 8 in 2024-09-21T17:49:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:55.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:49:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi042-71275-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi042-71275-37"}]': finished 2024-09-21T17:49:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-46"}]': finished 2024-09-21T17:49:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[38309]: osdmap e215: 8 total, 8 up, 8 in 2024-09-21T17:49:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1839405552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:49:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"} : dispatch 2024-09-21T17:49:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"}]': finished 2024-09-21T17:49:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: osdmap e216: 8 total, 8 up, 8 in 2024-09-21T17:49:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:56.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:56.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: pgmap v276: 236 pgs: 40 unknown, 196 active+clean; 584 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:56.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:56.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: osdmap e217: 8 total, 8 up, 8 in 2024-09-21T17:49:56.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:56.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:56.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"}]': finished 2024-09-21T17:49:56.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: osdmap e216: 8 total, 8 up, 8 in 2024-09-21T17:49:56.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:56.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:56.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: pgmap v276: 236 pgs: 40 unknown, 196 active+clean; 584 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:56.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:56.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: osdmap e217: 8 total, 8 up, 8 in 2024-09-21T17:49:56.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:56.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-46"}]': finished 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: osdmap e216: 8 total, 8 up, 8 in 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: pgmap v276: 236 pgs: 40 unknown, 196 active+clean; 584 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi042-71285-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: osdmap e217: 8 total, 8 up, 8 in 2024-09-21T17:49:56.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:56.569 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:56.569 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:49:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37"}]': finished 2024-09-21T17:49:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:58.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:58 smithi162 ceph-mon[32106]: osdmap e218: 8 total, 8 up, 8 in 2024-09-21T17:49:58.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:58.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:58.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:58 smithi162 ceph-mon[32106]: pgmap v279: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:49:58.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:58.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37"}]': finished 2024-09-21T17:49:58.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:58.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[29361]: osdmap e218: 8 total, 8 up, 8 in 2024-09-21T17:49:58.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:58.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:58.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[29361]: pgmap v279: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:49:58.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi042-71275-37"}]': finished 2024-09-21T17:49:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[38309]: osdmap e218: 8 total, 8 up, 8 in 2024-09-21T17:49:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi042-71275-37"} : dispatch 2024-09-21T17:49:58.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:49:58.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[38309]: pgmap v279: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:49:58.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:49:59.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:49:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:49:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-47"}]': finished 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi042-71275-37"}]': finished 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: osdmap e219: 8 total, 8 up, 8 in 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi042-71275-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi042-71275-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-29"}]': finished 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi042-71275-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: osdmap e220: 8 total, 8 up, 8 in 2024-09-21T17:49:59.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi042-71275-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi042-71275-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-29", "mode": "writeback"} : dispatch 2024-09-21T17:49:59.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:49:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-29", "mode": "writeback"} : dispatch 2024-09-21T17:49:59.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-47"}]': finished 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi042-71275-37"}]': finished 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: osdmap e219: 8 total, 8 up, 8 in 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi042-71275-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi042-71275-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-29"}]': finished 2024-09-21T17:49:59.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi042-71275-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:59.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: osdmap e220: 8 total, 8 up, 8 in 2024-09-21T17:49:59.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi042-71275-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi042-71275-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-29", "mode": "writeback"} : dispatch 2024-09-21T17:49:59.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-29", "mode": "writeback"} : dispatch 2024-09-21T17:49:59.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi042-71285-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi042-71285-47"}]': finished 2024-09-21T17:49:59.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1674677989' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi042-71275-37"}]': finished 2024-09-21T17:49:59.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:49:59.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: osdmap e219: 8 total, 8 up, 8 in 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi042-71275-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi042-71275-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-29"}]': finished 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi042-71275-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: osdmap e220: 8 total, 8 up, 8 in 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi042-71275-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi042-71275-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:49:59.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-29", "mode": "writeback"} : dispatch 2024-09-21T17:49:59.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:49:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-29", "mode": "writeback"} : dispatch 2024-09-21T17:50:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:00 smithi162 ceph-mon[32106]: pgmap v282: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2024-09-21T17:50:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:00 smithi162 ceph-mon[32106]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-09-21T17:50:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:00 smithi162 ceph-mon[32106]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-21T17:50:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:00 smithi162 ceph-mon[32106]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-21T17:50:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:00 smithi162 ceph-mon[32106]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-21T17:50:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:00 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-29", "mode": "writeback"}]': finished 2024-09-21T17:50:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:00 smithi162 ceph-mon[32106]: osdmap e221: 8 total, 8 up, 8 in 2024-09-21T17:50:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:00.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:00.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[29361]: pgmap v282: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2024-09-21T17:50:00.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[29361]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-09-21T17:50:00.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[29361]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-21T17:50:00.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[29361]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-21T17:50:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[29361]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-21T17:50:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-29", "mode": "writeback"}]': finished 2024-09-21T17:50:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[29361]: osdmap e221: 8 total, 8 up, 8 in 2024-09-21T17:50:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[38309]: pgmap v282: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2024-09-21T17:50:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[38309]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-09-21T17:50:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[38309]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-21T17:50:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[38309]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-21T17:50:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[38309]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-21T17:50:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-29", "mode": "writeback"}]': finished 2024-09-21T17:50:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[38309]: osdmap e221: 8 total, 8 up, 8 in 2024-09-21T17:50:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:01 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi042-71275-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi042-71275-38"}]': finished 2024-09-21T17:50:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"}]': finished 2024-09-21T17:50:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:01 smithi162 ceph-mon[32106]: osdmap e222: 8 total, 8 up, 8 in 2024-09-21T17:50:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:01.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:01.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi042-71275-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi042-71275-38"}]': finished 2024-09-21T17:50:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"}]': finished 2024-09-21T17:50:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[29361]: osdmap e222: 8 total, 8 up, 8 in 2024-09-21T17:50:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi042-71275-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi042-71275-38"}]': finished 2024-09-21T17:50:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi042-71285-47"}]': finished 2024-09-21T17:50:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1711505914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[38309]: osdmap e222: 8 total, 8 up, 8 in 2024-09-21T17:50:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"} : dispatch 2024-09-21T17:50:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:02 smithi162 ceph-mon[32106]: pgmap v285: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T17:50:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"}]': finished 2024-09-21T17:50:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:02 smithi162 ceph-mon[32106]: osdmap e223: 8 total, 8 up, 8 in 2024-09-21T17:50:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi042-71285-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi042-71285-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:02.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[29361]: pgmap v285: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T17:50:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"}]': finished 2024-09-21T17:50:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[29361]: osdmap e223: 8 total, 8 up, 8 in 2024-09-21T17:50:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi042-71285-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi042-71285-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[38309]: pgmap v285: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T17:50:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi042-71285-47"}]': finished 2024-09-21T17:50:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[38309]: osdmap e223: 8 total, 8 up, 8 in 2024-09-21T17:50:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi042-71285-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi042-71285-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:04.152 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:50:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:50:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:50:04.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi042-71285-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[29361]: osdmap e224: 8 total, 8 up, 8 in 2024-09-21T17:50:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi042-71285-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi042-71285-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:04.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[29361]: pgmap v288: 228 pgs: 228 active+clean; 4.6 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-21T17:50:04.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi042-71285-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:04.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[38309]: osdmap e224: 8 total, 8 up, 8 in 2024-09-21T17:50:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi042-71285-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi042-71285-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:04.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:04 smithi042 ceph-mon[38309]: pgmap v288: 228 pgs: 228 active+clean; 4.6 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-21T17:50:04.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi042-71285-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:04.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:04 smithi162 ceph-mon[32106]: osdmap e224: 8 total, 8 up, 8 in 2024-09-21T17:50:04.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi042-71285-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:04.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi042-71285-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:04 smithi162 ceph-mon[32106]: pgmap v288: 228 pgs: 228 active+clean; 4.6 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-21T17:50:05.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"}]': finished 2024-09-21T17:50:05.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:05.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:05 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:50:05.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:05 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:05.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:05 smithi162 ceph-mon[32106]: osdmap e225: 8 total, 8 up, 8 in 2024-09-21T17:50:05.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:50:05.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"}]': finished 2024-09-21T17:50:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:50:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[29361]: osdmap e225: 8 total, 8 up, 8 in 2024-09-21T17:50:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:50:05.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:05.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi042-71275-38"}]': finished 2024-09-21T17:50:05.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:05.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:50:05.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/378225742' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:05.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[38309]: osdmap e225: 8 total, 8 up, 8 in 2024-09-21T17:50:05.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29"} : dispatch 2024-09-21T17:50:05.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"} : dispatch 2024-09-21T17:50:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi042-71285-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi042-71285-48"}]': finished 2024-09-21T17:50:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29"}]': finished 2024-09-21T17:50:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"}]': finished 2024-09-21T17:50:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: osdmap e226: 8 total, 8 up, 8 in 2024-09-21T17:50:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi042-71275-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi042-71275-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: pgmap v291: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1024 KiB/s wr, 27 op/s 2024-09-21T17:50:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi042-71275-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: osdmap e227: 8 total, 8 up, 8 in 2024-09-21T17:50:06.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi042-71275-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi042-71285-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi042-71285-48"}]': finished 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29"}]': finished 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"}]': finished 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: osdmap e226: 8 total, 8 up, 8 in 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi042-71275-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi042-71275-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: pgmap v291: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1024 KiB/s wr, 27 op/s 2024-09-21T17:50:06.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi042-71275-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:06.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: osdmap e227: 8 total, 8 up, 8 in 2024-09-21T17:50:06.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi042-71275-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi042-71285-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi042-71285-48"}]': finished 2024-09-21T17:50:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-29"}]': finished 2024-09-21T17:50:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi042-71275-38"}]': finished 2024-09-21T17:50:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: osdmap e226: 8 total, 8 up, 8 in 2024-09-21T17:50:06.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:06.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi042-71275-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:06.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi042-71275-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:06.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: pgmap v291: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1024 KiB/s wr, 27 op/s 2024-09-21T17:50:06.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi042-71275-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:06.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: osdmap e227: 8 total, 8 up, 8 in 2024-09-21T17:50:06.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi042-71275-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:07 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi042-71275-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:07 smithi162 ceph-mon[32106]: osdmap e228: 8 total, 8 up, 8 in 2024-09-21T17:50:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:07.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:07.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi042-71275-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[29361]: osdmap e228: 8 total, 8 up, 8 in 2024-09-21T17:50:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi042-71275-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[38309]: osdmap e228: 8 total, 8 up, 8 in 2024-09-21T17:50:07.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:07.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:07.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:08 smithi162 ceph-mon[32106]: pgmap v294: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi042-71275-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi042-71275-39"}]': finished 2024-09-21T17:50:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"}]': finished 2024-09-21T17:50:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:08 smithi162 ceph-mon[32106]: osdmap e229: 8 total, 8 up, 8 in 2024-09-21T17:50:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:08.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:08.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:08.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[29361]: pgmap v294: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi042-71275-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi042-71275-39"}]': finished 2024-09-21T17:50:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"}]': finished 2024-09-21T17:50:08.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[29361]: osdmap e229: 8 total, 8 up, 8 in 2024-09-21T17:50:08.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:08.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:08.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:08.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:08.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[38309]: pgmap v294: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:08.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi042-71275-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi042-71275-39"}]': finished 2024-09-21T17:50:08.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:08.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi042-71285-48"}]': finished 2024-09-21T17:50:08.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[38309]: osdmap e229: 8 total, 8 up, 8 in 2024-09-21T17:50:08.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1435113971' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:08.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:08.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"} : dispatch 2024-09-21T17:50:08.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:09.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:50:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:50:10.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:10.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"}]': finished 2024-09-21T17:50:10.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:10.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: osdmap e230: 8 total, 8 up, 8 in 2024-09-21T17:50:10.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:10.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:10.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi042-71285-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:10.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi042-71285-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:10.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[29361]: pgmap v297: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:10.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:10.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"}]': finished 2024-09-21T17:50:10.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:10.417 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: osdmap e230: 8 total, 8 up, 8 in 2024-09-21T17:50:10.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:10.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:10.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.418 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi042-71285-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:10.419 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi042-71285-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:10.420 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:10 smithi042 ceph-mon[38309]: pgmap v297: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi042-71285-48"}]': finished 2024-09-21T17:50:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: osdmap e230: 8 total, 8 up, 8 in 2024-09-21T17:50:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi042-71285-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi042-71285-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:10 smithi162 ceph-mon[32106]: pgmap v297: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-31"}]': finished 2024-09-21T17:50:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi042-71285-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:11 smithi162 ceph-mon[32106]: osdmap e231: 8 total, 8 up, 8 in 2024-09-21T17:50:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-31", "mode": "writeback"} : dispatch 2024-09-21T17:50:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi042-71285-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-31", "mode": "writeback"} : dispatch 2024-09-21T17:50:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi042-71285-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:11.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-31"}]': finished 2024-09-21T17:50:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi042-71285-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[29361]: osdmap e231: 8 total, 8 up, 8 in 2024-09-21T17:50:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-31", "mode": "writeback"} : dispatch 2024-09-21T17:50:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi042-71285-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-31", "mode": "writeback"} : dispatch 2024-09-21T17:50:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi042-71285-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:11.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:11.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-31"}]': finished 2024-09-21T17:50:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi042-71285-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[38309]: osdmap e231: 8 total, 8 up, 8 in 2024-09-21T17:50:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-31", "mode": "writeback"} : dispatch 2024-09-21T17:50:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi042-71285-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-31", "mode": "writeback"} : dispatch 2024-09-21T17:50:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi042-71285-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:11.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-31", "mode": "writeback"}]': finished 2024-09-21T17:50:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"}]': finished 2024-09-21T17:50:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: osdmap e232: 8 total, 8 up, 8 in 2024-09-21T17:50:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: pgmap v300: 228 pgs: 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi042-71285-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi042-71285-49"}]': finished 2024-09-21T17:50:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"}]': finished 2024-09-21T17:50:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: osdmap e233: 8 total, 8 up, 8 in 2024-09-21T17:50:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:12.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:12.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-31", "mode": "writeback"}]': finished 2024-09-21T17:50:12.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"}]': finished 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: osdmap e232: 8 total, 8 up, 8 in 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: pgmap v300: 228 pgs: 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi042-71285-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi042-71285-49"}]': finished 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"}]': finished 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: osdmap e233: 8 total, 8 up, 8 in 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:12.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:12.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-31", "mode": "writeback"}]': finished 2024-09-21T17:50:12.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi042-71275-39"}]': finished 2024-09-21T17:50:12.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/923200083' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:12.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: osdmap e232: 8 total, 8 up, 8 in 2024-09-21T17:50:12.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"} : dispatch 2024-09-21T17:50:12.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:12.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:12.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: pgmap v300: 228 pgs: 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:12.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi042-71285-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi042-71285-49"}]': finished 2024-09-21T17:50:12.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi042-71275-39"}]': finished 2024-09-21T17:50:12.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:12.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: osdmap e233: 8 total, 8 up, 8 in 2024-09-21T17:50:12.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:12.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31"} : dispatch 2024-09-21T17:50:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi042-71275-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi042-71275-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31"}]': finished 2024-09-21T17:50:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi042-71275-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: osdmap e234: 8 total, 8 up, 8 in 2024-09-21T17:50:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemove_smithi042-71275-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemove_smithi042-71275-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi042-71275-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi042-71275-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:50:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:13.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:13.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31"}]': finished 2024-09-21T17:50:13.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi042-71275-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:13.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: osdmap e234: 8 total, 8 up, 8 in 2024-09-21T17:50:13.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemove_smithi042-71275-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemove_smithi042-71275-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:13.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi042-71275-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi042-71275-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-31"}]': finished 2024-09-21T17:50:13.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi042-71275-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:13.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: osdmap e234: 8 total, 8 up, 8 in 2024-09-21T17:50:13.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemove_smithi042-71275-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:13.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemove_smithi042-71275-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:50:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:50:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:50:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:14 smithi162 ceph-mon[32106]: pgmap v303: 236 pgs: 236 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:14 smithi162 ceph-mon[32106]: osdmap e235: 8 total, 8 up, 8 in 2024-09-21T17:50:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:14.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:14 smithi042 ceph-mon[29361]: pgmap v303: 236 pgs: 236 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:14.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:14 smithi042 ceph-mon[29361]: osdmap e235: 8 total, 8 up, 8 in 2024-09-21T17:50:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:14.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:14 smithi042 ceph-mon[38309]: pgmap v303: 236 pgs: 236 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:14.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:14 smithi042 ceph-mon[38309]: osdmap e235: 8 total, 8 up, 8 in 2024-09-21T17:50:14.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi042-71275-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi042-71275-40"}]': finished 2024-09-21T17:50:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"}]': finished 2024-09-21T17:50:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:15 smithi162 ceph-mon[32106]: osdmap e236: 8 total, 8 up, 8 in 2024-09-21T17:50:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:15.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi042-71275-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi042-71275-40"}]': finished 2024-09-21T17:50:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"}]': finished 2024-09-21T17:50:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[29361]: osdmap e236: 8 total, 8 up, 8 in 2024-09-21T17:50:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi042-71275-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi042-71275-40"}]': finished 2024-09-21T17:50:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi042-71285-49"}]': finished 2024-09-21T17:50:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[38309]: osdmap e236: 8 total, 8 up, 8 in 2024-09-21T17:50:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2285952393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"} : dispatch 2024-09-21T17:50:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:16 smithi162 ceph-mon[32106]: pgmap v306: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:16 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"}]': finished 2024-09-21T17:50:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:16 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:16 smithi162 ceph-mon[32106]: osdmap e237: 8 total, 8 up, 8 in 2024-09-21T17:50:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:16 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:16 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:16.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[29361]: pgmap v306: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"}]': finished 2024-09-21T17:50:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[29361]: osdmap e237: 8 total, 8 up, 8 in 2024-09-21T17:50:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[38309]: pgmap v306: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi042-71285-49"}]': finished 2024-09-21T17:50:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[38309]: osdmap e237: 8 total, 8 up, 8 in 2024-09-21T17:50:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:16.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:16 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi042-71285-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi042-71285-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:17 smithi162 ceph-mon[32106]: osdmap e238: 8 total, 8 up, 8 in 2024-09-21T17:50:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP2_smithi042-71285-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:17.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:17.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi042-71285-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi042-71285-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[29361]: osdmap e238: 8 total, 8 up, 8 in 2024-09-21T17:50:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP2_smithi042-71285-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:17.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi042-71285-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi042-71285-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[38309]: osdmap e238: 8 total, 8 up, 8 in 2024-09-21T17:50:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP2_smithi042-71285-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:17.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:18 smithi162 ceph-mon[32106]: pgmap v309: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-33"}]': finished 2024-09-21T17:50:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"}]': finished 2024-09-21T17:50:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-33", "mode": "writeback"} : dispatch 2024-09-21T17:50:18.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:18 smithi162 ceph-mon[32106]: osdmap e239: 8 total, 8 up, 8 in 2024-09-21T17:50:18.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-33", "mode": "writeback"} : dispatch 2024-09-21T17:50:18.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:18.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[38309]: pgmap v309: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:18.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-33"}]': finished 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"}]': finished 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-33", "mode": "writeback"} : dispatch 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[38309]: osdmap e239: 8 total, 8 up, 8 in 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-33", "mode": "writeback"} : dispatch 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[29361]: pgmap v309: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-33"}]': finished 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi042-71275-40"}]': finished 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2344384246' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-33", "mode": "writeback"} : dispatch 2024-09-21T17:50:18.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[29361]: osdmap e239: 8 total, 8 up, 8 in 2024-09-21T17:50:18.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-33", "mode": "writeback"} : dispatch 2024-09-21T17:50:18.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"} : dispatch 2024-09-21T17:50:19.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:50:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:50:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:19 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:19 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi042-71285-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi042-71285-50"}]': finished 2024-09-21T17:50:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-33", "mode": "writeback"}]': finished 2024-09-21T17:50:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"}]': finished 2024-09-21T17:50:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:19 smithi162 ceph-mon[32106]: osdmap e240: 8 total, 8 up, 8 in 2024-09-21T17:50:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:19.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi042-71275-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi042-71285-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi042-71285-50"}]': finished 2024-09-21T17:50:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-33", "mode": "writeback"}]': finished 2024-09-21T17:50:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"}]': finished 2024-09-21T17:50:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[29361]: osdmap e240: 8 total, 8 up, 8 in 2024-09-21T17:50:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi042-71275-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:19.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:19.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi042-71285-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi042-71285-50"}]': finished 2024-09-21T17:50:19.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-33", "mode": "writeback"}]': finished 2024-09-21T17:50:19.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi042-71275-40"}]': finished 2024-09-21T17:50:19.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[38309]: osdmap e240: 8 total, 8 up, 8 in 2024-09-21T17:50:19.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:19.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:19.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi042-71275-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:20 smithi162 ceph-mon[32106]: pgmap v312: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi042-71275-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:20.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:20.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:20 smithi162 ceph-mon[32106]: osdmap e241: 8 total, 8 up, 8 in 2024-09-21T17:50:20.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClass_smithi042-71275-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:20.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:20.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[29361]: pgmap v312: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi042-71275-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[29361]: osdmap e241: 8 total, 8 up, 8 in 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClass_smithi042-71275-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[38309]: pgmap v312: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:20.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi042-71275-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:20.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:20.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[38309]: osdmap e241: 8 total, 8 up, 8 in 2024-09-21T17:50:20.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClass_smithi042-71275-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:20.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:20.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33"} : dispatch 2024-09-21T17:50:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:21 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:21.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33"}]': finished 2024-09-21T17:50:21.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:21 smithi162 ceph-mon[32106]: osdmap e242: 8 total, 8 up, 8 in 2024-09-21T17:50:21.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:21 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33"}]': finished 2024-09-21T17:50:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:21 smithi042 ceph-mon[29361]: osdmap e242: 8 total, 8 up, 8 in 2024-09-21T17:50:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:21 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-33"}]': finished 2024-09-21T17:50:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:21 smithi042 ceph-mon[38309]: osdmap e242: 8 total, 8 up, 8 in 2024-09-21T17:50:21.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:22 smithi162 ceph-mon[32106]: pgmap v315: 228 pgs: 228 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi042-71275-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi042-71275-41"}]': finished 2024-09-21T17:50:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi042-71285-50"}]': finished 2024-09-21T17:50:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:22 smithi162 ceph-mon[32106]: osdmap e243: 8 total, 8 up, 8 in 2024-09-21T17:50:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:22 smithi042 ceph-mon[29361]: pgmap v315: 228 pgs: 228 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi042-71275-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi042-71275-41"}]': finished 2024-09-21T17:50:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi042-71285-50"}]': finished 2024-09-21T17:50:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:22 smithi042 ceph-mon[29361]: osdmap e243: 8 total, 8 up, 8 in 2024-09-21T17:50:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:22 smithi042 ceph-mon[38309]: pgmap v315: 228 pgs: 228 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi042-71275-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi042-71275-41"}]': finished 2024-09-21T17:50:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi042-71285-50"}]': finished 2024-09-21T17:50:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:22 smithi042 ceph-mon[38309]: osdmap e243: 8 total, 8 up, 8 in 2024-09-21T17:50:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi042-71285-50"} : dispatch 2024-09-21T17:50:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:50:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:50:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:50:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi042-71285-50"}]': finished 2024-09-21T17:50:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:24 smithi162 ceph-mon[32106]: osdmap e244: 8 total, 8 up, 8 in 2024-09-21T17:50:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:24 smithi162 ceph-mon[32106]: pgmap v318: 236 pgs: 15 creating+peering, 20 unknown, 201 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:24.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi042-71285-50"}]': finished 2024-09-21T17:50:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:24 smithi042 ceph-mon[29361]: osdmap e244: 8 total, 8 up, 8 in 2024-09-21T17:50:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:24 smithi042 ceph-mon[29361]: pgmap v318: 236 pgs: 15 creating+peering, 20 unknown, 201 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1326035595' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi042-71285-50"}]': finished 2024-09-21T17:50:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:24 smithi042 ceph-mon[38309]: osdmap e244: 8 total, 8 up, 8 in 2024-09-21T17:50:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:24 smithi042 ceph-mon[38309]: pgmap v318: 236 pgs: 15 creating+peering, 20 unknown, 201 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:25 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:25 smithi162 ceph-mon[32106]: osdmap e245: 8 total, 8 up, 8 in 2024-09-21T17:50:25.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:25.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:25.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:25.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1105383075' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:25.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:25.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:25.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:25.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[29361]: osdmap e245: 8 total, 8 up, 8 in 2024-09-21T17:50:25.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:25.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:25.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:25.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1105383075' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:25.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:25.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:25.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:25.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[38309]: osdmap e245: 8 total, 8 up, 8 in 2024-09-21T17:50:25.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:25.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:25.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:25.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1105383075' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:25.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi042-71275-41"}]': finished 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: osdmap e246: 8 total, 8 up, 8 in 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: pgmap v321: 260 pgs: 32 creating+peering, 32 unknown, 196 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi042-71275-41"}]': finished 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"}]': finished 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: osdmap e247: 8 total, 8 up, 8 in 2024-09-21T17:50:26.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-35", "mode": "writeback"} : dispatch 2024-09-21T17:50:26.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-35", "mode": "writeback"} : dispatch 2024-09-21T17:50:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi042-71275-41"}]': finished 2024-09-21T17:50:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: osdmap e246: 8 total, 8 up, 8 in 2024-09-21T17:50:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: pgmap v321: 260 pgs: 32 creating+peering, 32 unknown, 196 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi042-71275-41"}]': finished 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"}]': finished 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: osdmap e247: 8 total, 8 up, 8 in 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-35", "mode": "writeback"} : dispatch 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-35", "mode": "writeback"} : dispatch 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi042-71275-41"}]': finished 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi042-71285-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: osdmap e246: 8 total, 8 up, 8 in 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi042-71275-41"} : dispatch 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:26.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: pgmap v321: 260 pgs: 32 creating+peering, 32 unknown, 196 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:50:26.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/72172575' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi042-71275-41"}]': finished 2024-09-21T17:50:26.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"}]': finished 2024-09-21T17:50:26.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: osdmap e247: 8 total, 8 up, 8 in 2024-09-21T17:50:26.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-35", "mode": "writeback"} : dispatch 2024-09-21T17:50:26.568 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-35", "mode": "writeback"} : dispatch 2024-09-21T17:50:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi042-71275-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi042-71275-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-35", "mode": "writeback"}]': finished 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi042-71275-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: osdmap e248: 8 total, 8 up, 8 in 2024-09-21T17:50:27.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi042-71275-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi042-71285-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:27.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi042-71275-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi042-71275-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi042-71275-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-35", "mode": "writeback"}]': finished 2024-09-21T17:50:27.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:27.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi042-71275-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:27.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: osdmap e248: 8 total, 8 up, 8 in 2024-09-21T17:50:27.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi042-71275-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi042-71285-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:27.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi042-71275-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:27.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi042-71275-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi042-71275-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-35", "mode": "writeback"}]': finished 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi042-71275-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: osdmap e248: 8 total, 8 up, 8 in 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi042-71275-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi042-71285-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:27.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi042-71275-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:28.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:28 smithi042 ceph-mon[29361]: pgmap v324: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T17:50:28.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:28.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:28 smithi042 ceph-mon[29361]: osdmap e249: 8 total, 8 up, 8 in 2024-09-21T17:50:28.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:28 smithi042 ceph-mon[38309]: pgmap v324: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T17:50:28.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:28.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:28 smithi042 ceph-mon[38309]: osdmap e249: 8 total, 8 up, 8 in 2024-09-21T17:50:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:28 smithi162 ceph-mon[32106]: pgmap v324: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T17:50:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:28 smithi162 ceph-mon[32106]: osdmap e249: 8 total, 8 up, 8 in 2024-09-21T17:50:29.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:50:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:50:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi042-71285-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi042-71285-52"}]': finished 2024-09-21T17:50:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi042-71275-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi042-71275-42"}]': finished 2024-09-21T17:50:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:30 smithi162 ceph-mon[32106]: osdmap e250: 8 total, 8 up, 8 in 2024-09-21T17:50:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:30.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:30 smithi162 ceph-mon[32106]: pgmap v327: 244 pgs: 16 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:50:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi042-71285-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi042-71285-52"}]': finished 2024-09-21T17:50:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi042-71275-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi042-71275-42"}]': finished 2024-09-21T17:50:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[29361]: osdmap e250: 8 total, 8 up, 8 in 2024-09-21T17:50:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[29361]: pgmap v327: 244 pgs: 16 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:50:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi042-71285-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi042-71285-52"}]': finished 2024-09-21T17:50:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi042-71275-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi042-71275-42"}]': finished 2024-09-21T17:50:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[38309]: osdmap e250: 8 total, 8 up, 8 in 2024-09-21T17:50:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:30 smithi042 ceph-mon[38309]: pgmap v327: 244 pgs: 16 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:50:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:31 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:31 smithi162 ceph-mon[32106]: osdmap e251: 8 total, 8 up, 8 in 2024-09-21T17:50:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:31.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:31.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:31 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:31.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:31 smithi042 ceph-mon[29361]: osdmap e251: 8 total, 8 up, 8 in 2024-09-21T17:50:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:31.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:31 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:31 smithi042 ceph-mon[38309]: osdmap e251: 8 total, 8 up, 8 in 2024-09-21T17:50:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:31.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"}]': finished 2024-09-21T17:50:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:32 smithi162 ceph-mon[32106]: osdmap e252: 8 total, 8 up, 8 in 2024-09-21T17:50:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:32 smithi162 ceph-mon[32106]: pgmap v330: 228 pgs: 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:50:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"}]': finished 2024-09-21T17:50:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[29361]: osdmap e252: 8 total, 8 up, 8 in 2024-09-21T17:50:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[29361]: pgmap v330: 228 pgs: 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:50:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-35"}]': finished 2024-09-21T17:50:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[38309]: osdmap e252: 8 total, 8 up, 8 in 2024-09-21T17:50:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:32 smithi042 ceph-mon[38309]: pgmap v330: 228 pgs: 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:50:33.234 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7012 ms) 2024-09-21T17:50:33.234 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6955 ms) 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7036 ms) 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6976 ms) 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7023 ms) 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7017 ms) 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7036 ms) 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-09-21T17:50:33.235 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7015 ms) 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6931 ms) 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7010 ms) 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7024 ms) 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6964 ms) 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7008 ms) 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7013 ms) 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-09-21T17:50:33.236 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7022 ms) 2024-09-21T17:50:33.237 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-09-21T17:50:33.237 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7025 ms) 2024-09-21T17:50:33.237 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112068 ms total) 2024-09-21T17:50:33.237 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: 2024-09-21T17:50:33.237 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [----------] Global test environment tear-down 2024-09-21T17:50:33.237 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (189547 ms total) 2024-09-21T17:50:33.237 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio: [ PASSED ] 42 tests. 2024-09-21T17:50:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52"}]': finished 2024-09-21T17:50:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"}]': finished 2024-09-21T17:50:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:33 smithi162 ceph-mon[32106]: osdmap e253: 8 total, 8 up, 8 in 2024-09-21T17:50:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:33.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:33.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52"}]': finished 2024-09-21T17:50:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"}]': finished 2024-09-21T17:50:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[29361]: osdmap e253: 8 total, 8 up, 8 in 2024-09-21T17:50:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi042-71285-52"}]': finished 2024-09-21T17:50:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi042-71275-42"}]': finished 2024-09-21T17:50:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[38309]: osdmap e253: 8 total, 8 up, 8 in 2024-09-21T17:50:33.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1014085797' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:33.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi042-71285-52"} : dispatch 2024-09-21T17:50:33.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"} : dispatch 2024-09-21T17:50:33.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:33.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:34.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:50:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:50:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:50:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi042-71285-52"}]': finished 2024-09-21T17:50:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"}]': finished 2024-09-21T17:50:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: osdmap e254: 8 total, 8 up, 8 in 2024-09-21T17:50:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: pgmap v333: 228 pgs: 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35"}]': finished 2024-09-21T17:50:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: osdmap e255: 8 total, 8 up, 8 in 2024-09-21T17:50:34.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi042-71285-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi042-71285-52"}]': finished 2024-09-21T17:50:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"}]': finished 2024-09-21T17:50:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: osdmap e254: 8 total, 8 up, 8 in 2024-09-21T17:50:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: pgmap v333: 228 pgs: 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:34.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35"}]': finished 2024-09-21T17:50:34.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:34.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: osdmap e255: 8 total, 8 up, 8 in 2024-09-21T17:50:34.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi042-71285-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/589036346' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi042-71285-52"}]': finished 2024-09-21T17:50:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi042-71275-42"}]': finished 2024-09-21T17:50:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: osdmap e254: 8 total, 8 up, 8 in 2024-09-21T17:50:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35"} : dispatch 2024-09-21T17:50:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:34.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:34.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:34.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: pgmap v333: 228 pgs: 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:34.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:34.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-35"}]': finished 2024-09-21T17:50:34.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:34.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: osdmap e255: 8 total, 8 up, 8 in 2024-09-21T17:50:34.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi042-71285-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:36 smithi162 ceph-mon[32106]: osdmap e256: 8 total, 8 up, 8 in 2024-09-21T17:50:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:36 smithi162 ceph-mon[32106]: pgmap v336: 196 pgs: 196 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T17:50:36.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:36 smithi042 ceph-mon[29361]: osdmap e256: 8 total, 8 up, 8 in 2024-09-21T17:50:36.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:36 smithi042 ceph-mon[29361]: pgmap v336: 196 pgs: 196 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T17:50:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:36 smithi042 ceph-mon[38309]: osdmap e256: 8 total, 8 up, 8 in 2024-09-21T17:50:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:36 smithi042 ceph-mon[38309]: pgmap v336: 196 pgs: 196 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T17:50:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi042-71285-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi042-71285-53"}]': finished 2024-09-21T17:50:37.615 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:37 smithi162 ceph-mon[32106]: osdmap e257: 8 total, 8 up, 8 in 2024-09-21T17:50:37.615 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:37.616 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi042-71285-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi042-71285-53"}]': finished 2024-09-21T17:50:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:37 smithi042 ceph-mon[29361]: osdmap e257: 8 total, 8 up, 8 in 2024-09-21T17:50:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi042-71285-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi042-71285-53"}]': finished 2024-09-21T17:50:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:37 smithi042 ceph-mon[38309]: osdmap e257: 8 total, 8 up, 8 in 2024-09-21T17:50:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:38 smithi162 ceph-mon[32106]: osdmap e258: 8 total, 8 up, 8 in 2024-09-21T17:50:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:38 smithi162 ceph-mon[32106]: pgmap v339: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 255 B/s wr, 0 op/s 2024-09-21T17:50:38.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:38 smithi042 ceph-mon[29361]: osdmap e258: 8 total, 8 up, 8 in 2024-09-21T17:50:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:38 smithi042 ceph-mon[29361]: pgmap v339: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 255 B/s wr, 0 op/s 2024-09-21T17:50:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:38 smithi042 ceph-mon[38309]: osdmap e258: 8 total, 8 up, 8 in 2024-09-21T17:50:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:38.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:38.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:38 smithi042 ceph-mon[38309]: pgmap v339: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 255 B/s wr, 0 op/s 2024-09-21T17:50:39.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:50:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:50:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: osdmap e259: 8 total, 8 up, 8 in 2024-09-21T17:50:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-37"}]': finished 2024-09-21T17:50:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53"}]': finished 2024-09-21T17:50:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-37", "mode": "writeback"} : dispatch 2024-09-21T17:50:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: osdmap e260: 8 total, 8 up, 8 in 2024-09-21T17:50:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:39.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-37", "mode": "writeback"} : dispatch 2024-09-21T17:50:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: osdmap e259: 8 total, 8 up, 8 in 2024-09-21T17:50:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-37"}]': finished 2024-09-21T17:50:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53"}]': finished 2024-09-21T17:50:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-37", "mode": "writeback"} : dispatch 2024-09-21T17:50:39.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: osdmap e260: 8 total, 8 up, 8 in 2024-09-21T17:50:39.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:39.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-37", "mode": "writeback"} : dispatch 2024-09-21T17:50:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: osdmap e259: 8 total, 8 up, 8 in 2024-09-21T17:50:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:39.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-37"}]': finished 2024-09-21T17:50:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi042-71285-53"}]': finished 2024-09-21T17:50:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-37", "mode": "writeback"} : dispatch 2024-09-21T17:50:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: osdmap e260: 8 total, 8 up, 8 in 2024-09-21T17:50:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi042-71285-53"} : dispatch 2024-09-21T17:50:39.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-37", "mode": "writeback"} : dispatch 2024-09-21T17:50:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: pgmap v342: 228 pgs: 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi042-71285-53"}]': finished 2024-09-21T17:50:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-37", "mode": "writeback"}]': finished 2024-09-21T17:50:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: osdmap e261: 8 total, 8 up, 8 in 2024-09-21T17:50:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi042-71285-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi042-71285-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:40.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: pgmap v342: 228 pgs: 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi042-71285-53"}]': finished 2024-09-21T17:50:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-37", "mode": "writeback"}]': finished 2024-09-21T17:50:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: osdmap e261: 8 total, 8 up, 8 in 2024-09-21T17:50:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi042-71285-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi042-71285-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:40.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:40.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: pgmap v342: 228 pgs: 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:40.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:40.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3969064393' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi042-71285-53"}]': finished 2024-09-21T17:50:40.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-37", "mode": "writeback"}]': finished 2024-09-21T17:50:40.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: osdmap e261: 8 total, 8 up, 8 in 2024-09-21T17:50:40.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi042-71285-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi042-71285-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi042-71285-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[29361]: osdmap e262: 8 total, 8 up, 8 in 2024-09-21T17:50:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi042-71285-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi042-71285-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:42.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[29361]: pgmap v345: 228 pgs: 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:42.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi042-71285-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:42.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:42.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[38309]: osdmap e262: 8 total, 8 up, 8 in 2024-09-21T17:50:42.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi042-71285-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:42.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi042-71285-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:42.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:42.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:42.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:42 smithi042 ceph-mon[38309]: pgmap v345: 228 pgs: 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi042-71285-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:42 smithi162 ceph-mon[32106]: osdmap e262: 8 total, 8 up, 8 in 2024-09-21T17:50:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi042-71285-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi042-71285-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37"} : dispatch 2024-09-21T17:50:42.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:42 smithi162 ceph-mon[32106]: pgmap v345: 228 pgs: 228 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:43 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37"}]': finished 2024-09-21T17:50:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:43 smithi162 ceph-mon[32106]: osdmap e263: 8 total, 8 up, 8 in 2024-09-21T17:50:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:50:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:43 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37"}]': finished 2024-09-21T17:50:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:43 smithi042 ceph-mon[29361]: osdmap e263: 8 total, 8 up, 8 in 2024-09-21T17:50:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:50:43.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:43 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-37"}]': finished 2024-09-21T17:50:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:43 smithi042 ceph-mon[38309]: osdmap e263: 8 total, 8 up, 8 in 2024-09-21T17:50:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:50:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:50:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:50:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:50:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi042-71285-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi042-71285-54"}]': finished 2024-09-21T17:50:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:44 smithi162 ceph-mon[32106]: osdmap e264: 8 total, 8 up, 8 in 2024-09-21T17:50:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:44 smithi162 ceph-mon[32106]: pgmap v348: 204 pgs: 2 creating+peering, 6 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:44 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:44.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi042-71285-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi042-71285-54"}]': finished 2024-09-21T17:50:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:44 smithi042 ceph-mon[29361]: osdmap e264: 8 total, 8 up, 8 in 2024-09-21T17:50:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:44 smithi042 ceph-mon[29361]: pgmap v348: 204 pgs: 2 creating+peering, 6 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:44 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi042-71285-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi042-71285-54"}]': finished 2024-09-21T17:50:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:44 smithi042 ceph-mon[38309]: osdmap e264: 8 total, 8 up, 8 in 2024-09-21T17:50:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:44 smithi042 ceph-mon[38309]: pgmap v348: 204 pgs: 2 creating+peering, 6 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:44 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:45 smithi162 ceph-mon[32106]: osdmap e265: 8 total, 8 up, 8 in 2024-09-21T17:50:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:45.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:45 smithi042 ceph-mon[29361]: osdmap e265: 8 total, 8 up, 8 in 2024-09-21T17:50:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:45 smithi042 ceph-mon[38309]: osdmap e265: 8 total, 8 up, 8 in 2024-09-21T17:50:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: osdmap e266: 8 total, 8 up, 8 in 2024-09-21T17:50:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:46.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:46.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: pgmap v351: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:50:46.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:46.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"}]': finished 2024-09-21T17:50:46.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: osdmap e267: 8 total, 8 up, 8 in 2024-09-21T17:50:46.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:46.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:46.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:46.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: osdmap e266: 8 total, 8 up, 8 in 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: pgmap v351: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"}]': finished 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: osdmap e267: 8 total, 8 up, 8 in 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: osdmap e266: 8 total, 8 up, 8 in 2024-09-21T17:50:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: pgmap v351: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:50:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi042-71285-54"}]': finished 2024-09-21T17:50:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: osdmap e267: 8 total, 8 up, 8 in 2024-09-21T17:50:46.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1420175390' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:46.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"} : dispatch 2024-09-21T17:50:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-39"}]': finished 2024-09-21T17:50:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"}]': finished 2024-09-21T17:50:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: osdmap e268: 8 total, 8 up, 8 in 2024-09-21T17:50:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-39", "mode": "writeback"} : dispatch 2024-09-21T17:50:48.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-39", "mode": "writeback"} : dispatch 2024-09-21T17:50:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi042-71285-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi042-71285-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:48.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-mon[32106]: pgmap v354: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-21T17:50:48.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-39"}]': finished 2024-09-21T17:50:48.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"}]': finished 2024-09-21T17:50:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: osdmap e268: 8 total, 8 up, 8 in 2024-09-21T17:50:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-39", "mode": "writeback"} : dispatch 2024-09-21T17:50:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-39", "mode": "writeback"} : dispatch 2024-09-21T17:50:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi042-71285-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi042-71285-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[29361]: pgmap v354: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-21T17:50:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-39"}]': finished 2024-09-21T17:50:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi042-71285-54"}]': finished 2024-09-21T17:50:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: osdmap e268: 8 total, 8 up, 8 in 2024-09-21T17:50:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-39", "mode": "writeback"} : dispatch 2024-09-21T17:50:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-39", "mode": "writeback"} : dispatch 2024-09-21T17:50:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi042-71285-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi042-71285-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:48.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:48 smithi042 ceph-mon[38309]: pgmap v354: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-21T17:50:49.202 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:50:48 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:50:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:49 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-39", "mode": "writeback"}]': finished 2024-09-21T17:50:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi042-71285-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:49 smithi162 ceph-mon[32106]: osdmap e269: 8 total, 8 up, 8 in 2024-09-21T17:50:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi042-71285-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi042-71285-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:49.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-39", "mode": "writeback"}]': finished 2024-09-21T17:50:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi042-71285-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[29361]: osdmap e269: 8 total, 8 up, 8 in 2024-09-21T17:50:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi042-71285-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi042-71285-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:49.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:50:49.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-39", "mode": "writeback"}]': finished 2024-09-21T17:50:49.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi042-71285-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[38309]: osdmap e269: 8 total, 8 up, 8 in 2024-09-21T17:50:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi042-71285-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi042-71285-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:49.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:50 smithi162 ceph-mon[32106]: osdmap e270: 8 total, 8 up, 8 in 2024-09-21T17:50:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:50.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:50 smithi162 ceph-mon[32106]: pgmap v357: 228 pgs: 228 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 123 op/s 2024-09-21T17:50:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:50 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi042-71285-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi042-71285-55"}]': finished 2024-09-21T17:50:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39"}]': finished 2024-09-21T17:50:50.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:50 smithi162 ceph-mon[32106]: osdmap e271: 8 total, 8 up, 8 in 2024-09-21T17:50:50.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:50.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[38309]: osdmap e270: 8 total, 8 up, 8 in 2024-09-21T17:50:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[38309]: pgmap v357: 228 pgs: 228 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 123 op/s 2024-09-21T17:50:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi042-71285-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi042-71285-55"}]': finished 2024-09-21T17:50:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39"}]': finished 2024-09-21T17:50:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[38309]: osdmap e271: 8 total, 8 up, 8 in 2024-09-21T17:50:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:50:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:50:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[29361]: osdmap e270: 8 total, 8 up, 8 in 2024-09-21T17:50:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39"} : dispatch 2024-09-21T17:50:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[29361]: pgmap v357: 228 pgs: 228 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 123 op/s 2024-09-21T17:50:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:50:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi042-71285-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi042-71285-55"}]': finished 2024-09-21T17:50:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-39"}]': finished 2024-09-21T17:50:50.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:50 smithi042 ceph-mon[29361]: osdmap e271: 8 total, 8 up, 8 in 2024-09-21T17:50:51.198 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: seed 71455 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (390 ms) 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (10294 ms) 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (45 ms) 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (10729 ms total) 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: 2024-09-21T17:50:51.199 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (7039 ms) 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (7944 ms) 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (10002 ms) 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: my_snaps [3] 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: my_snaps [4,3] 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: my_snaps [5,4,3] 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: promoting some heads 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: promoting from clones for snap 6 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: promoting from clones for snap 5 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: promoting from clones for snap 4 2024-09-21T17:50:51.200 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: promoting from clones for snap 3 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: waiting for scrubs... 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: done waiting 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (46072 ms) 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (9974 ms) 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (7979 ms) 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8024 ms) 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8020 ms) 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10039 ms) 2024-09-21T17:50:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (8931 ms) 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10033 ms) 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (12978 ms) 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (8018 ms) 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (8008 ms) 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13053 ms) 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7928 ms) 2024-09-21T17:50:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-21T17:50:51.203 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8031 ms) 2024-09-21T17:50:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:52 smithi162 ceph-mon[32106]: osdmap e272: 8 total, 8 up, 8 in 2024-09-21T17:50:52.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:52 smithi162 ceph-mon[32106]: pgmap v360: 204 pgs: 8 unknown, 196 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T17:50:52.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:52 smithi042 ceph-mon[29361]: osdmap e272: 8 total, 8 up, 8 in 2024-09-21T17:50:52.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:52 smithi042 ceph-mon[29361]: pgmap v360: 204 pgs: 8 unknown, 196 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T17:50:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:52 smithi042 ceph-mon[38309]: osdmap e272: 8 total, 8 up, 8 in 2024-09-21T17:50:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:52 smithi042 ceph-mon[38309]: pgmap v360: 204 pgs: 8 unknown, 196 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T17:50:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:53 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:53 smithi162 ceph-mon[32106]: osdmap e273: 8 total, 8 up, 8 in 2024-09-21T17:50:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:53 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:53 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:53.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:53.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[29361]: osdmap e273: 8 total, 8 up, 8 in 2024-09-21T17:50:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:53.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[38309]: osdmap e273: 8 total, 8 up, 8 in 2024-09-21T17:50:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:50:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:50:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:50:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:50:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"}]': finished 2024-09-21T17:50:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: osdmap e274: 8 total, 8 up, 8 in 2024-09-21T17:50:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: pgmap v363: 228 pgs: 19 unknown, 209 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"}]': finished 2024-09-21T17:50:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: osdmap e275: 8 total, 8 up, 8 in 2024-09-21T17:50:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:50:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:50:54.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"}]': finished 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: osdmap e274: 8 total, 8 up, 8 in 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: pgmap v363: 228 pgs: 19 unknown, 209 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"}]': finished 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: osdmap e275: 8 total, 8 up, 8 in 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:50:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:50:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:50:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi042-71285-55"}]': finished 2024-09-21T17:50:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: osdmap e274: 8 total, 8 up, 8 in 2024-09-21T17:50:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:50:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3603423905' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"} : dispatch 2024-09-21T17:50:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: pgmap v363: 228 pgs: 19 unknown, 209 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:50:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi042-71285-55"}]': finished 2024-09-21T17:50:54.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: osdmap e275: 8 total, 8 up, 8 in 2024-09-21T17:50:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:50:54.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:50:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi042-71285-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:55.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi042-71285-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:55.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:50:55.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi042-71285-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:55.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: osdmap e276: 8 total, 8 up, 8 in 2024-09-21T17:50:55.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:50:55.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValuePP_smithi042-71285-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:50:55.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValuePP_smithi042-71285-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi042-71285-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi042-71285-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:50:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi042-71285-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: osdmap e276: 8 total, 8 up, 8 in 2024-09-21T17:50:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:50:55.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValuePP_smithi042-71285-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:50:55.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValuePP_smithi042-71285-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi042-71285-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi042-71285-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:50:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:50:55.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi042-71285-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:50:55.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: osdmap e276: 8 total, 8 up, 8 in 2024-09-21T17:50:55.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:50:55.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValuePP_smithi042-71285-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:55.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:50:55.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValuePP_smithi042-71285-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:50:56.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:56 smithi162 ceph-mon[32106]: pgmap v366: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:50:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:50:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:56 smithi162 ceph-mon[32106]: osdmap e277: 8 total, 8 up, 8 in 2024-09-21T17:50:56.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:50:56.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:56 smithi042 ceph-mon[29361]: pgmap v366: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:56.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:50:56.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:50:56.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:56 smithi042 ceph-mon[29361]: osdmap e277: 8 total, 8 up, 8 in 2024-09-21T17:50:56.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:50:56.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:56 smithi042 ceph-mon[38309]: pgmap v366: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:50:56.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:50:56.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:50:56.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:56 smithi042 ceph-mon[38309]: osdmap e277: 8 total, 8 up, 8 in 2024-09-21T17:50:56.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:50:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi042-71285-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi042-71285-56"}]': finished 2024-09-21T17:50:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:50:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:58 smithi162 ceph-mon[32106]: osdmap e278: 8 total, 8 up, 8 in 2024-09-21T17:50:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:58 smithi162 ceph-mon[32106]: pgmap v369: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:58.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi042-71285-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi042-71285-56"}]': finished 2024-09-21T17:50:58.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:50:58.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:58 smithi042 ceph-mon[29361]: osdmap e278: 8 total, 8 up, 8 in 2024-09-21T17:50:58.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:58 smithi042 ceph-mon[29361]: pgmap v369: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:58.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi042-71285-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi042-71285-56"}]': finished 2024-09-21T17:50:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:50:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:58 smithi042 ceph-mon[38309]: osdmap e278: 8 total, 8 up, 8 in 2024-09-21T17:50:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:58 smithi042 ceph-mon[38309]: pgmap v369: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:50:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:50:59.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:50:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:50:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:59 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:59 smithi162 ceph-mon[32106]: osdmap e279: 8 total, 8 up, 8 in 2024-09-21T17:50:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41"} : dispatch 2024-09-21T17:50:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:50:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41"} : dispatch 2024-09-21T17:50:59.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:59.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[29361]: osdmap e279: 8 total, 8 up, 8 in 2024-09-21T17:50:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41"} : dispatch 2024-09-21T17:50:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41"} : dispatch 2024-09-21T17:50:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:50:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[38309]: osdmap e279: 8 total, 8 up, 8 in 2024-09-21T17:50:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:50:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41"} : dispatch 2024-09-21T17:50:59.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:50:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41"} : dispatch 2024-09-21T17:51:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41"}]': finished 2024-09-21T17:51:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:00 smithi162 ceph-mon[32106]: osdmap e280: 8 total, 8 up, 8 in 2024-09-21T17:51:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:00.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:00 smithi162 ceph-mon[32106]: pgmap v372: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41"}]': finished 2024-09-21T17:51:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[29361]: osdmap e280: 8 total, 8 up, 8 in 2024-09-21T17:51:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[29361]: pgmap v372: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-41"}]': finished 2024-09-21T17:51:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[38309]: osdmap e280: 8 total, 8 up, 8 in 2024-09-21T17:51:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:00.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:00 smithi042 ceph-mon[38309]: pgmap v372: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"}]': finished 2024-09-21T17:51:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:01 smithi162 ceph-mon[32106]: osdmap e281: 8 total, 8 up, 8 in 2024-09-21T17:51:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:01.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"}]': finished 2024-09-21T17:51:01.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:01 smithi042 ceph-mon[29361]: osdmap e281: 8 total, 8 up, 8 in 2024-09-21T17:51:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi042-71285-56"}]': finished 2024-09-21T17:51:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:01 smithi042 ceph-mon[38309]: osdmap e281: 8 total, 8 up, 8 in 2024-09-21T17:51:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1035766690' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"} : dispatch 2024-09-21T17:51:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"}]': finished 2024-09-21T17:51:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:02 smithi162 ceph-mon[32106]: osdmap e282: 8 total, 8 up, 8 in 2024-09-21T17:51:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi042-71285-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi042-71285-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:02.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:02 smithi162 ceph-mon[32106]: pgmap v375: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:02.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"}]': finished 2024-09-21T17:51:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[29361]: osdmap e282: 8 total, 8 up, 8 in 2024-09-21T17:51:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi042-71285-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi042-71285-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[29361]: pgmap v375: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi042-71285-56"}]': finished 2024-09-21T17:51:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[38309]: osdmap e282: 8 total, 8 up, 8 in 2024-09-21T17:51:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi042-71285-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi042-71285-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:02.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:02 smithi042 ceph-mon[38309]: pgmap v375: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi042-71285-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:03 smithi162 ceph-mon[32106]: osdmap e283: 8 total, 8 up, 8 in 2024-09-21T17:51:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushPP_smithi042-71285-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi042-71455-6","var": "pg_num","format": "json"} : dispatch 2024-09-21T17:51:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:03.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushPP_smithi042-71285-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi042-71285-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[29361]: osdmap e283: 8 total, 8 up, 8 in 2024-09-21T17:51:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushPP_smithi042-71285-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi042-71455-6","var": "pg_num","format": "json"} : dispatch 2024-09-21T17:51:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:03.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushPP_smithi042-71285-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:03.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:03.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi042-71285-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:03.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[38309]: osdmap e283: 8 total, 8 up, 8 in 2024-09-21T17:51:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushPP_smithi042-71285-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi042-71455-6","var": "pg_num","format": "json"} : dispatch 2024-09-21T17:51:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:03.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushPP_smithi042-71285-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:51:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:51:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:51:04.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:04.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T17:51:04.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:04 smithi162 ceph-mon[32106]: osdmap e284: 8 total, 8 up, 8 in 2024-09-21T17:51:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T17:51:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:04 smithi162 ceph-mon[32106]: pgmap v378: 228 pgs: 17 unknown, 211 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi042-71285-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi042-71285-57"}]': finished 2024-09-21T17:51:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_count","val": "8"}]': finished 2024-09-21T17:51:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:04 smithi162 ceph-mon[32106]: osdmap e285: 8 total, 8 up, 8 in 2024-09-21T17:51:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:04.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:04.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T17:51:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[29361]: osdmap e284: 8 total, 8 up, 8 in 2024-09-21T17:51:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T17:51:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[29361]: pgmap v378: 228 pgs: 17 unknown, 211 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi042-71285-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi042-71285-57"}]': finished 2024-09-21T17:51:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_count","val": "8"}]': finished 2024-09-21T17:51:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[29361]: osdmap e285: 8 total, 8 up, 8 in 2024-09-21T17:51:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:04.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:04.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T17:51:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[38309]: osdmap e284: 8 total, 8 up, 8 in 2024-09-21T17:51:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T17:51:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[38309]: pgmap v378: 228 pgs: 17 unknown, 211 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi042-71285-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi042-71285-57"}]': finished 2024-09-21T17:51:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_count","val": "8"}]': finished 2024-09-21T17:51:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[38309]: osdmap e285: 8 total, 8 up, 8 in 2024-09-21T17:51:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:04.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:05.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:05 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:05.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:51:05.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:05 smithi162 ceph-mon[32106]: osdmap e286: 8 total, 8 up, 8 in 2024-09-21T17:51:05.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:05 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T17:51:05.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T17:51:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:05 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:51:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:05 smithi042 ceph-mon[29361]: osdmap e286: 8 total, 8 up, 8 in 2024-09-21T17:51:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:05 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T17:51:05.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T17:51:05.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:05 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:05.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:51:05.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:05 smithi042 ceph-mon[38309]: osdmap e286: 8 total, 8 up, 8 in 2024-09-21T17:51:05.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:05 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T17:51:05.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T17:51:06.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-21T17:51:06.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: hmm, no HitSet yet 2024-09-21T17:51:06.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: ok, hit_set contains 274:602f83fe:::foo:head 2024-09-21T17:51:06.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9039 ms) 2024-09-21T17:51:06.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-21T17:51:06.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg_num = 32 2024-09-21T17:51:06.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 0 ls 1726941067,0 2024-09-21T17:51:06.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 1 ls 1726941067,0 2024-09-21T17:51:06.484 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 2 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 3 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 4 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 5 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 6 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 7 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 8 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 9 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 10 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 11 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 12 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 13 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 14 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 15 ls 1726941067,0 2024-09-21T17:51:06.485 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 16 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 17 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 18 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 19 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 20 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 21 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 22 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 23 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 24 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 25 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 26 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 27 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 28 ls 1726941067,0 2024-09-21T17:51:06.486 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 29 ls 1726941067,0 2024-09-21T17:51:06.487 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 30 ls 1726941067,0 2024-09-21T17:51:06.487 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg 31 ls 1726941067,0 2024-09-21T17:51:06.487 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: pg_num = 32 2024-09-21T17:51:06.487 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:6cac518f:::0:head 2024-09-21T17:51:06.487 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:02547ec2:::1:head 2024-09-21T17:51:06.487 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:f905c69b:::2:head 2024-09-21T17:51:06.487 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:cfc208b3:::3:head 2024-09-21T17:51:06.487 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:d83876eb:::4:head 2024-09-21T17:51:06.487 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:b29083e3:::5:head 2024-09-21T17:51:06.488 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:c4fdafeb:::6:head 2024-09-21T17:51:06.488 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:5c6b0b28:::7:head 2024-09-21T17:51:06.488 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:bd63b0f1:::8:head 2024-09-21T17:51:06.488 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:e960b815:::9:head 2024-09-21T17:51:06.488 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:52ea6a34:::10:head 2024-09-21T17:51:06.488 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:89d3ae78:::11:head 2024-09-21T17:51:06.488 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:de5d7c5f:::12:head 2024-09-21T17:51:06.488 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:566253c9:::13:head 2024-09-21T17:51:06.488 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:62a1935d:::14:head 2024-09-21T17:51:06.489 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:863748b0:::15:head 2024-09-21T17:51:06.489 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:3958e169:::16:head 2024-09-21T17:51:06.489 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:4d4dabf9:::17:head 2024-09-21T17:51:06.489 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:8391935d:::18:head 2024-09-21T17:51:06.489 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:28883081:::19:head 2024-09-21T17:51:06.489 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:69259c59:::20:head 2024-09-21T17:51:06.490 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:4bdb80b7:::21:head 2024-09-21T17:51:06.490 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:a11c5d71:::22:head 2024-09-21T17:51:06.490 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:271af37b:::23:head 2024-09-21T17:51:06.490 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:95b121be:::24:head 2024-09-21T17:51:06.490 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:58d1031b:::25:head 2024-09-21T17:51:06.490 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:0a050783:::26:head 2024-09-21T17:51:06.490 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:c709704c:::27:head 2024-09-21T17:51:06.491 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:cbe56eaf:::28:head 2024-09-21T17:51:06.491 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:86b4b162:::29:head 2024-09-21T17:51:06.491 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:70d89383:::30:head 2024-09-21T17:51:06.491 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:dd450c7c:::31:head 2024-09-21T17:51:06.491 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:6d5729b1:::32:head 2024-09-21T17:51:06.491 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:c388f3fb:::33:head 2024-09-21T17:51:06.491 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:56cfea31:::34:head 2024-09-21T17:51:06.492 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:9dbc1bf7:::35:head 2024-09-21T17:51:06.492 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:40b74ccd:::36:head 2024-09-21T17:51:06.492 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:4d5aaf42:::37:head 2024-09-21T17:51:06.492 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:920f362c:::38:head 2024-09-21T17:51:06.492 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:6cc53222:::39:head 2024-09-21T17:51:06.492 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:9cad833f:::40:head 2024-09-21T17:51:06.492 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:1ea84d41:::41:head 2024-09-21T17:51:06.492 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:c4480ef6:::42:head 2024-09-21T17:51:06.492 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:a694361e:::43:head 2024-09-21T17:51:06.493 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:d1bd33e9:::44:head 2024-09-21T17:51:06.493 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:ddc2cd5d:::45:head 2024-09-21T17:51:06.493 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:2b782207:::46:head 2024-09-21T17:51:06.493 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:7b187fca:::47:head 2024-09-21T17:51:06.493 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:90ecdf6f:::48:head 2024-09-21T17:51:06.493 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:a5ed95fe:::49:head 2024-09-21T17:51:06.493 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:ea0eaa55:::50:head 2024-09-21T17:51:06.493 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:f33ef17b:::51:head 2024-09-21T17:51:06.494 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:a0d1b2f6:::52:head 2024-09-21T17:51:06.494 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:60c5229e:::53:head 2024-09-21T17:51:06.494 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:edcbc575:::54:head 2024-09-21T17:51:06.494 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:102cf253:::55:head 2024-09-21T17:51:06.494 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:efb7fb0b:::56:head 2024-09-21T17:51:06.494 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:50d0a326:::57:head 2024-09-21T17:51:06.495 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:d4dc5daf:::58:head 2024-09-21T17:51:06.495 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:3a130462:::59:head 2024-09-21T17:51:06.495 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:ec87ed71:::60:head 2024-09-21T17:51:06.495 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:d5bc9454:::61:head 2024-09-21T17:51:06.495 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:3ddfe313:::62:head 2024-09-21T17:51:06.495 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:7c2816b9:::63:head 2024-09-21T17:51:06.495 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:47e00e4d:::64:head 2024-09-21T17:51:06.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:c6410c18:::65:head 2024-09-21T17:51:06.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:b48ed237:::66:head 2024-09-21T17:51:06.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:cd63ad31:::67:head 2024-09-21T17:51:06.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:b179e92b:::68:head 2024-09-21T17:51:06.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:0d9f741a:::69:head 2024-09-21T17:51:06.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:6d3352ae:::70:head 2024-09-21T17:51:06.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:c6d5c19e:::71:head 2024-09-21T17:51:06.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:bc4729c3:::72:head 2024-09-21T17:51:06.496 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:77e930b9:::73:head 2024-09-21T17:51:06.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:0abeecfd:::74:head 2024-09-21T17:51:06.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:b7c37e15:::75:head 2024-09-21T17:51:06.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:b6378398:::76:head 2024-09-21T17:51:06.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:02bd68de:::77:head 2024-09-21T17:51:06.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:cc795d2d:::78:head 2024-09-21T17:51:06.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:630d4fea:::79:head 2024-09-21T17:51:06.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:e0d29ef5:::80:head 2024-09-21T17:51:06.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:fd6f13d2:::81:head 2024-09-21T17:51:06.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:606461d5:::82:head 2024-09-21T17:51:06.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:eadbdc43:::83:head 2024-09-21T17:51:06.497 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:8761d0bb:::84:head 2024-09-21T17:51:06.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:9ef0186f:::85:head 2024-09-21T17:51:06.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:e0d41294:::86:head 2024-09-21T17:51:06.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:961de695:::87:head 2024-09-21T17:51:06.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:1423148f:::88:head 2024-09-21T17:51:06.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:633a8fa2:::89:head 2024-09-21T17:51:06.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:a8653809:::90:head 2024-09-21T17:51:06.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:3dac8b33:::91:head 2024-09-21T17:51:06.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:35aad435:::92:head 2024-09-21T17:51:06.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:f6dcc343:::93:head 2024-09-21T17:51:06.498 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:dbbdad87:::94:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:1cb48ce0:::95:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:03cd461c:::96:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:17a4ea99:::97:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:9993c9a7:::98:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:6394211c:::99:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:94c7ae57:::100:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:6fdee5bb:::101:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:9a477fd1:::102:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:eb850916:::103:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:affc56b9:::104:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:b42dc814:::105:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:f319f8f0:::106:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:9a40b9de:::107:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:8b524f28:::108:head 2024-09-21T17:51:06.499 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:e3de589f:::109:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:90f90a5b:::110:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:a7b4f1d7:::111:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:af51766e:::112:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:b6f90bd1:::113:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:e0261208:::114:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:c9569ef7:::115:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:61bebe50:::116:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:fe93412b:::117:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:d3d38bee:::118:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:3100ba0c:::119:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:d0560ada:::120:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:f0ea8b35:::121:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:766f231a:::122:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:a07a2582:::123:head 2024-09-21T17:51:06.500 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:bd7c6b3a:::124:head 2024-09-21T17:51:06.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:fb2ddaff:::125:head 2024-09-21T17:51:06.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:4408e1fe:::126:head 2024-09-21T17:51:06.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:ee1df7a7:::127:head 2024-09-21T17:51:06.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:c3002909:::128:head 2024-09-21T17:51:06.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:4f48ffa9:::129:head 2024-09-21T17:51:06.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:edf38733:::130:head 2024-09-21T17:51:06.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:c08425c0:::131:head 2024-09-21T17:51:06.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:5f902d98:::132:head 2024-09-21T17:51:06.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:41ea2c93:::133:head 2024-09-21T17:51:06.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:813cee13:::134:head 2024-09-21T17:51:06.501 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:0131818d:::135:head 2024-09-21T17:51:06.502 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:26ba5a85:::136:head 2024-09-21T17:51:06.502 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:381b8a5a:::137:head 2024-09-21T17:51:06.502 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:28797e47:::138:head 2024-09-21T17:51:06.502 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:bfca7f22:::139:head 2024-09-21T17:51:06.502 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:36807075:::140:head 2024-09-21T17:51:06.502 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:80b03975:::141:head 2024-09-21T17:51:06.502 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:5c15709b:::142:head 2024-09-21T17:51:06.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:f39ea15e:::143:head 2024-09-21T17:51:06.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:ea992956:::144:head 2024-09-21T17:51:06.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:48887b1c:::145:head 2024-09-21T17:51:06.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:9f24a9dd:::146:head 2024-09-21T17:51:06.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:987f100b:::147:head 2024-09-21T17:51:06.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:d2dd3581:::148:head 2024-09-21T17:51:06.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:7fed1808:::149:head 2024-09-21T17:51:06.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:c80b70e9:::150:head 2024-09-21T17:51:06.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:85ed90f9:::151:head 2024-09-21T17:51:06.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:36428b24:::152:head 2024-09-21T17:51:06.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:d044c34a:::153:head 2024-09-21T17:51:06.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:7c18bf58:::154:head 2024-09-21T17:51:06.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:d1c21232:::155:head 2024-09-21T17:51:06.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:a7a3c575:::156:head 2024-09-21T17:51:06.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:87da0633:::157:head 2024-09-21T17:51:06.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:d5ac3822:::158:head 2024-09-21T17:51:06.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:3f20522d:::159:head 2024-09-21T17:51:06.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:6ca26563:::160:head 2024-09-21T17:51:06.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:532ce135:::161:head 2024-09-21T17:51:06.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:c78863e6:::162:head 2024-09-21T17:51:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:06 smithi162 ceph-mon[32106]: pgmap v381: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-21T17:51:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:06 smithi162 ceph-mon[32106]: osdmap e287: 8 total, 8 up, 8 in 2024-09-21T17:51:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:06.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:06.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:06 smithi042 ceph-mon[29361]: pgmap v381: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:06.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-21T17:51:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:06 smithi042 ceph-mon[29361]: osdmap e287: 8 total, 8 up, 8 in 2024-09-21T17:51:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:06.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:06 smithi042 ceph-mon[38309]: pgmap v381: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-21T17:51:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:06 smithi042 ceph-mon[38309]: osdmap e287: 8 total, 8 up, 8 in 2024-09-21T17:51:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi042-71455-43","var": "pg_num","format": "json"} : dispatch 2024-09-21T17:51:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43"} : dispatch 2024-09-21T17:51:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43"} : dispatch 2024-09-21T17:51:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"}]': finished 2024-09-21T17:51:07.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43"}]': finished 2024-09-21T17:51:07.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:07 smithi162 ceph-mon[32106]: osdmap e288: 8 total, 8 up, 8 in 2024-09-21T17:51:07.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:07.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:07.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi042-71455-43","var": "pg_num","format": "json"} : dispatch 2024-09-21T17:51:07.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43"} : dispatch 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43"} : dispatch 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"}]': finished 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43"}]': finished 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[29361]: osdmap e288: 8 total, 8 up, 8 in 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi042-71455-43","var": "pg_num","format": "json"} : dispatch 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:07.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43"} : dispatch 2024-09-21T17:51:07.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43"} : dispatch 2024-09-21T17:51:07.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi042-71285-57"}]': finished 2024-09-21T17:51:07.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-43"}]': finished 2024-09-21T17:51:07.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[38309]: osdmap e288: 8 total, 8 up, 8 in 2024-09-21T17:51:07.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4100501751' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:07.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"} : dispatch 2024-09-21T17:51:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:08 smithi162 ceph-mon[32106]: pgmap v384: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:51:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"}]': finished 2024-09-21T17:51:08.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:08 smithi162 ceph-mon[32106]: osdmap e289: 8 total, 8 up, 8 in 2024-09-21T17:51:08.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:08 smithi042 ceph-mon[29361]: pgmap v384: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:51:08.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"}]': finished 2024-09-21T17:51:08.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:08 smithi042 ceph-mon[29361]: osdmap e289: 8 total, 8 up, 8 in 2024-09-21T17:51:08.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:08 smithi042 ceph-mon[38309]: pgmap v384: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:51:08.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi042-71285-57"}]': finished 2024-09-21T17:51:08.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:08 smithi042 ceph-mon[38309]: osdmap e289: 8 total, 8 up, 8 in 2024-09-21T17:51:09.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:51:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:51:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi042-71285-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi042-71285-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi042-71285-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: osdmap e290: 8 total, 8 up, 8 in 2024-09-21T17:51:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi042-71285-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi042-71285-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi042-71285-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi042-71285-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi042-71285-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: osdmap e290: 8 total, 8 up, 8 in 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi042-71285-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi042-71285-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi042-71285-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi042-71285-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi042-71285-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: osdmap e290: 8 total, 8 up, 8 in 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi042-71285-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi042-71285-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:09.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:10 smithi162 ceph-mon[32106]: pgmap v387: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:10 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:10 smithi162 ceph-mon[32106]: osdmap e291: 8 total, 8 up, 8 in 2024-09-21T17:51:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[29361]: pgmap v387: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[29361]: osdmap e291: 8 total, 8 up, 8 in 2024-09-21T17:51:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[38309]: pgmap v387: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:10.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:10.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:10.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:10.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[38309]: osdmap e291: 8 total, 8 up, 8 in 2024-09-21T17:51:10.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi042-71285-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi042-71285-58"}]': finished 2024-09-21T17:51:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:12 smithi162 ceph-mon[32106]: osdmap e292: 8 total, 8 up, 8 in 2024-09-21T17:51:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:51:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:51:12.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:12 smithi162 ceph-mon[32106]: pgmap v390: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:12.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi042-71285-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi042-71285-58"}]': finished 2024-09-21T17:51:12.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:12.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[29361]: osdmap e292: 8 total, 8 up, 8 in 2024-09-21T17:51:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:51:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:51:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[29361]: pgmap v390: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi042-71285-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi042-71285-58"}]': finished 2024-09-21T17:51:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[38309]: osdmap e292: 8 total, 8 up, 8 in 2024-09-21T17:51:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:51:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:51:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:12 smithi042 ceph-mon[38309]: pgmap v390: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_count","val": "3"}]': finished 2024-09-21T17:51:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:13 smithi162 ceph-mon[32106]: osdmap e293: 8 total, 8 up, 8 in 2024-09-21T17:51:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T17:51:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T17:51:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:51:13.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_count","val": "3"}]': finished 2024-09-21T17:51:13.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[38309]: osdmap e293: 8 total, 8 up, 8 in 2024-09-21T17:51:13.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T17:51:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T17:51:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:51:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_count","val": "3"}]': finished 2024-09-21T17:51:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[29361]: osdmap e293: 8 total, 8 up, 8 in 2024-09-21T17:51:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T17:51:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T17:51:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:51:14.166 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:51:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:51:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:51:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_period","val": "3"}]': finished 2024-09-21T17:51:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: osdmap e294: 8 total, 8 up, 8 in 2024-09-21T17:51:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: pgmap v393: 228 pgs: 22 unknown, 206 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:14.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:14.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:14.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:14.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:14.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:51:14.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:51:14.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:14.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_period","val": "3"}]': finished 2024-09-21T17:51:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: osdmap e294: 8 total, 8 up, 8 in 2024-09-21T17:51:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: pgmap v393: 228 pgs: 22 unknown, 206 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:51:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:51:14.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_period","val": "3"}]': finished 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: osdmap e294: 8 total, 8 up, 8 in 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: pgmap v393: 228 pgs: 22 unknown, 206 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:51:14.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"}]': finished 2024-09-21T17:51:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:51:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:15 smithi162 ceph-mon[32106]: osdmap e295: 8 total, 8 up, 8 in 2024-09-21T17:51:15.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T17:51:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T17:51:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:15.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T17:51:15.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"}]': finished 2024-09-21T17:51:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:51:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[29361]: osdmap e295: 8 total, 8 up, 8 in 2024-09-21T17:51:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T17:51:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T17:51:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:15.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T17:51:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi042-71285-58"}]': finished 2024-09-21T17:51:15.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:51:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[38309]: osdmap e295: 8 total, 8 up, 8 in 2024-09-21T17:51:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T17:51:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3279891914' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T17:51:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"} : dispatch 2024-09-21T17:51:15.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T17:51:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:16 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"}]': finished 2024-09-21T17:51:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:16 smithi162 ceph-mon[32106]: pgmap v396: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:16 smithi162 ceph-mon[32106]: osdmap e296: 8 total, 8 up, 8 in 2024-09-21T17:51:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:16 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:16.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:16 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:16.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:16 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"}]': finished 2024-09-21T17:51:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[29361]: pgmap v396: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[29361]: osdmap e296: 8 total, 8 up, 8 in 2024-09-21T17:51:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi042-71285-58"}]': finished 2024-09-21T17:51:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[38309]: pgmap v396: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[38309]: osdmap e296: 8 total, 8 up, 8 in 2024-09-21T17:51:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:16.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:16 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:17 smithi162 ceph-mon[32106]: osdmap e297: 8 total, 8 up, 8 in 2024-09-21T17:51:17.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi042-71285-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:17.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:17.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:17 smithi042 ceph-mon[29361]: osdmap e297: 8 total, 8 up, 8 in 2024-09-21T17:51:17.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi042-71285-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:17 smithi042 ceph-mon[38309]: osdmap e297: 8 total, 8 up, 8 in 2024-09-21T17:51:17.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi042-71285-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:18 smithi162 ceph-mon[32106]: pgmap v398: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:51:18.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:18 smithi162 ceph-mon[32106]: osdmap e298: 8 total, 8 up, 8 in 2024-09-21T17:51:18.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:18 smithi042 ceph-mon[29361]: pgmap v398: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:51:18.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:18 smithi042 ceph-mon[29361]: osdmap e298: 8 total, 8 up, 8 in 2024-09-21T17:51:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:18 smithi042 ceph-mon[38309]: pgmap v398: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:51:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:18 smithi042 ceph-mon[38309]: osdmap e298: 8 total, 8 up, 8 in 2024-09-21T17:51:19.315 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:51:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:51:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi042-71285-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi042-71285-59"}]': finished 2024-09-21T17:51:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:19 smithi162 ceph-mon[32106]: osdmap e299: 8 total, 8 up, 8 in 2024-09-21T17:51:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:19 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:19.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:19 smithi162 ceph-mon[32106]: osdmap e300: 8 total, 8 up, 8 in 2024-09-21T17:51:19.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi042-71285-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi042-71285-59"}]': finished 2024-09-21T17:51:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:19 smithi042 ceph-mon[29361]: osdmap e299: 8 total, 8 up, 8 in 2024-09-21T17:51:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:19 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:19 smithi042 ceph-mon[29361]: osdmap e300: 8 total, 8 up, 8 in 2024-09-21T17:51:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi042-71285-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi042-71285-59"}]': finished 2024-09-21T17:51:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:19 smithi042 ceph-mon[38309]: osdmap e299: 8 total, 8 up, 8 in 2024-09-21T17:51:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:19 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:19 smithi042 ceph-mon[38309]: osdmap e300: 8 total, 8 up, 8 in 2024-09-21T17:51:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:20.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:20 smithi162 ceph-mon[32106]: pgmap v401: 236 pgs: 6 creating+peering, 2 unknown, 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:51:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:20 smithi042 ceph-mon[29361]: pgmap v401: 236 pgs: 6 creating+peering, 2 unknown, 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:51:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:20 smithi042 ceph-mon[38309]: pgmap v401: 236 pgs: 6 creating+peering, 2 unknown, 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:51:21.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:21 smithi042 ceph-mon[29361]: osdmap e301: 8 total, 8 up, 8 in 2024-09-21T17:51:21.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59"}]': finished 2024-09-21T17:51:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:21 smithi042 ceph-mon[29361]: osdmap e302: 8 total, 8 up, 8 in 2024-09-21T17:51:21.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:21 smithi042 ceph-mon[38309]: osdmap e301: 8 total, 8 up, 8 in 2024-09-21T17:51:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59"}]': finished 2024-09-21T17:51:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:21 smithi042 ceph-mon[38309]: osdmap e302: 8 total, 8 up, 8 in 2024-09-21T17:51:21.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:21 smithi162 ceph-mon[32106]: osdmap e301: 8 total, 8 up, 8 in 2024-09-21T17:51:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi042-71285-59"}]': finished 2024-09-21T17:51:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:21 smithi162 ceph-mon[32106]: osdmap e302: 8 total, 8 up, 8 in 2024-09-21T17:51:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi042-71285-59"} : dispatch 2024-09-21T17:51:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:22 smithi042 ceph-mon[29361]: pgmap v404: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:51:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi042-71285-59"}]': finished 2024-09-21T17:51:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:22 smithi042 ceph-mon[29361]: osdmap e303: 8 total, 8 up, 8 in 2024-09-21T17:51:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:22 smithi042 ceph-mon[38309]: pgmap v404: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:51:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi042-71285-59"}]': finished 2024-09-21T17:51:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:22 smithi042 ceph-mon[38309]: osdmap e303: 8 total, 8 up, 8 in 2024-09-21T17:51:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:22 smithi162 ceph-mon[32106]: pgmap v404: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:51:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3111993920' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi042-71285-59"}]': finished 2024-09-21T17:51:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:22 smithi162 ceph-mon[32106]: osdmap e303: 8 total, 8 up, 8 in 2024-09-21T17:51:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:51:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:51:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:51:24.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:24 smithi042 ceph-mon[29361]: pgmap v407: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:24.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:24 smithi042 ceph-mon[29361]: osdmap e304: 8 total, 8 up, 8 in 2024-09-21T17:51:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4195440135' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:24 smithi042 ceph-mon[38309]: pgmap v407: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:24 smithi042 ceph-mon[38309]: osdmap e304: 8 total, 8 up, 8 in 2024-09-21T17:51:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4195440135' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:24 smithi162 ceph-mon[32106]: pgmap v407: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:24 smithi162 ceph-mon[32106]: osdmap e304: 8 total, 8 up, 8 in 2024-09-21T17:51:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4195440135' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:25.358 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:7462ddf6:::.RoundTripAppendPP (3018 ms) 2024-09-21T17:51:25.358 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-09-21T17:51:25.358 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3005 ms) 2024-09-21T17:51:25.358 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-21T17:51:25.358 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (2970 ms) 2024-09-21T17:51:25.358 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3004 ms) 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: setting pool EIO 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: max_success 98, min_failed 99 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (4004 ms) 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3015 ms) 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (111472 ms total) 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3016 ms) 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-21T17:51:25.359 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9013 ms) 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14964 ms) 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3005 ms) 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29998 ms total) 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3011 ms) 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3011 ms total) 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-21T17:51:25.360 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13985 ms) 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7001 ms) 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7024 ms) 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7017 ms) 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3009 ms) 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7027 ms) 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6930 ms) 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-09-21T17:51:25.361 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7027 ms) 2024-09-21T17:51:25.362 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-09-21T17:51:25.362 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7023 ms) 2024-09-21T17:51:25.362 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-21T17:51:25.362 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7033 ms) 2024-09-21T17:51:25.362 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-09-21T17:51:25.362 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7016 ms) 2024-09-21T17:51:25.362 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-21T17:51:25.362 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7026 ms) 2024-09-21T17:51:25.362 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-21T17:51:25.362 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7037 ms) 2024-09-21T17:51:25.362 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-21T17:51:25.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:25.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:25 smithi042 ceph-mon[29361]: osdmap e305: 8 total, 8 up, 8 in 2024-09-21T17:51:25.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:25.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:25 smithi042 ceph-mon[38309]: osdmap e305: 8 total, 8 up, 8 in 2024-09-21T17:51:25.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi042-71285-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:25.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:25 smithi162 ceph-mon[32106]: osdmap e305: 8 total, 8 up, 8 in 2024-09-21T17:51:26.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[29361]: pgmap v410: 260 pgs: 7 creating+peering, 25 unknown, 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T17:51:26.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[29361]: osdmap e306: 8 total, 8 up, 8 in 2024-09-21T17:51:26.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi042-71285-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:26.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi042-71285-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:26.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[38309]: pgmap v410: 260 pgs: 7 creating+peering, 25 unknown, 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T17:51:26.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[38309]: osdmap e306: 8 total, 8 up, 8 in 2024-09-21T17:51:26.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi042-71285-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:26.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi042-71285-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:26 smithi162 ceph-mon[32106]: pgmap v410: 260 pgs: 7 creating+peering, 25 unknown, 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T17:51:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:26 smithi162 ceph-mon[32106]: osdmap e306: 8 total, 8 up, 8 in 2024-09-21T17:51:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi042-71285-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi042-71285-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:27.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi042-71285-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:27.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:27 smithi042 ceph-mon[29361]: osdmap e307: 8 total, 8 up, 8 in 2024-09-21T17:51:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPP_smithi042-71285-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPP_smithi042-71285-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi042-71285-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:27 smithi042 ceph-mon[38309]: osdmap e307: 8 total, 8 up, 8 in 2024-09-21T17:51:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPP_smithi042-71285-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPP_smithi042-71285-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi042-71285-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:27 smithi162 ceph-mon[32106]: osdmap e307: 8 total, 8 up, 8 in 2024-09-21T17:51:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPP_smithi042-71285-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:27.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPP_smithi042-71285-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[29361]: pgmap v413: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 1 op/s 2024-09-21T17:51:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45"} : dispatch 2024-09-21T17:51:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45"} : dispatch 2024-09-21T17:51:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[29361]: osdmap e308: 8 total, 8 up, 8 in 2024-09-21T17:51:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[38309]: pgmap v413: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 1 op/s 2024-09-21T17:51:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45"} : dispatch 2024-09-21T17:51:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45"} : dispatch 2024-09-21T17:51:28.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[38309]: osdmap e308: 8 total, 8 up, 8 in 2024-09-21T17:51:28.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:28 smithi162 ceph-mon[32106]: pgmap v413: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 1 op/s 2024-09-21T17:51:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45"} : dispatch 2024-09-21T17:51:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45"} : dispatch 2024-09-21T17:51:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:28 smithi162 ceph-mon[32106]: osdmap e308: 8 total, 8 up, 8 in 2024-09-21T17:51:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:29.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:51:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:51:29.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi042-71285-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi042-71285-61"}]': finished 2024-09-21T17:51:29.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45"}]': finished 2024-09-21T17:51:29.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:29 smithi042 ceph-mon[29361]: osdmap e309: 8 total, 8 up, 8 in 2024-09-21T17:51:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:29 smithi042 ceph-mon[29361]: osdmap e310: 8 total, 8 up, 8 in 2024-09-21T17:51:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi042-71285-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi042-71285-61"}]': finished 2024-09-21T17:51:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45"}]': finished 2024-09-21T17:51:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:29 smithi042 ceph-mon[38309]: osdmap e309: 8 total, 8 up, 8 in 2024-09-21T17:51:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:29 smithi042 ceph-mon[38309]: osdmap e310: 8 total, 8 up, 8 in 2024-09-21T17:51:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi042-71285-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi042-71285-61"}]': finished 2024-09-21T17:51:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-45"}]': finished 2024-09-21T17:51:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:29 smithi162 ceph-mon[32106]: osdmap e309: 8 total, 8 up, 8 in 2024-09-21T17:51:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:29 smithi162 ceph-mon[32106]: osdmap e310: 8 total, 8 up, 8 in 2024-09-21T17:51:30.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[29361]: pgmap v416: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T17:51:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[29361]: osdmap e311: 8 total, 8 up, 8 in 2024-09-21T17:51:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[38309]: pgmap v416: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T17:51:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[38309]: osdmap e311: 8 total, 8 up, 8 in 2024-09-21T17:51:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:30.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:30 smithi162 ceph-mon[32106]: pgmap v416: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T17:51:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:30 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:30 smithi162 ceph-mon[32106]: osdmap e311: 8 total, 8 up, 8 in 2024-09-21T17:51:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:30.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[29361]: pgmap v419: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"}]': finished 2024-09-21T17:51:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[29361]: osdmap e312: 8 total, 8 up, 8 in 2024-09-21T17:51:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:32.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[38309]: pgmap v419: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"}]': finished 2024-09-21T17:51:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[38309]: osdmap e312: 8 total, 8 up, 8 in 2024-09-21T17:51:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:32.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:32 smithi162 ceph-mon[32106]: pgmap v419: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi042-71285-61"}]': finished 2024-09-21T17:51:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:32 smithi162 ceph-mon[32106]: osdmap e312: 8 total, 8 up, 8 in 2024-09-21T17:51:32.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2895157331' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:32.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"} : dispatch 2024-09-21T17:51:32.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:32.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"}]': finished 2024-09-21T17:51:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[29361]: osdmap e313: 8 total, 8 up, 8 in 2024-09-21T17:51:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:33.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"}]': finished 2024-09-21T17:51:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[38309]: osdmap e313: 8 total, 8 up, 8 in 2024-09-21T17:51:33.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:33.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:33.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:33.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:33.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi042-71285-61"}]': finished 2024-09-21T17:51:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:33 smithi162 ceph-mon[32106]: osdmap e313: 8 total, 8 up, 8 in 2024-09-21T17:51:33.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:33.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:33.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:33.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:33.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:34.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:51:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:51:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:51:34.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[29361]: pgmap v422: 228 pgs: 18 unknown, 210 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-47"}]': finished 2024-09-21T17:51:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-47", "mode": "writeback"} : dispatch 2024-09-21T17:51:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[29361]: osdmap e314: 8 total, 8 up, 8 in 2024-09-21T17:51:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi042-71285-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-47", "mode": "writeback"} : dispatch 2024-09-21T17:51:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[38309]: pgmap v422: 228 pgs: 18 unknown, 210 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-47"}]': finished 2024-09-21T17:51:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-47", "mode": "writeback"} : dispatch 2024-09-21T17:51:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[38309]: osdmap e314: 8 total, 8 up, 8 in 2024-09-21T17:51:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi042-71285-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:34.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-47", "mode": "writeback"} : dispatch 2024-09-21T17:51:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:34 smithi162 ceph-mon[32106]: pgmap v422: 228 pgs: 18 unknown, 210 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-47"}]': finished 2024-09-21T17:51:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-47", "mode": "writeback"} : dispatch 2024-09-21T17:51:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:34 smithi162 ceph-mon[32106]: osdmap e314: 8 total, 8 up, 8 in 2024-09-21T17:51:34.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi042-71285-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:34.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-47", "mode": "writeback"} : dispatch 2024-09-21T17:51:35.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:51:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-47", "mode": "writeback"}]': finished 2024-09-21T17:51:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:51:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[38309]: osdmap e315: 8 total, 8 up, 8 in 2024-09-21T17:51:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:51:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi042-71285-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi042-71285-62"}]': finished 2024-09-21T17:51:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:51:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[38309]: osdmap e316: 8 total, 8 up, 8 in 2024-09-21T17:51:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:51:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-47", "mode": "writeback"}]': finished 2024-09-21T17:51:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:51:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[29361]: osdmap e315: 8 total, 8 up, 8 in 2024-09-21T17:51:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:51:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi042-71285-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi042-71285-62"}]': finished 2024-09-21T17:51:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:51:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[29361]: osdmap e316: 8 total, 8 up, 8 in 2024-09-21T17:51:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:35.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:35 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:51:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-47", "mode": "writeback"}]': finished 2024-09-21T17:51:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:51:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:35 smithi162 ceph-mon[32106]: osdmap e315: 8 total, 8 up, 8 in 2024-09-21T17:51:35.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:51:35.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi042-71285-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi042-71285-62"}]': finished 2024-09-21T17:51:35.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:51:35.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:35 smithi162 ceph-mon[32106]: osdmap e316: 8 total, 8 up, 8 in 2024-09-21T17:51:35.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:35.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:51:36.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:36 smithi042 ceph-mon[29361]: pgmap v425: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T17:51:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:51:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:36 smithi042 ceph-mon[29361]: osdmap e317: 8 total, 8 up, 8 in 2024-09-21T17:51:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:36 smithi042 ceph-mon[38309]: pgmap v425: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T17:51:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:51:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:36 smithi042 ceph-mon[38309]: osdmap e317: 8 total, 8 up, 8 in 2024-09-21T17:51:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:36 smithi162 ceph-mon[32106]: pgmap v425: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T17:51:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:51:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:36 smithi162 ceph-mon[32106]: osdmap e317: 8 total, 8 up, 8 in 2024-09-21T17:51:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:51:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:51:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:51:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[29361]: osdmap e318: 8 total, 8 up, 8 in 2024-09-21T17:51:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:51:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:51:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:51:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:51:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[38309]: osdmap e318: 8 total, 8 up, 8 in 2024-09-21T17:51:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:51:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:51:37.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:37 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:51:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:51:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:37 smithi162 ceph-mon[32106]: osdmap e318: 8 total, 8 up, 8 in 2024-09-21T17:51:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:51:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:51:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:38.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[38309]: pgmap v428: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s wr, 3 op/s 2024-09-21T17:51:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T17:51:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62"}]': finished 2024-09-21T17:51:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T17:51:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[38309]: osdmap e319: 8 total, 8 up, 8 in 2024-09-21T17:51:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T17:51:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[29361]: pgmap v428: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s wr, 3 op/s 2024-09-21T17:51:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:38.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T17:51:38.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62"}]': finished 2024-09-21T17:51:38.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T17:51:38.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[29361]: osdmap e319: 8 total, 8 up, 8 in 2024-09-21T17:51:38.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:38.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T17:51:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:38 smithi162 ceph-mon[32106]: pgmap v428: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s wr, 3 op/s 2024-09-21T17:51:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:38 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T17:51:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi042-71285-62"}]': finished 2024-09-21T17:51:38.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T17:51:38.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:38 smithi162 ceph-mon[32106]: osdmap e319: 8 total, 8 up, 8 in 2024-09-21T17:51:38.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi042-71285-62"} : dispatch 2024-09-21T17:51:38.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T17:51:39.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:51:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:51:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi042-71285-62"}]': finished 2024-09-21T17:51:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T17:51:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T17:51:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: osdmap e320: 8 total, 8 up, 8 in 2024-09-21T17:51:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T17:51:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi042-71285-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:40.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi042-71285-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi042-71285-62"}]': finished 2024-09-21T17:51:40.667 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T17:51:40.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T17:51:40.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: osdmap e320: 8 total, 8 up, 8 in 2024-09-21T17:51:40.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T17:51:40.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.668 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi042-71285-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:40.669 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi042-71285-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3861278003' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi042-71285-62"}]': finished 2024-09-21T17:51:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T17:51:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T17:51:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: osdmap e320: 8 total, 8 up, 8 in 2024-09-21T17:51:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T17:51:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi042-71285-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi042-71285-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T17:51:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi042-71285-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[29361]: osdmap e321: 8 total, 8 up, 8 in 2024-09-21T17:51:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi042-71285-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi042-71285-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T17:51:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi042-71285-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[38309]: osdmap e321: 8 total, 8 up, 8 in 2024-09-21T17:51:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi042-71285-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi042-71285-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:41.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:41.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T17:51:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi042-71285-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:41 smithi162 ceph-mon[32106]: osdmap e321: 8 total, 8 up, 8 in 2024-09-21T17:51:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi042-71285-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi042-71285-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:42.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:42 smithi162 ceph-mon[32106]: pgmap v434: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:42.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:51:42.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:42.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:42 smithi162 ceph-mon[32106]: osdmap e322: 8 total, 8 up, 8 in 2024-09-21T17:51:42.827 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:42 smithi042 ceph-mon[29361]: pgmap v434: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:51:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:42 smithi042 ceph-mon[29361]: osdmap e322: 8 total, 8 up, 8 in 2024-09-21T17:51:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:42 smithi042 ceph-mon[38309]: pgmap v434: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:51:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:42 smithi042 ceph-mon[38309]: osdmap e322: 8 total, 8 up, 8 in 2024-09-21T17:51:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi042-71285-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi042-71285-63"}]': finished 2024-09-21T17:51:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"}]': finished 2024-09-21T17:51:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:43 smithi162 ceph-mon[32106]: osdmap e323: 8 total, 8 up, 8 in 2024-09-21T17:51:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:43.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:43.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:43 smithi162 ceph-mon[32106]: osdmap e324: 8 total, 8 up, 8 in 2024-09-21T17:51:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi042-71285-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi042-71285-63"}]': finished 2024-09-21T17:51:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"}]': finished 2024-09-21T17:51:43.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[29361]: osdmap e323: 8 total, 8 up, 8 in 2024-09-21T17:51:43.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:43.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:43.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:43.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:43.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:43.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[29361]: osdmap e324: 8 total, 8 up, 8 in 2024-09-21T17:51:43.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi042-71285-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi042-71285-63"}]': finished 2024-09-21T17:51:43.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"}]': finished 2024-09-21T17:51:43.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[38309]: osdmap e323: 8 total, 8 up, 8 in 2024-09-21T17:51:43.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:43.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:43.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:43.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-47"} : dispatch 2024-09-21T17:51:43.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:43.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-mon[38309]: osdmap e324: 8 total, 8 up, 8 in 2024-09-21T17:51:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:51:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:51:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:51:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:44 smithi162 ceph-mon[32106]: pgmap v437: 236 pgs: 3 creating+peering, 5 unknown, 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:44 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:44 smithi162 ceph-mon[32106]: osdmap e325: 8 total, 8 up, 8 in 2024-09-21T17:51:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:44.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:44.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[29361]: pgmap v437: 236 pgs: 3 creating+peering, 5 unknown, 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[29361]: osdmap e325: 8 total, 8 up, 8 in 2024-09-21T17:51:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[38309]: pgmap v437: 236 pgs: 3 creating+peering, 5 unknown, 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[38309]: osdmap e325: 8 total, 8 up, 8 in 2024-09-21T17:51:44.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:44.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:51:44.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:44.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:46 smithi162 ceph-mon[32106]: pgmap v440: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T17:51:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"}]': finished 2024-09-21T17:51:46.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:46 smithi162 ceph-mon[32106]: osdmap e326: 8 total, 8 up, 8 in 2024-09-21T17:51:46.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:46.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:46.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:46.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[29361]: pgmap v440: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T17:51:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"}]': finished 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[29361]: osdmap e326: 8 total, 8 up, 8 in 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[38309]: pgmap v440: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi042-71285-63"}]': finished 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[38309]: osdmap e326: 8 total, 8 up, 8 in 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3230695880' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"} : dispatch 2024-09-21T17:51:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:46.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:51:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"}]': finished 2024-09-21T17:51:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:47 smithi162 ceph-mon[32106]: osdmap e327: 8 total, 8 up, 8 in 2024-09-21T17:51:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:51:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:51:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:47.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:47.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi042-71285-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:47.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-49"}]': finished 2024-09-21T17:51:47.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi042-71285-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:47.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:47 smithi162 ceph-mon[32106]: osdmap e328: 8 total, 8 up, 8 in 2024-09-21T17:51:47.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"}]': finished 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[29361]: osdmap e327: 8 total, 8 up, 8 in 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi042-71285-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-49"}]': finished 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi042-71285-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[29361]: osdmap e328: 8 total, 8 up, 8 in 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi042-71285-63"}]': finished 2024-09-21T17:51:47.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:51:47.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[38309]: osdmap e327: 8 total, 8 up, 8 in 2024-09-21T17:51:47.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:51:47.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:51:47.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:47.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:47.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi042-71285-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:47.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-49"}]': finished 2024-09-21T17:51:47.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi042-71285-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:47.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:47 smithi042 ceph-mon[38309]: osdmap e328: 8 total, 8 up, 8 in 2024-09-21T17:51:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:48 smithi162 ceph-mon[32106]: pgmap v443: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T17:51:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-49", "mode": "readproxy"} : dispatch 2024-09-21T17:51:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi042-71285-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-49", "mode": "readproxy"} : dispatch 2024-09-21T17:51:48.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:48 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:51:48.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-49", "mode": "readproxy"}]': finished 2024-09-21T17:51:48.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[29361]: pgmap v443: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T17:51:48.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-49", "mode": "readproxy"} : dispatch 2024-09-21T17:51:48.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi042-71285-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:48.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-49", "mode": "readproxy"} : dispatch 2024-09-21T17:51:48.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:51:48.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-49", "mode": "readproxy"}]': finished 2024-09-21T17:51:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[38309]: pgmap v443: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T17:51:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-49", "mode": "readproxy"} : dispatch 2024-09-21T17:51:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi042-71285-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-49", "mode": "readproxy"} : dispatch 2024-09-21T17:51:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:51:48.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-49", "mode": "readproxy"}]': finished 2024-09-21T17:51:49.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:51:48 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:51:49.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:49 smithi162 ceph-mon[32106]: osdmap e329: 8 total, 8 up, 8 in 2024-09-21T17:51:49.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:49 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:49.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi042-71285-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi042-71285-64"}]': finished 2024-09-21T17:51:49.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:49 smithi162 ceph-mon[32106]: osdmap e330: 8 total, 8 up, 8 in 2024-09-21T17:51:49.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:49 smithi042 ceph-mon[29361]: osdmap e329: 8 total, 8 up, 8 in 2024-09-21T17:51:49.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:49 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:49.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi042-71285-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi042-71285-64"}]': finished 2024-09-21T17:51:49.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:49 smithi042 ceph-mon[29361]: osdmap e330: 8 total, 8 up, 8 in 2024-09-21T17:51:49.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:49 smithi042 ceph-mon[38309]: osdmap e329: 8 total, 8 up, 8 in 2024-09-21T17:51:49.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:49 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:49.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi042-71285-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi042-71285-64"}]': finished 2024-09-21T17:51:49.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:49 smithi042 ceph-mon[38309]: osdmap e330: 8 total, 8 up, 8 in 2024-09-21T17:51:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:50 smithi162 ceph-mon[32106]: pgmap v446: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:51:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:50 smithi162 ceph-mon[32106]: osdmap e331: 8 total, 8 up, 8 in 2024-09-21T17:51:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:50 smithi042 ceph-mon[29361]: pgmap v446: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:51:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:50 smithi042 ceph-mon[29361]: osdmap e331: 8 total, 8 up, 8 in 2024-09-21T17:51:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:51:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:50 smithi042 ceph-mon[38309]: pgmap v446: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:51:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:50 smithi042 ceph-mon[38309]: osdmap e331: 8 total, 8 up, 8 in 2024-09-21T17:51:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:52 smithi162 ceph-mon[32106]: pgmap v449: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:51:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:52 smithi162 ceph-mon[32106]: osdmap e332: 8 total, 8 up, 8 in 2024-09-21T17:51:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:52 smithi042 ceph-mon[29361]: pgmap v449: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:51:52.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:52 smithi042 ceph-mon[29361]: osdmap e332: 8 total, 8 up, 8 in 2024-09-21T17:51:52.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:52 smithi042 ceph-mon[38309]: pgmap v449: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:51:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:52 smithi042 ceph-mon[38309]: osdmap e332: 8 total, 8 up, 8 in 2024-09-21T17:51:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:53 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi042-71285-64"}]': finished 2024-09-21T17:51:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:53 smithi162 ceph-mon[32106]: osdmap e333: 8 total, 8 up, 8 in 2024-09-21T17:51:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:53 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:53.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:53 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi042-71285-64"}]': finished 2024-09-21T17:51:53.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:53 smithi042 ceph-mon[29361]: osdmap e333: 8 total, 8 up, 8 in 2024-09-21T17:51:53.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:53 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:53.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:53 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi042-71285-64"}]': finished 2024-09-21T17:51:53.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:53 smithi042 ceph-mon[38309]: osdmap e333: 8 total, 8 up, 8 in 2024-09-21T17:51:53.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:53 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi042-71285-64"} : dispatch 2024-09-21T17:51:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:51:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:51:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:51:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:54 smithi162 ceph-mon[32106]: pgmap v452: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi042-71285-64"}]': finished 2024-09-21T17:51:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:54 smithi162 ceph-mon[32106]: osdmap e334: 8 total, 8 up, 8 in 2024-09-21T17:51:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi042-71285-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:54.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[38309]: pgmap v452: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi042-71285-64"}]': finished 2024-09-21T17:51:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[38309]: osdmap e334: 8 total, 8 up, 8 in 2024-09-21T17:51:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi042-71285-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[29361]: pgmap v452: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:51:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/56294546' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi042-71285-64"}]': finished 2024-09-21T17:51:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[29361]: osdmap e334: 8 total, 8 up, 8 in 2024-09-21T17:51:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:54.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi042-71285-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:51:55.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi042-71285-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:55.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:55 smithi162 ceph-mon[32106]: osdmap e335: 8 total, 8 up, 8 in 2024-09-21T17:51:55.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "OmapPP_smithi042-71285-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:55.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi042-71285-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:55.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:55 smithi042 ceph-mon[29361]: osdmap e335: 8 total, 8 up, 8 in 2024-09-21T17:51:55.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "OmapPP_smithi042-71285-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi042-71285-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:51:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:55 smithi042 ceph-mon[38309]: osdmap e335: 8 total, 8 up, 8 in 2024-09-21T17:51:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "OmapPP_smithi042-71285-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:56.726 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:56 smithi162 ceph-mon[32106]: pgmap v455: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T17:51:56.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:56 smithi162 ceph-mon[32106]: osdmap e336: 8 total, 8 up, 8 in 2024-09-21T17:51:56.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:56 smithi042 ceph-mon[29361]: pgmap v455: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T17:51:56.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:56 smithi042 ceph-mon[29361]: osdmap e336: 8 total, 8 up, 8 in 2024-09-21T17:51:56.816 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:56 smithi042 ceph-mon[38309]: pgmap v455: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T17:51:56.816 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:56 smithi042 ceph-mon[38309]: osdmap e336: 8 total, 8 up, 8 in 2024-09-21T17:51:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi042-71285-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi042-71285-65"}]': finished 2024-09-21T17:51:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:57 smithi162 ceph-mon[32106]: osdmap e337: 8 total, 8 up, 8 in 2024-09-21T17:51:57.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi042-71285-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi042-71285-65"}]': finished 2024-09-21T17:51:57.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:57 smithi042 ceph-mon[29361]: osdmap e337: 8 total, 8 up, 8 in 2024-09-21T17:51:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi042-71285-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi042-71285-65"}]': finished 2024-09-21T17:51:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:57 smithi042 ceph-mon[38309]: osdmap e337: 8 total, 8 up, 8 in 2024-09-21T17:51:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:58 smithi162 ceph-mon[32106]: pgmap v458: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T17:51:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:58 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:58 smithi162 ceph-mon[32106]: osdmap e338: 8 total, 8 up, 8 in 2024-09-21T17:51:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:58 smithi042 ceph-mon[29361]: pgmap v458: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T17:51:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:58 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:58 smithi042 ceph-mon[29361]: osdmap e338: 8 total, 8 up, 8 in 2024-09-21T17:51:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:58 smithi042 ceph-mon[38309]: pgmap v458: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T17:51:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:58 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:51:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:58 smithi042 ceph-mon[38309]: osdmap e338: 8 total, 8 up, 8 in 2024-09-21T17:51:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:51:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:51:59.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:51:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:51:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:59 smithi162 ceph-mon[32106]: osdmap e339: 8 total, 8 up, 8 in 2024-09-21T17:51:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:51:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:59.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:59 smithi042 ceph-mon[29361]: osdmap e339: 8 total, 8 up, 8 in 2024-09-21T17:51:59.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:59.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:59.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:51:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:59.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:59 smithi042 ceph-mon[38309]: osdmap e339: 8 total, 8 up, 8 in 2024-09-21T17:51:59.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:51:59.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:51:59.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:51:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:00 smithi162 ceph-mon[32106]: pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi042-71285-65"}]': finished 2024-09-21T17:52:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:52:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:00 smithi162 ceph-mon[32106]: osdmap e340: 8 total, 8 up, 8 in 2024-09-21T17:52:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:52:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[29361]: pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi042-71285-65"}]': finished 2024-09-21T17:52:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:52:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[29361]: osdmap e340: 8 total, 8 up, 8 in 2024-09-21T17:52:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:52:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[38309]: pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi042-71285-65"}]': finished 2024-09-21T17:52:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:52:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[38309]: osdmap e340: 8 total, 8 up, 8 in 2024-09-21T17:52:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi042-71285-65"} : dispatch 2024-09-21T17:52:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:01.502 INFO:tasks.workunit.client.0.smithi042.stdout: 163:head 2024-09-21T17:52:01.502 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:5d165639:::164:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:f43765fc:::165:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:b4c720e9:::166:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:e694b040:::167:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:afa38db2:::168:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:77ba9f53:::169:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:87495034:::170:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:7c96bf0e:::171:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:dbe346cc:::172:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:e943ec24:::173:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:f97a9c0c:::174:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:6f26e74d:::175:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:4f95e106:::176:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:0e6f2f8f:::177:head 2024-09-21T17:52:01.503 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:05db05f1:::178:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:38a78d66:::179:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:d095610b:::180:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:a1a9d709:::181:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:1e5d39db:::182:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:f7df4fb9:::183:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:03a7f161:::184:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:ba70721e:::185:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:28e5662d:::186:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:973d52de:::187:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:4303eb1c:::188:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:b990b48e:::189:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:29b8165b:::190:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:3547f197:::191:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:7e260936:::192:head 2024-09-21T17:52:01.504 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:1abec7b1:::193:head 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:10fdda93:::194:head 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:15817eea:::195:head 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:770bab57:::196:head 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:ed9e13e7:::197:head 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:71471a8f:::198:head 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: checking for 276:10fb1d02:::199:head 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8020 ms) 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,0 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: first is 1726941076 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,0 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,0 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,1726941078,1726941079,0 2024-09-21T17:52:01.505 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,1726941078,1726941079,0 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,1726941078,1726941079,0 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,1726941078,1726941079,1726941081,1726941082,0 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,1726941078,1726941079,1726941081,1726941082,0 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,1726941078,1726941079,1726941081,1726941082,0 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,1726941078,1726941079,1726941081,1726941082,1726941084,1726941085,0 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,1726941078,1726941079,1726941081,1726941082,1726941084,1726941085,0 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941076,1726941078,1726941079,1726941081,1726941082,1726941084,1726941085,0 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941079,1726941081,1726941082,1726941084,1726941085,1726941087,1726941088,0 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: first now 1726941079, trimmed 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (21114 ms) 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: foo0 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-09-21T17:52:01.506 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14048 ms) 2024-09-21T17:52:01.507 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-21T17:52:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:01 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:52:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi042-71285-65"}]': finished 2024-09-21T17:52:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"}]': finished 2024-09-21T17:52:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:01 smithi162 ceph-mon[32106]: osdmap e341: 8 total, 8 up, 8 in 2024-09-21T17:52:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:01.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi042-71285-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:52:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:52:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi042-71285-65"}]': finished 2024-09-21T17:52:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"}]': finished 2024-09-21T17:52:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[29361]: osdmap e341: 8 total, 8 up, 8 in 2024-09-21T17:52:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi042-71285-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:52:01.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:52:01.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2904806307' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi042-71285-65"}]': finished 2024-09-21T17:52:01.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"}]': finished 2024-09-21T17:52:01.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[38309]: osdmap e341: 8 total, 8 up, 8 in 2024-09-21T17:52:01.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:01.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:01.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:01.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-49"} : dispatch 2024-09-21T17:52:01.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:01.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:01.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi042-71285-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:52:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:02 smithi162 ceph-mon[32106]: pgmap v464: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi042-71285-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:52:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:02 smithi162 ceph-mon[32106]: osdmap e342: 8 total, 8 up, 8 in 2024-09-21T17:52:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWritePP_smithi042-71285-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:02.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:02 smithi042 ceph-mon[29361]: pgmap v464: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:02.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi042-71285-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:52:02.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:02 smithi042 ceph-mon[29361]: osdmap e342: 8 total, 8 up, 8 in 2024-09-21T17:52:02.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWritePP_smithi042-71285-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:02.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:02 smithi042 ceph-mon[38309]: pgmap v464: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:02.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi042-71285-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:52:02.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:02 smithi042 ceph-mon[38309]: osdmap e342: 8 total, 8 up, 8 in 2024-09-21T17:52:02.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWritePP_smithi042-71285-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:03 smithi162 ceph-mon[32106]: osdmap e343: 8 total, 8 up, 8 in 2024-09-21T17:52:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi042-71285-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi042-71285-66"}]': finished 2024-09-21T17:52:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:03 smithi162 ceph-mon[32106]: osdmap e344: 8 total, 8 up, 8 in 2024-09-21T17:52:03.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[29361]: osdmap e343: 8 total, 8 up, 8 in 2024-09-21T17:52:03.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:03.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:03.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi042-71285-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi042-71285-66"}]': finished 2024-09-21T17:52:03.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:03.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[29361]: osdmap e344: 8 total, 8 up, 8 in 2024-09-21T17:52:03.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[38309]: osdmap e343: 8 total, 8 up, 8 in 2024-09-21T17:52:03.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:03.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:03.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi042-71285-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi042-71285-66"}]': finished 2024-09-21T17:52:03.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:03.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-mon[38309]: osdmap e344: 8 total, 8 up, 8 in 2024-09-21T17:52:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:52:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:52:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:52:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:04 smithi162 ceph-mon[32106]: pgmap v467: 228 pgs: 14 creating+peering, 18 unknown, 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:04 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:52:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:52:04.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:52:04.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:04 smithi162 ceph-mon[32106]: osdmap e345: 8 total, 8 up, 8 in 2024-09-21T17:52:04.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:04.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[29361]: pgmap v467: 228 pgs: 14 creating+peering, 18 unknown, 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:52:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:52:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:52:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[29361]: osdmap e345: 8 total, 8 up, 8 in 2024-09-21T17:52:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[38309]: pgmap v467: 228 pgs: 14 creating+peering, 18 unknown, 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:04.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:52:04.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:52:04.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:52:04.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[38309]: osdmap e345: 8 total, 8 up, 8 in 2024-09-21T17:52:04.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:04.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:06 smithi162 ceph-mon[32106]: pgmap v470: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-51"}]': finished 2024-09-21T17:52:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:06 smithi162 ceph-mon[32106]: osdmap e346: 8 total, 8 up, 8 in 2024-09-21T17:52:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-51", "mode": "writeback"} : dispatch 2024-09-21T17:52:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-51", "mode": "writeback"} : dispatch 2024-09-21T17:52:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[29361]: pgmap v470: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-51"}]': finished 2024-09-21T17:52:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[29361]: osdmap e346: 8 total, 8 up, 8 in 2024-09-21T17:52:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-51", "mode": "writeback"} : dispatch 2024-09-21T17:52:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-51", "mode": "writeback"} : dispatch 2024-09-21T17:52:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[38309]: pgmap v470: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:52:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-51"}]': finished 2024-09-21T17:52:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[38309]: osdmap e346: 8 total, 8 up, 8 in 2024-09-21T17:52:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-51", "mode": "writeback"} : dispatch 2024-09-21T17:52:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-51", "mode": "writeback"} : dispatch 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3035 ms) 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7026 ms) 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7019 ms) 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7024 ms) 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7016 ms) 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7051 ms) 2024-09-21T17:52:07.520 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-09-21T17:52:07.521 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7023 ms) 2024-09-21T17:52:07.521 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139349 ms total) 2024-09-21T17:52:07.521 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: 2024-09-21T17:52:07.521 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-09-21T17:52:07.521 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (283830 ms total) 2024-09-21T17:52:07.521 INFO:tasks.workunit.client.0.smithi042.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-09-21T17:52:07.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:52:07.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi042-71285-66"}]': finished 2024-09-21T17:52:07.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-51", "mode": "writeback"}]': finished 2024-09-21T17:52:07.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: osdmap e347: 8 total, 8 up, 8 in 2024-09-21T17:52:07.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:07.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:52:07.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:52:07.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi042-71285-66"}]': finished 2024-09-21T17:52:07.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:52:07.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: osdmap e348: 8 total, 8 up, 8 in 2024-09-21T17:52:07.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:52:07.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:52:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:52:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi042-71285-66"}]': finished 2024-09-21T17:52:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-51", "mode": "writeback"}]': finished 2024-09-21T17:52:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: osdmap e347: 8 total, 8 up, 8 in 2024-09-21T17:52:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:52:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:52:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi042-71285-66"}]': finished 2024-09-21T17:52:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:52:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: osdmap e348: 8 total, 8 up, 8 in 2024-09-21T17:52:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi042-71285-66"}]': finished 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-51", "mode": "writeback"}]': finished 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: osdmap e347: 8 total, 8 up, 8 in 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi042-71285-66"} : dispatch 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2645341552' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi042-71285-66"}]': finished 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: osdmap e348: 8 total, 8 up, 8 in 2024-09-21T17:52:07.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:52:07.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:52:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:08 smithi162 ceph-mon[32106]: pgmap v473: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:52:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:52:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:08 smithi162 ceph-mon[32106]: osdmap e349: 8 total, 8 up, 8 in 2024-09-21T17:52:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:52:08.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:52:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:08 smithi042 ceph-mon[29361]: pgmap v473: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:52:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:52:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:08 smithi042 ceph-mon[29361]: osdmap e349: 8 total, 8 up, 8 in 2024-09-21T17:52:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:52:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:52:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:08 smithi042 ceph-mon[38309]: pgmap v473: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:52:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:52:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:08 smithi042 ceph-mon[38309]: osdmap e349: 8 total, 8 up, 8 in 2024-09-21T17:52:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:52:08.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:52:09.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:52:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:52:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:09 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:09 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:52:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:52:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:09 smithi162 ceph-mon[32106]: osdmap e350: 8 total, 8 up, 8 in 2024-09-21T17:52:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:52:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:52:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:52:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:52:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[29361]: osdmap e350: 8 total, 8 up, 8 in 2024-09-21T17:52:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:52:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:52:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:52:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:52:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[38309]: osdmap e350: 8 total, 8 up, 8 in 2024-09-21T17:52:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:52:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T17:52:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:10 smithi162 ceph-mon[32106]: pgmap v476: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T17:52:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T17:52:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:10 smithi162 ceph-mon[32106]: osdmap e351: 8 total, 8 up, 8 in 2024-09-21T17:52:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T17:52:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T17:52:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[29361]: pgmap v476: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[29361]: osdmap e351: 8 total, 8 up, 8 in 2024-09-21T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T17:52:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[38309]: pgmap v476: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T17:52:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T17:52:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[38309]: osdmap e351: 8 total, 8 up, 8 in 2024-09-21T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T17:52:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:12 smithi162 ceph-mon[32106]: pgmap v479: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T17:52:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "target_max_objects","val": "1"}]': finished 2024-09-21T17:52:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:12 smithi162 ceph-mon[32106]: osdmap e352: 8 total, 8 up, 8 in 2024-09-21T17:52:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:12 smithi042 ceph-mon[29361]: pgmap v479: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T17:52:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "target_max_objects","val": "1"}]': finished 2024-09-21T17:52:12.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:12 smithi042 ceph-mon[29361]: osdmap e352: 8 total, 8 up, 8 in 2024-09-21T17:52:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:12 smithi042 ceph-mon[38309]: pgmap v479: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T17:52:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-51","var": "target_max_objects","val": "1"}]': finished 2024-09-21T17:52:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:12 smithi042 ceph-mon[38309]: osdmap e352: 8 total, 8 up, 8 in 2024-09-21T17:52:14.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:14.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:14 smithi042 ceph-mon[29361]: pgmap v481: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T17:52:14.165 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:52:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:52:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:52:14.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:14.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:14.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:14 smithi042 ceph-mon[38309]: pgmap v481: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T17:52:14.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:14.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:14.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:14 smithi162 ceph-mon[32106]: pgmap v481: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T17:52:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:15 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T17:52:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:15 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:52:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:15 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:15 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:15 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:52:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:15 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:52:15.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:15 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:15.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T17:52:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:52:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:52:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:52:15.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:15.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T17:52:15.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:52:15.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:52:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:52:15.416 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:15 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:52:16.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:16 smithi162 ceph-mon[32106]: pgmap v482: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:16.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:16 smithi042 ceph-mon[29361]: pgmap v482: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:16.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:16 smithi042 ceph-mon[38309]: pgmap v482: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:18.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:18 smithi042 ceph-mon[29361]: pgmap v483: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 657 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T17:52:18.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:18 smithi042 ceph-mon[38309]: pgmap v483: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 657 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T17:52:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:18 smithi162 ceph-mon[32106]: pgmap v483: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 657 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T17:52:19.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:52:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:52:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:20.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:20 smithi042 ceph-mon[29361]: pgmap v484: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:20 smithi042 ceph-mon[38309]: pgmap v484: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:20 smithi162 ceph-mon[32106]: pgmap v484: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:22 smithi042 ceph-mon[29361]: pgmap v485: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:22 smithi042 ceph-mon[38309]: pgmap v485: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:22 smithi162 ceph-mon[32106]: pgmap v485: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:23.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:52:23.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:23 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:23.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:23 smithi042 ceph-mon[38309]: osdmap e353: 8 total, 8 up, 8 in 2024-09-21T17:52:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:52:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:23 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:23 smithi042 ceph-mon[29361]: osdmap e353: 8 total, 8 up, 8 in 2024-09-21T17:52:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:23.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:52:23.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:23 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:23.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:23 smithi162 ceph-mon[32106]: osdmap e353: 8 total, 8 up, 8 in 2024-09-21T17:52:23.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:52:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:52:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:52:24.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[38309]: pgmap v487: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"}]': finished 2024-09-21T17:52:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[38309]: osdmap e354: 8 total, 8 up, 8 in 2024-09-21T17:52:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[29361]: pgmap v487: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"}]': finished 2024-09-21T17:52:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[29361]: osdmap e354: 8 total, 8 up, 8 in 2024-09-21T17:52:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:24.666 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:24 smithi162 ceph-mon[32106]: pgmap v487: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"}]': finished 2024-09-21T17:52:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:24 smithi162 ceph-mon[32106]: osdmap e354: 8 total, 8 up, 8 in 2024-09-21T17:52:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-51"} : dispatch 2024-09-21T17:52:25.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:25 smithi042 ceph-mon[29361]: osdmap e355: 8 total, 8 up, 8 in 2024-09-21T17:52:25.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:25 smithi042 ceph-mon[38309]: osdmap e355: 8 total, 8 up, 8 in 2024-09-21T17:52:25.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:25 smithi162 ceph-mon[32106]: osdmap e355: 8 total, 8 up, 8 in 2024-09-21T17:52:26.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:26 smithi042 ceph-mon[29361]: pgmap v490: 196 pgs: 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-21T17:52:26.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:26 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T17:52:26.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:26 smithi042 ceph-mon[29361]: osdmap e356: 8 total, 8 up, 8 in 2024-09-21T17:52:26.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:26.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:26.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:26 smithi042 ceph-mon[38309]: pgmap v490: 196 pgs: 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-21T17:52:26.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:26 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T17:52:26.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:26 smithi042 ceph-mon[38309]: osdmap e356: 8 total, 8 up, 8 in 2024-09-21T17:52:26.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:26.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:26.726 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:26 smithi162 ceph-mon[32106]: pgmap v490: 196 pgs: 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-21T17:52:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:26 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T17:52:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:26 smithi162 ceph-mon[32106]: osdmap e356: 8 total, 8 up, 8 in 2024-09-21T17:52:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:27.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[29361]: osdmap e357: 8 total, 8 up, 8 in 2024-09-21T17:52:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-53"} : dispatch 2024-09-21T17:52:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-53"} : dispatch 2024-09-21T17:52:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[38309]: osdmap e357: 8 total, 8 up, 8 in 2024-09-21T17:52:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:27.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:27.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-53"} : dispatch 2024-09-21T17:52:27.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-53"} : dispatch 2024-09-21T17:52:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:27 smithi162 ceph-mon[32106]: osdmap e357: 8 total, 8 up, 8 in 2024-09-21T17:52:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-53"} : dispatch 2024-09-21T17:52:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-53"} : dispatch 2024-09-21T17:52:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:28 smithi042 ceph-mon[29361]: pgmap v493: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:52:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:28 smithi042 ceph-mon[29361]: osdmap e358: 8 total, 8 up, 8 in 2024-09-21T17:52:28.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:28 smithi042 ceph-mon[38309]: pgmap v493: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:52:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:28 smithi042 ceph-mon[38309]: osdmap e358: 8 total, 8 up, 8 in 2024-09-21T17:52:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:28 smithi162 ceph-mon[32106]: pgmap v493: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:52:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:28 smithi162 ceph-mon[32106]: osdmap e358: 8 total, 8 up, 8 in 2024-09-21T17:52:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:29.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:52:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:52:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:29 smithi162 ceph-mon[32106]: osdmap e359: 8 total, 8 up, 8 in 2024-09-21T17:52:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:29 smithi042 ceph-mon[29361]: osdmap e359: 8 total, 8 up, 8 in 2024-09-21T17:52:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:29 smithi042 ceph-mon[38309]: osdmap e359: 8 total, 8 up, 8 in 2024-09-21T17:52:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:30 smithi162 ceph-mon[32106]: pgmap v496: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:52:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:30 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:30 smithi162 ceph-mon[32106]: osdmap e360: 8 total, 8 up, 8 in 2024-09-21T17:52:30.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:30.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:30.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:30.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-55"} : dispatch 2024-09-21T17:52:30.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-55"} : dispatch 2024-09-21T17:52:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[29361]: pgmap v496: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:52:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[29361]: osdmap e360: 8 total, 8 up, 8 in 2024-09-21T17:52:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-55"} : dispatch 2024-09-21T17:52:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-55"} : dispatch 2024-09-21T17:52:30.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:30.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[38309]: pgmap v496: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:52:30.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:30.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:30.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[38309]: osdmap e360: 8 total, 8 up, 8 in 2024-09-21T17:52:30.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:30.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:30.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:30.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-55"} : dispatch 2024-09-21T17:52:30.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-55"} : dispatch 2024-09-21T17:52:31.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:31 smithi162 ceph-mon[32106]: osdmap e361: 8 total, 8 up, 8 in 2024-09-21T17:52:31.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:31 smithi042 ceph-mon[29361]: osdmap e361: 8 total, 8 up, 8 in 2024-09-21T17:52:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:31 smithi042 ceph-mon[38309]: osdmap e361: 8 total, 8 up, 8 in 2024-09-21T17:52:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:32 smithi162 ceph-mon[32106]: pgmap v499: 196 pgs: 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:52:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:32 smithi162 ceph-mon[32106]: osdmap e362: 8 total, 8 up, 8 in 2024-09-21T17:52:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:32.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:32 smithi042 ceph-mon[29361]: pgmap v499: 196 pgs: 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:52:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:32 smithi042 ceph-mon[29361]: osdmap e362: 8 total, 8 up, 8 in 2024-09-21T17:52:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:32 smithi042 ceph-mon[38309]: pgmap v499: 196 pgs: 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:52:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:32 smithi042 ceph-mon[38309]: osdmap e362: 8 total, 8 up, 8 in 2024-09-21T17:52:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:32.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:33 smithi162 ceph-mon[32106]: osdmap e363: 8 total, 8 up, 8 in 2024-09-21T17:52:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-57"} : dispatch 2024-09-21T17:52:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-57"} : dispatch 2024-09-21T17:52:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[29361]: osdmap e363: 8 total, 8 up, 8 in 2024-09-21T17:52:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-57"} : dispatch 2024-09-21T17:52:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-57"} : dispatch 2024-09-21T17:52:33.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:33.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[38309]: osdmap e363: 8 total, 8 up, 8 in 2024-09-21T17:52:33.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:33.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:33.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-57"} : dispatch 2024-09-21T17:52:33.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-57"} : dispatch 2024-09-21T17:52:34.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:52:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:52:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:52:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:34 smithi162 ceph-mon[32106]: pgmap v502: 228 pgs: 16 unknown, 212 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T17:52:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:34 smithi162 ceph-mon[32106]: osdmap e364: 8 total, 8 up, 8 in 2024-09-21T17:52:34.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:34 smithi042 ceph-mon[29361]: pgmap v502: 228 pgs: 16 unknown, 212 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T17:52:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:34 smithi042 ceph-mon[29361]: osdmap e364: 8 total, 8 up, 8 in 2024-09-21T17:52:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:34 smithi042 ceph-mon[38309]: pgmap v502: 228 pgs: 16 unknown, 212 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T17:52:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:34 smithi042 ceph-mon[38309]: osdmap e364: 8 total, 8 up, 8 in 2024-09-21T17:52:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:35 smithi162 ceph-mon[32106]: osdmap e365: 8 total, 8 up, 8 in 2024-09-21T17:52:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:35.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:35 smithi042 ceph-mon[29361]: osdmap e365: 8 total, 8 up, 8 in 2024-09-21T17:52:35.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:35.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:35 smithi042 ceph-mon[38309]: osdmap e365: 8 total, 8 up, 8 in 2024-09-21T17:52:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:36 smithi162 ceph-mon[32106]: pgmap v505: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:52:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:36 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:36 smithi162 ceph-mon[32106]: osdmap e366: 8 total, 8 up, 8 in 2024-09-21T17:52:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:36.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:36.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:36.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-59"} : dispatch 2024-09-21T17:52:36.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-59"} : dispatch 2024-09-21T17:52:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[29361]: pgmap v505: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:52:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[29361]: osdmap e366: 8 total, 8 up, 8 in 2024-09-21T17:52:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-59"} : dispatch 2024-09-21T17:52:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-59"} : dispatch 2024-09-21T17:52:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[38309]: pgmap v505: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:52:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[38309]: osdmap e366: 8 total, 8 up, 8 in 2024-09-21T17:52:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-59"} : dispatch 2024-09-21T17:52:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-59"} : dispatch 2024-09-21T17:52:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:37 smithi162 ceph-mon[32106]: osdmap e367: 8 total, 8 up, 8 in 2024-09-21T17:52:37.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:37 smithi042 ceph-mon[29361]: osdmap e367: 8 total, 8 up, 8 in 2024-09-21T17:52:37.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:37 smithi042 ceph-mon[38309]: osdmap e367: 8 total, 8 up, 8 in 2024-09-21T17:52:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:38 smithi162 ceph-mon[32106]: pgmap v508: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:52:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:38 smithi162 ceph-mon[32106]: osdmap e368: 8 total, 8 up, 8 in 2024-09-21T17:52:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:38.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:38 smithi042 ceph-mon[29361]: pgmap v508: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:52:38.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:38 smithi042 ceph-mon[29361]: osdmap e368: 8 total, 8 up, 8 in 2024-09-21T17:52:38.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:38.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:38 smithi042 ceph-mon[38309]: pgmap v508: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:52:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:38 smithi042 ceph-mon[38309]: osdmap e368: 8 total, 8 up, 8 in 2024-09-21T17:52:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:39.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:52:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:52:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:39 smithi162 ceph-mon[32106]: osdmap e369: 8 total, 8 up, 8 in 2024-09-21T17:52:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:39.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:39.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:39.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:39 smithi042 ceph-mon[29361]: osdmap e369: 8 total, 8 up, 8 in 2024-09-21T17:52:39.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:39.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:39.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:39 smithi042 ceph-mon[38309]: osdmap e369: 8 total, 8 up, 8 in 2024-09-21T17:52:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:40 smithi162 ceph-mon[32106]: pgmap v511: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:52:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:52:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:40 smithi162 ceph-mon[32106]: osdmap e370: 8 total, 8 up, 8 in 2024-09-21T17:52:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-61"} : dispatch 2024-09-21T17:52:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-61"} : dispatch 2024-09-21T17:52:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[29361]: pgmap v511: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:52:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:52:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[29361]: osdmap e370: 8 total, 8 up, 8 in 2024-09-21T17:52:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-61"} : dispatch 2024-09-21T17:52:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-61"} : dispatch 2024-09-21T17:52:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[38309]: pgmap v511: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:52:40.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:52:40.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[38309]: osdmap e370: 8 total, 8 up, 8 in 2024-09-21T17:52:40.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:40.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:52:40.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-61"} : dispatch 2024-09-21T17:52:40.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-61"} : dispatch 2024-09-21T17:52:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:41 smithi162 ceph-mon[32106]: osdmap e371: 8 total, 8 up, 8 in 2024-09-21T17:52:41.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:41 smithi042 ceph-mon[29361]: osdmap e371: 8 total, 8 up, 8 in 2024-09-21T17:52:41.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:41 smithi042 ceph-mon[38309]: osdmap e371: 8 total, 8 up, 8 in 2024-09-21T17:52:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:42 smithi162 ceph-mon[32106]: pgmap v514: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:52:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:42 smithi162 ceph-mon[32106]: osdmap e372: 8 total, 8 up, 8 in 2024-09-21T17:52:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:42 smithi042 ceph-mon[29361]: pgmap v514: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:52:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:42 smithi042 ceph-mon[29361]: osdmap e372: 8 total, 8 up, 8 in 2024-09-21T17:52:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:42 smithi042 ceph-mon[38309]: pgmap v514: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:52:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:42 smithi042 ceph-mon[38309]: osdmap e372: 8 total, 8 up, 8 in 2024-09-21T17:52:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:52:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:43 smithi162 ceph-mon[32106]: osdmap e373: 8 total, 8 up, 8 in 2024-09-21T17:52:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[29361]: osdmap e373: 8 total, 8 up, 8 in 2024-09-21T17:52:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:43.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:52:43.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[38309]: osdmap e373: 8 total, 8 up, 8 in 2024-09-21T17:52:43.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:52:43.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:43.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:52:43.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:52:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:52:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:52:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:44 smithi162 ceph-mon[32106]: pgmap v517: 228 pgs: 14 unknown, 214 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:52:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:52:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:44 smithi162 ceph-mon[32106]: osdmap e374: 8 total, 8 up, 8 in 2024-09-21T17:52:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:44 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:44 smithi042 ceph-mon[29361]: pgmap v517: 228 pgs: 14 unknown, 214 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:52:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:52:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:44 smithi042 ceph-mon[29361]: osdmap e374: 8 total, 8 up, 8 in 2024-09-21T17:52:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:44 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:44 smithi042 ceph-mon[38309]: pgmap v517: 228 pgs: 14 unknown, 214 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:52:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:52:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:44 smithi042 ceph-mon[38309]: osdmap e374: 8 total, 8 up, 8 in 2024-09-21T17:52:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:44 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:52:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:45 smithi162 ceph-mon[32106]: osdmap e375: 8 total, 8 up, 8 in 2024-09-21T17:52:45.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:45 smithi042 ceph-mon[29361]: osdmap e375: 8 total, 8 up, 8 in 2024-09-21T17:52:45.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:45 smithi042 ceph-mon[38309]: osdmap e375: 8 total, 8 up, 8 in 2024-09-21T17:52:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:46 smithi162 ceph-mon[32106]: pgmap v520: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:52:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:46 smithi162 ceph-mon[32106]: osdmap e376: 8 total, 8 up, 8 in 2024-09-21T17:52:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:46 smithi042 ceph-mon[29361]: pgmap v520: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:52:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:46 smithi042 ceph-mon[29361]: osdmap e376: 8 total, 8 up, 8 in 2024-09-21T17:52:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:46 smithi042 ceph-mon[38309]: pgmap v520: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:52:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:46 smithi042 ceph-mon[38309]: osdmap e376: 8 total, 8 up, 8 in 2024-09-21T17:52:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:47 smithi162 ceph-mon[32106]: osdmap e377: 8 total, 8 up, 8 in 2024-09-21T17:52:47.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:47 smithi042 ceph-mon[29361]: osdmap e377: 8 total, 8 up, 8 in 2024-09-21T17:52:47.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:47 smithi042 ceph-mon[38309]: osdmap e377: 8 total, 8 up, 8 in 2024-09-21T17:52:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:48 smithi162 ceph-mon[32106]: pgmap v523: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:52:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:48 smithi162 ceph-mon[32106]: osdmap e378: 8 total, 8 up, 8 in 2024-09-21T17:52:48.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:48 smithi042 ceph-mon[29361]: pgmap v523: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:52:48.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:48 smithi042 ceph-mon[29361]: osdmap e378: 8 total, 8 up, 8 in 2024-09-21T17:52:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:48 smithi042 ceph-mon[38309]: pgmap v523: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:52:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:48 smithi042 ceph-mon[38309]: osdmap e378: 8 total, 8 up, 8 in 2024-09-21T17:52:49.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:52:48 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:52:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:50 smithi162 ceph-mon[32106]: pgmap v525: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-09-21T17:52:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:50 smithi042 ceph-mon[29361]: pgmap v525: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-09-21T17:52:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:50 smithi042 ceph-mon[38309]: pgmap v525: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-09-21T17:52:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:52 smithi162 ceph-mon[32106]: pgmap v526: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-21T17:52:52.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:52 smithi042 ceph-mon[29361]: pgmap v526: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-21T17:52:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:52 smithi042 ceph-mon[38309]: pgmap v526: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-21T17:52:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:52:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:52:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:52:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:54 smithi162 ceph-mon[32106]: pgmap v527: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-21T17:52:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:54 smithi162 ceph-mon[32106]: osdmap e379: 8 total, 8 up, 8 in 2024-09-21T17:52:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:54 smithi042 ceph-mon[29361]: pgmap v527: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-21T17:52:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:54 smithi042 ceph-mon[29361]: osdmap e379: 8 total, 8 up, 8 in 2024-09-21T17:52:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:54 smithi042 ceph-mon[38309]: pgmap v527: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-21T17:52:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:54 smithi042 ceph-mon[38309]: osdmap e379: 8 total, 8 up, 8 in 2024-09-21T17:52:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:56 smithi162 ceph-mon[32106]: pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-21T17:52:56.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:56 smithi042 ceph-mon[29361]: pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-21T17:52:56.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:56 smithi042 ceph-mon[38309]: pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-21T17:52:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:58 smithi162 ceph-mon[32106]: pgmap v530: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T17:52:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:58 smithi162 ceph-mon[32106]: osdmap e380: 8 total, 8 up, 8 in 2024-09-21T17:52:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:58 smithi042 ceph-mon[29361]: pgmap v530: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T17:52:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:58 smithi042 ceph-mon[29361]: osdmap e380: 8 total, 8 up, 8 in 2024-09-21T17:52:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:58 smithi042 ceph-mon[38309]: pgmap v530: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T17:52:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:58 smithi042 ceph-mon[38309]: osdmap e380: 8 total, 8 up, 8 in 2024-09-21T17:52:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:52:59.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:52:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:52:59.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:59 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:59.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:52:59 smithi042 ceph-mon[29361]: pgmap v532: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:52:59.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:59 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:52:59.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:52:59 smithi042 ceph-mon[38309]: pgmap v532: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:00.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:59 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:00.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:52:59 smithi162 ceph-mon[32106]: pgmap v532: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:02.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:02 smithi042 ceph-mon[29361]: pgmap v533: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:02 smithi042 ceph-mon[38309]: pgmap v533: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:02 smithi162 ceph-mon[32106]: pgmap v533: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:53:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:53:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:53:04.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:04 smithi042 ceph-mon[29361]: pgmap v534: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:04.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:04 smithi042 ceph-mon[29361]: osdmap e381: 8 total, 8 up, 8 in 2024-09-21T17:53:04.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:04 smithi042 ceph-mon[38309]: pgmap v534: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:04.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:04 smithi042 ceph-mon[38309]: osdmap e381: 8 total, 8 up, 8 in 2024-09-21T17:53:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:04 smithi162 ceph-mon[32106]: pgmap v534: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:04 smithi162 ceph-mon[32106]: osdmap e381: 8 total, 8 up, 8 in 2024-09-21T17:53:06.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:06 smithi042 ceph-mon[29361]: pgmap v536: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:06.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:06 smithi042 ceph-mon[38309]: pgmap v536: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:06 smithi162 ceph-mon[32106]: pgmap v536: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:08.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:08 smithi042 ceph-mon[29361]: pgmap v537: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:08.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:08 smithi042 ceph-mon[38309]: pgmap v537: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:08 smithi162 ceph-mon[32106]: pgmap v537: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:53:09.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:53:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:53:09.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:09 smithi042 ceph-mon[29361]: osdmap e382: 8 total, 8 up, 8 in 2024-09-21T17:53:09.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:09 smithi042 ceph-mon[38309]: osdmap e382: 8 total, 8 up, 8 in 2024-09-21T17:53:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:09 smithi162 ceph-mon[32106]: osdmap e382: 8 total, 8 up, 8 in 2024-09-21T17:53:10.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:10.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:10 smithi042 ceph-mon[38309]: pgmap v539: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T17:53:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:10 smithi042 ceph-mon[29361]: pgmap v539: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T17:53:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:10 smithi162 ceph-mon[32106]: pgmap v539: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T17:53:12.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:12 smithi042 ceph-mon[29361]: pgmap v540: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T17:53:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:12 smithi042 ceph-mon[38309]: pgmap v540: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T17:53:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:12 smithi162 ceph-mon[32106]: pgmap v540: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T17:53:13.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:13.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:53:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:53:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:53:14.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:14 smithi042 ceph-mon[29361]: pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:53:14.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:14 smithi042 ceph-mon[38309]: pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:53:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:14 smithi162 ceph-mon[32106]: pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:53:15.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:15 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:53:15.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:15 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:53:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:15 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:53:16.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:16 smithi042 ceph-mon[29361]: pgmap v542: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T17:53:16.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:16 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:53:16.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:16 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:53:16.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:16 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:53:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:16 smithi042 ceph-mon[38309]: pgmap v542: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T17:53:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:16 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:53:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:16 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:53:16.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:16 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:53:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:16 smithi162 ceph-mon[32106]: pgmap v542: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T17:53:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:16 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:53:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:16 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:53:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:16 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:53:18.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:18 smithi042 ceph-mon[29361]: pgmap v543: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T17:53:18.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:18 smithi042 ceph-mon[38309]: pgmap v543: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T17:53:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:18 smithi162 ceph-mon[32106]: pgmap v543: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T17:53:19.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:53:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:53:19.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:19.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-63"} : dispatch 2024-09-21T17:53:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-63"} : dispatch 2024-09-21T17:53:19.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:19 smithi042 ceph-mon[38309]: osdmap e383: 8 total, 8 up, 8 in 2024-09-21T17:53:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-63"} : dispatch 2024-09-21T17:53:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-63"} : dispatch 2024-09-21T17:53:19.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:19 smithi042 ceph-mon[29361]: osdmap e383: 8 total, 8 up, 8 in 2024-09-21T17:53:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-63"} : dispatch 2024-09-21T17:53:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-63"} : dispatch 2024-09-21T17:53:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:19 smithi162 ceph-mon[32106]: osdmap e383: 8 total, 8 up, 8 in 2024-09-21T17:53:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:20 smithi042 ceph-mon[29361]: pgmap v545: 196 pgs: 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:20 smithi042 ceph-mon[29361]: osdmap e384: 8 total, 8 up, 8 in 2024-09-21T17:53:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:20.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:20 smithi042 ceph-mon[38309]: pgmap v545: 196 pgs: 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:20 smithi042 ceph-mon[38309]: osdmap e384: 8 total, 8 up, 8 in 2024-09-21T17:53:20.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:20.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:20 smithi162 ceph-mon[32106]: pgmap v545: 196 pgs: 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:20 smithi162 ceph-mon[32106]: osdmap e384: 8 total, 8 up, 8 in 2024-09-21T17:53:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:22 smithi162 ceph-mon[32106]: osdmap e385: 8 total, 8 up, 8 in 2024-09-21T17:53:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:22 smithi162 ceph-mon[32106]: pgmap v548: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[29361]: osdmap e385: 8 total, 8 up, 8 in 2024-09-21T17:53:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[29361]: pgmap v548: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[38309]: osdmap e385: 8 total, 8 up, 8 in 2024-09-21T17:53:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:22 smithi042 ceph-mon[38309]: pgmap v548: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:23.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:53:23.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:23 smithi162 ceph-mon[32106]: osdmap e386: 8 total, 8 up, 8 in 2024-09-21T17:53:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:53:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:23 smithi042 ceph-mon[29361]: osdmap e386: 8 total, 8 up, 8 in 2024-09-21T17:53:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:53:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:23 smithi042 ceph-mon[38309]: osdmap e386: 8 total, 8 up, 8 in 2024-09-21T17:53:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:53:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:53:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:53:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:24 smithi162 ceph-mon[32106]: osdmap e387: 8 total, 8 up, 8 in 2024-09-21T17:53:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:24 smithi162 ceph-mon[32106]: pgmap v551: 228 pgs: 8 unknown, 220 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-09-21T17:53:24.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:24 smithi042 ceph-mon[29361]: osdmap e387: 8 total, 8 up, 8 in 2024-09-21T17:53:24.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:24 smithi042 ceph-mon[29361]: pgmap v551: 228 pgs: 8 unknown, 220 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-09-21T17:53:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:24 smithi042 ceph-mon[38309]: osdmap e387: 8 total, 8 up, 8 in 2024-09-21T17:53:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:24 smithi042 ceph-mon[38309]: pgmap v551: 228 pgs: 8 unknown, 220 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-09-21T17:53:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:25 smithi162 ceph-mon[32106]: osdmap e388: 8 total, 8 up, 8 in 2024-09-21T17:53:25.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:25 smithi042 ceph-mon[29361]: osdmap e388: 8 total, 8 up, 8 in 2024-09-21T17:53:25.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:25 smithi042 ceph-mon[38309]: osdmap e388: 8 total, 8 up, 8 in 2024-09-21T17:53:26.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:26 smithi162 ceph-mon[32106]: osdmap e389: 8 total, 8 up, 8 in 2024-09-21T17:53:26.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:26 smithi162 ceph-mon[32106]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-21T17:53:26.565 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:26 smithi042 ceph-mon[29361]: osdmap e389: 8 total, 8 up, 8 in 2024-09-21T17:53:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:26 smithi042 ceph-mon[29361]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-21T17:53:26.566 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:26 smithi042 ceph-mon[38309]: osdmap e389: 8 total, 8 up, 8 in 2024-09-21T17:53:26.566 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:26 smithi042 ceph-mon[38309]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-21T17:53:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:28 smithi042 ceph-mon[29361]: pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T17:53:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:28 smithi042 ceph-mon[38309]: pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T17:53:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:28 smithi162 ceph-mon[32106]: pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T17:53:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:29.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:53:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:53:30.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:30.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:30 smithi042 ceph-mon[29361]: pgmap v556: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T17:53:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:30 smithi042 ceph-mon[38309]: pgmap v556: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T17:53:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:30 smithi162 ceph-mon[32106]: pgmap v556: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T17:53:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:32 smithi042 ceph-mon[29361]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T17:53:32.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:32 smithi042 ceph-mon[38309]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T17:53:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:32 smithi162 ceph-mon[32106]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T17:53:34.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:53:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:53:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:53:34.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:34 smithi042 ceph-mon[29361]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 224 B/s wr, 2 op/s 2024-09-21T17:53:34.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:34 smithi042 ceph-mon[29361]: osdmap e390: 8 total, 8 up, 8 in 2024-09-21T17:53:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:34 smithi042 ceph-mon[38309]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 224 B/s wr, 2 op/s 2024-09-21T17:53:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:34 smithi042 ceph-mon[38309]: osdmap e390: 8 total, 8 up, 8 in 2024-09-21T17:53:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:34 smithi162 ceph-mon[32106]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 224 B/s wr, 2 op/s 2024-09-21T17:53:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:34 smithi162 ceph-mon[32106]: osdmap e390: 8 total, 8 up, 8 in 2024-09-21T17:53:35.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:35.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:35.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-65"} : dispatch 2024-09-21T17:53:35.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-65"} : dispatch 2024-09-21T17:53:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-65"} : dispatch 2024-09-21T17:53:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-65"} : dispatch 2024-09-21T17:53:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-65"} : dispatch 2024-09-21T17:53:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-65"} : dispatch 2024-09-21T17:53:36.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:36 smithi042 ceph-mon[29361]: pgmap v560: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T17:53:36.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:36 smithi042 ceph-mon[29361]: osdmap e391: 8 total, 8 up, 8 in 2024-09-21T17:53:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:36 smithi042 ceph-mon[38309]: pgmap v560: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T17:53:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:36 smithi042 ceph-mon[38309]: osdmap e391: 8 total, 8 up, 8 in 2024-09-21T17:53:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:36 smithi162 ceph-mon[32106]: pgmap v560: 228 pgs: 228 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T17:53:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:36 smithi162 ceph-mon[32106]: osdmap e391: 8 total, 8 up, 8 in 2024-09-21T17:53:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:37 smithi042 ceph-mon[29361]: osdmap e392: 8 total, 8 up, 8 in 2024-09-21T17:53:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:37.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:37 smithi042 ceph-mon[38309]: osdmap e392: 8 total, 8 up, 8 in 2024-09-21T17:53:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:37 smithi162 ceph-mon[32106]: osdmap e392: 8 total, 8 up, 8 in 2024-09-21T17:53:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:38.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:38 smithi042 ceph-mon[29361]: pgmap v563: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:38 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:53:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:38 smithi042 ceph-mon[29361]: osdmap e393: 8 total, 8 up, 8 in 2024-09-21T17:53:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:38 smithi042 ceph-mon[38309]: pgmap v563: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:38 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:53:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:38 smithi042 ceph-mon[38309]: osdmap e393: 8 total, 8 up, 8 in 2024-09-21T17:53:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:38 smithi162 ceph-mon[32106]: pgmap v563: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:38 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:53:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:38 smithi162 ceph-mon[32106]: osdmap e393: 8 total, 8 up, 8 in 2024-09-21T17:53:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:39.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:53:38 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:53:39.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:39 smithi042 ceph-mon[29361]: osdmap e394: 8 total, 8 up, 8 in 2024-09-21T17:53:39.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-67"} : dispatch 2024-09-21T17:53:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-67"} : dispatch 2024-09-21T17:53:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:39 smithi042 ceph-mon[38309]: osdmap e394: 8 total, 8 up, 8 in 2024-09-21T17:53:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-67"} : dispatch 2024-09-21T17:53:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-67"} : dispatch 2024-09-21T17:53:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:39 smithi162 ceph-mon[32106]: osdmap e394: 8 total, 8 up, 8 in 2024-09-21T17:53:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-67"} : dispatch 2024-09-21T17:53:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-67"} : dispatch 2024-09-21T17:53:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:40 smithi162 ceph-mon[32106]: pgmap v566: 228 pgs: 228 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:40 smithi162 ceph-mon[32106]: osdmap e395: 8 total, 8 up, 8 in 2024-09-21T17:53:40.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:40 smithi042 ceph-mon[29361]: pgmap v566: 228 pgs: 228 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:40 smithi042 ceph-mon[29361]: osdmap e395: 8 total, 8 up, 8 in 2024-09-21T17:53:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:40 smithi042 ceph-mon[38309]: pgmap v566: 228 pgs: 228 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:53:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:40 smithi042 ceph-mon[38309]: osdmap e395: 8 total, 8 up, 8 in 2024-09-21T17:53:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:41 smithi162 ceph-mon[32106]: osdmap e396: 8 total, 8 up, 8 in 2024-09-21T17:53:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:41 smithi162 ceph-mon[32106]: osdmap e397: 8 total, 8 up, 8 in 2024-09-21T17:53:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[29361]: osdmap e396: 8 total, 8 up, 8 in 2024-09-21T17:53:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[29361]: osdmap e397: 8 total, 8 up, 8 in 2024-09-21T17:53:41.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:41.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[38309]: osdmap e396: 8 total, 8 up, 8 in 2024-09-21T17:53:41.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:41.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:41.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:41.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[38309]: osdmap e397: 8 total, 8 up, 8 in 2024-09-21T17:53:41.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:42 smithi162 ceph-mon[32106]: pgmap v569: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:53:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-69"} : dispatch 2024-09-21T17:53:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-69"} : dispatch 2024-09-21T17:53:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:42 smithi162 ceph-mon[32106]: osdmap e398: 8 total, 8 up, 8 in 2024-09-21T17:53:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[29361]: pgmap v569: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:53:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-69"} : dispatch 2024-09-21T17:53:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-69"} : dispatch 2024-09-21T17:53:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[29361]: osdmap e398: 8 total, 8 up, 8 in 2024-09-21T17:53:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[38309]: pgmap v569: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:53:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:53:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-69"} : dispatch 2024-09-21T17:53:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-69"} : dispatch 2024-09-21T17:53:42.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:42 smithi042 ceph-mon[38309]: osdmap e398: 8 total, 8 up, 8 in 2024-09-21T17:53:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:43 smithi162 ceph-mon[32106]: osdmap e399: 8 total, 8 up, 8 in 2024-09-21T17:53:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:43 smithi042 ceph-mon[29361]: osdmap e399: 8 total, 8 up, 8 in 2024-09-21T17:53:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:43.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:43.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:43 smithi042 ceph-mon[38309]: osdmap e399: 8 total, 8 up, 8 in 2024-09-21T17:53:43.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:43.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:53:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:53:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:53:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:53:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:44 smithi162 ceph-mon[32106]: pgmap v572: 196 pgs: 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T17:53:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:44 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:53:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:44 smithi162 ceph-mon[32106]: osdmap e400: 8 total, 8 up, 8 in 2024-09-21T17:53:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:44.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[29361]: pgmap v572: 196 pgs: 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T17:53:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:53:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[29361]: osdmap e400: 8 total, 8 up, 8 in 2024-09-21T17:53:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[38309]: pgmap v572: 196 pgs: 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T17:53:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:53:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:53:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[38309]: osdmap e400: 8 total, 8 up, 8 in 2024-09-21T17:53:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:53:44.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:44.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:53:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:46 smithi162 ceph-mon[32106]: pgmap v575: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T17:53:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:53:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:46 smithi162 ceph-mon[32106]: osdmap e401: 8 total, 8 up, 8 in 2024-09-21T17:53:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:46 smithi042 ceph-mon[29361]: pgmap v575: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T17:53:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:53:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:46 smithi042 ceph-mon[29361]: osdmap e401: 8 total, 8 up, 8 in 2024-09-21T17:53:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:46 smithi042 ceph-mon[38309]: pgmap v575: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T17:53:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:53:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:46 smithi042 ceph-mon[38309]: osdmap e401: 8 total, 8 up, 8 in 2024-09-21T17:53:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:47 smithi162 ceph-mon[32106]: osdmap e402: 8 total, 8 up, 8 in 2024-09-21T17:53:47.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:47 smithi042 ceph-mon[29361]: osdmap e402: 8 total, 8 up, 8 in 2024-09-21T17:53:47.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:47 smithi042 ceph-mon[38309]: osdmap e402: 8 total, 8 up, 8 in 2024-09-21T17:53:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:48 smithi162 ceph-mon[32106]: pgmap v578: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 255 B/s wr, 0 op/s 2024-09-21T17:53:48.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:48 smithi042 ceph-mon[29361]: pgmap v578: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 255 B/s wr, 0 op/s 2024-09-21T17:53:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:48 smithi042 ceph-mon[38309]: pgmap v578: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 255 B/s wr, 0 op/s 2024-09-21T17:53:49.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:53:49 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:53:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:50 smithi162 ceph-mon[32106]: pgmap v579: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-09-21T17:53:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:50 smithi042 ceph-mon[29361]: pgmap v579: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-09-21T17:53:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:53:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:50 smithi042 ceph-mon[38309]: pgmap v579: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-09-21T17:53:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:52 smithi162 ceph-mon[32106]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 890 B/s rd, 1.9 KiB/s wr, 4 op/s 2024-09-21T17:53:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:52 smithi042 ceph-mon[29361]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 890 B/s rd, 1.9 KiB/s wr, 4 op/s 2024-09-21T17:53:52.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:52 smithi042 ceph-mon[38309]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 890 B/s rd, 1.9 KiB/s wr, 4 op/s 2024-09-21T17:53:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:53:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:53:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:53:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:54 smithi162 ceph-mon[32106]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T17:53:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:54 smithi042 ceph-mon[29361]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T17:53:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:54 smithi042 ceph-mon[38309]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T17:53:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:56 smithi162 ceph-mon[32106]: pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-21T17:53:56.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:56 smithi042 ceph-mon[29361]: pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-21T17:53:56.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:56 smithi042 ceph-mon[38309]: pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-21T17:53:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.19", "id": [7, 3]} : dispatch 2024-09-21T17:53:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:57 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1e", "id": [6, 2]} : dispatch 2024-09-21T17:53:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.19", "id": [7, 3]} : dispatch 2024-09-21T17:53:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:57 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1e", "id": [6, 2]} : dispatch 2024-09-21T17:53:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.19", "id": [7, 3]} : dispatch 2024-09-21T17:53:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:57 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1e", "id": [6, 2]} : dispatch 2024-09-21T17:53:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:58 smithi162 ceph-mon[32106]: pgmap v583: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:53:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.19", "id": [7, 3]}]': finished 2024-09-21T17:53:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1e", "id": [6, 2]}]': finished 2024-09-21T17:53:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:58 smithi162 ceph-mon[32106]: osdmap e403: 8 total, 8 up, 8 in 2024-09-21T17:53:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:58 smithi042 ceph-mon[29361]: pgmap v583: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:53:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.19", "id": [7, 3]}]': finished 2024-09-21T17:53:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1e", "id": [6, 2]}]': finished 2024-09-21T17:53:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:58 smithi042 ceph-mon[29361]: osdmap e403: 8 total, 8 up, 8 in 2024-09-21T17:53:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:58 smithi042 ceph-mon[38309]: pgmap v583: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:53:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.19", "id": [7, 3]}]': finished 2024-09-21T17:53:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1e", "id": [6, 2]}]': finished 2024-09-21T17:53:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:58 smithi042 ceph-mon[38309]: osdmap e403: 8 total, 8 up, 8 in 2024-09-21T17:53:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:53:59.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:53:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:53:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:53:59 smithi162 ceph-mon[32106]: osdmap e404: 8 total, 8 up, 8 in 2024-09-21T17:53:59.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:53:59 smithi042 ceph-mon[29361]: osdmap e404: 8 total, 8 up, 8 in 2024-09-21T17:53:59.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:53:59 smithi042 ceph-mon[38309]: osdmap e404: 8 total, 8 up, 8 in 2024-09-21T17:54:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:00 smithi162 ceph-mon[32106]: pgmap v586: 228 pgs: 2 peering, 226 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-21T17:54:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:00 smithi042 ceph-mon[29361]: pgmap v586: 228 pgs: 2 peering, 226 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-21T17:54:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:00 smithi042 ceph-mon[38309]: pgmap v586: 228 pgs: 2 peering, 226 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-21T17:54:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:02 smithi162 ceph-mon[32106]: pgmap v587: 228 pgs: 2 peering, 226 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T17:54:02.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:02 smithi042 ceph-mon[29361]: pgmap v587: 228 pgs: 2 peering, 226 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T17:54:02.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:02 smithi042 ceph-mon[38309]: pgmap v587: 228 pgs: 2 peering, 226 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T17:54:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:54:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:54:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:54:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:04 smithi162 ceph-mon[32106]: pgmap v588: 228 pgs: 1 peering, 227 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T17:54:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:04 smithi042 ceph-mon[29361]: pgmap v588: 228 pgs: 1 peering, 227 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T17:54:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:04 smithi042 ceph-mon[38309]: pgmap v588: 228 pgs: 1 peering, 227 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T17:54:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:06 smithi162 ceph-mon[32106]: pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T17:54:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:06 smithi042 ceph-mon[29361]: pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T17:54:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:06 smithi042 ceph-mon[38309]: pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T17:54:07.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:07.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:07.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-71"} : dispatch 2024-09-21T17:54:07.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-71"} : dispatch 2024-09-21T17:54:07.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-71"} : dispatch 2024-09-21T17:54:07.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-71"} : dispatch 2024-09-21T17:54:07.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:07.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:07.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-71"} : dispatch 2024-09-21T17:54:07.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-71"} : dispatch 2024-09-21T17:54:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:08 smithi162 ceph-mon[32106]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 311 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T17:54:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:08 smithi162 ceph-mon[32106]: osdmap e405: 8 total, 8 up, 8 in 2024-09-21T17:54:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:08 smithi042 ceph-mon[29361]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 311 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T17:54:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:08 smithi042 ceph-mon[29361]: osdmap e405: 8 total, 8 up, 8 in 2024-09-21T17:54:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:08 smithi042 ceph-mon[38309]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 311 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T17:54:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:08 smithi042 ceph-mon[38309]: osdmap e405: 8 total, 8 up, 8 in 2024-09-21T17:54:09.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:54:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:54:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:09 smithi162 ceph-mon[32106]: osdmap e406: 8 total, 8 up, 8 in 2024-09-21T17:54:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:09 smithi042 ceph-mon[29361]: osdmap e406: 8 total, 8 up, 8 in 2024-09-21T17:54:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:09 smithi042 ceph-mon[38309]: osdmap e406: 8 total, 8 up, 8 in 2024-09-21T17:54:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:10 smithi162 ceph-mon[32106]: pgmap v593: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:10 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:10 smithi162 ceph-mon[32106]: osdmap e407: 8 total, 8 up, 8 in 2024-09-21T17:54:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[29361]: pgmap v593: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[29361]: osdmap e407: 8 total, 8 up, 8 in 2024-09-21T17:54:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[38309]: pgmap v593: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[38309]: osdmap e407: 8 total, 8 up, 8 in 2024-09-21T17:54:10.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:11 smithi162 ceph-mon[32106]: osdmap e408: 8 total, 8 up, 8 in 2024-09-21T17:54:11.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:11 smithi042 ceph-mon[29361]: osdmap e408: 8 total, 8 up, 8 in 2024-09-21T17:54:11.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:11 smithi042 ceph-mon[38309]: osdmap e408: 8 total, 8 up, 8 in 2024-09-21T17:54:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:12 smithi162 ceph-mon[32106]: pgmap v596: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:12 smithi162 ceph-mon[32106]: osdmap e409: 8 total, 8 up, 8 in 2024-09-21T17:54:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:12 smithi042 ceph-mon[29361]: pgmap v596: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:12 smithi042 ceph-mon[29361]: osdmap e409: 8 total, 8 up, 8 in 2024-09-21T17:54:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:12 smithi042 ceph-mon[38309]: pgmap v596: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:12 smithi042 ceph-mon[38309]: osdmap e409: 8 total, 8 up, 8 in 2024-09-21T17:54:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:54:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:54:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:54:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:14 smithi162 ceph-mon[32106]: pgmap v598: 228 pgs: 12 unknown, 216 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 849 B/s wr, 2 op/s 2024-09-21T17:54:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:14 smithi042 ceph-mon[29361]: pgmap v598: 228 pgs: 12 unknown, 216 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 849 B/s wr, 2 op/s 2024-09-21T17:54:14.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:14 smithi042 ceph-mon[38309]: pgmap v598: 228 pgs: 12 unknown, 216 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 849 B/s wr, 2 op/s 2024-09-21T17:54:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:16 smithi162 ceph-mon[32106]: pgmap v599: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T17:54:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:16 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:54:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:16 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:54:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:16 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:54:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:16 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:54:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:16 smithi042 ceph-mon[29361]: pgmap v599: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T17:54:16.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:16 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:54:16.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:16 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:54:16.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:16 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:54:16.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:16 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:54:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:16 smithi042 ceph-mon[38309]: pgmap v599: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T17:54:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:16 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:54:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:16 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:54:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:16 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:54:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:16 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:54:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:18 smithi162 ceph-mon[32106]: pgmap v600: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 917 B/s wr, 3 op/s 2024-09-21T17:54:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:18 smithi042 ceph-mon[29361]: pgmap v600: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 917 B/s wr, 3 op/s 2024-09-21T17:54:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:18 smithi042 ceph-mon[38309]: pgmap v600: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 917 B/s wr, 3 op/s 2024-09-21T17:54:19.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:54:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:54:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:19 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:19.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:19 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:19 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:20 smithi162 ceph-mon[32106]: pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 813 B/s wr, 3 op/s 2024-09-21T17:54:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:20 smithi042 ceph-mon[29361]: pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 813 B/s wr, 3 op/s 2024-09-21T17:54:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:20 smithi042 ceph-mon[38309]: pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 813 B/s wr, 3 op/s 2024-09-21T17:54:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:22 smithi162 ceph-mon[32106]: pgmap v602: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-09-21T17:54:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-73"} : dispatch 2024-09-21T17:54:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-73"} : dispatch 2024-09-21T17:54:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:22 smithi042 ceph-mon[29361]: pgmap v602: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-09-21T17:54:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-73"} : dispatch 2024-09-21T17:54:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-73"} : dispatch 2024-09-21T17:54:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:22 smithi042 ceph-mon[38309]: pgmap v602: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-09-21T17:54:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:22.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-73"} : dispatch 2024-09-21T17:54:22.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-73"} : dispatch 2024-09-21T17:54:23.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:23 smithi162 ceph-mon[32106]: osdmap e410: 8 total, 8 up, 8 in 2024-09-21T17:54:23.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:23 smithi042 ceph-mon[29361]: osdmap e410: 8 total, 8 up, 8 in 2024-09-21T17:54:23.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:23 smithi042 ceph-mon[38309]: osdmap e410: 8 total, 8 up, 8 in 2024-09-21T17:54:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:54:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:54:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:54:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:24 smithi042 ceph-mon[29361]: pgmap v604: 196 pgs: 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-21T17:54:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:24 smithi042 ceph-mon[29361]: osdmap e411: 8 total, 8 up, 8 in 2024-09-21T17:54:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:24 smithi042 ceph-mon[38309]: pgmap v604: 196 pgs: 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-21T17:54:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:24 smithi042 ceph-mon[38309]: osdmap e411: 8 total, 8 up, 8 in 2024-09-21T17:54:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:24 smithi162 ceph-mon[32106]: pgmap v604: 196 pgs: 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-21T17:54:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:24 smithi162 ceph-mon[32106]: osdmap e411: 8 total, 8 up, 8 in 2024-09-21T17:54:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:25 smithi042 ceph-mon[29361]: osdmap e412: 8 total, 8 up, 8 in 2024-09-21T17:54:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:25 smithi042 ceph-mon[29361]: pgmap v607: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:25 smithi042 ceph-mon[38309]: osdmap e412: 8 total, 8 up, 8 in 2024-09-21T17:54:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:25 smithi042 ceph-mon[38309]: pgmap v607: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:25 smithi162 ceph-mon[32106]: osdmap e412: 8 total, 8 up, 8 in 2024-09-21T17:54:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:25 smithi162 ceph-mon[32106]: pgmap v607: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:26 smithi042 ceph-mon[29361]: osdmap e413: 8 total, 8 up, 8 in 2024-09-21T17:54:26.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:26 smithi042 ceph-mon[38309]: osdmap e413: 8 total, 8 up, 8 in 2024-09-21T17:54:26.976 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:26 smithi162 ceph-mon[32106]: osdmap e413: 8 total, 8 up, 8 in 2024-09-21T17:54:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[29361]: osdmap e414: 8 total, 8 up, 8 in 2024-09-21T17:54:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-75"} : dispatch 2024-09-21T17:54:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-75"} : dispatch 2024-09-21T17:54:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[29361]: pgmap v610: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[38309]: osdmap e414: 8 total, 8 up, 8 in 2024-09-21T17:54:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-75"} : dispatch 2024-09-21T17:54:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-75"} : dispatch 2024-09-21T17:54:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:27 smithi042 ceph-mon[38309]: pgmap v610: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:27 smithi162 ceph-mon[32106]: osdmap e414: 8 total, 8 up, 8 in 2024-09-21T17:54:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-75"} : dispatch 2024-09-21T17:54:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-75"} : dispatch 2024-09-21T17:54:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:27 smithi162 ceph-mon[32106]: pgmap v610: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:54:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:28 smithi042 ceph-mon[29361]: osdmap e415: 8 total, 8 up, 8 in 2024-09-21T17:54:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:28 smithi042 ceph-mon[38309]: osdmap e415: 8 total, 8 up, 8 in 2024-09-21T17:54:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:29.038 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:28 smithi162 ceph-mon[32106]: osdmap e415: 8 total, 8 up, 8 in 2024-09-21T17:54:29.038 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:29.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:54:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:54:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:29 smithi042 ceph-mon[29361]: osdmap e416: 8 total, 8 up, 8 in 2024-09-21T17:54:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:29 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:29 smithi042 ceph-mon[29361]: pgmap v613: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:54:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:29 smithi042 ceph-mon[38309]: osdmap e416: 8 total, 8 up, 8 in 2024-09-21T17:54:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:29 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:29 smithi042 ceph-mon[38309]: pgmap v613: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:54:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:29 smithi162 ceph-mon[32106]: osdmap e416: 8 total, 8 up, 8 in 2024-09-21T17:54:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:29 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:29 smithi162 ceph-mon[32106]: pgmap v613: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:54:30.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:30 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:30 smithi042 ceph-mon[29361]: osdmap e417: 8 total, 8 up, 8 in 2024-09-21T17:54:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:30 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:30 smithi042 ceph-mon[38309]: osdmap e417: 8 total, 8 up, 8 in 2024-09-21T17:54:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:30 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:30 smithi162 ceph-mon[32106]: osdmap e417: 8 total, 8 up, 8 in 2024-09-21T17:54:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:31.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[29361]: osdmap e418: 8 total, 8 up, 8 in 2024-09-21T17:54:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-77"} : dispatch 2024-09-21T17:54:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-77"} : dispatch 2024-09-21T17:54:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[29361]: pgmap v616: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:54:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[38309]: osdmap e418: 8 total, 8 up, 8 in 2024-09-21T17:54:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-77"} : dispatch 2024-09-21T17:54:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-77"} : dispatch 2024-09-21T17:54:31.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:31 smithi042 ceph-mon[38309]: pgmap v616: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:54:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:31 smithi162 ceph-mon[32106]: osdmap e418: 8 total, 8 up, 8 in 2024-09-21T17:54:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-77"} : dispatch 2024-09-21T17:54:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-77"} : dispatch 2024-09-21T17:54:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:31 smithi162 ceph-mon[32106]: pgmap v616: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:54:32.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:32 smithi042 ceph-mon[29361]: osdmap e419: 8 total, 8 up, 8 in 2024-09-21T17:54:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:32 smithi042 ceph-mon[38309]: osdmap e419: 8 total, 8 up, 8 in 2024-09-21T17:54:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:32 smithi162 ceph-mon[32106]: osdmap e419: 8 total, 8 up, 8 in 2024-09-21T17:54:33.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[29361]: osdmap e420: 8 total, 8 up, 8 in 2024-09-21T17:54:33.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[29361]: pgmap v619: 228 pgs: 17 creating+peering, 15 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:54:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[29361]: osdmap e421: 8 total, 8 up, 8 in 2024-09-21T17:54:33.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:54:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:54:33.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[38309]: osdmap e420: 8 total, 8 up, 8 in 2024-09-21T17:54:33.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:33.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:33.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[38309]: pgmap v619: 228 pgs: 17 creating+peering, 15 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:54:33.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:33.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:33 smithi042 ceph-mon[38309]: osdmap e421: 8 total, 8 up, 8 in 2024-09-21T17:54:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:33 smithi162 ceph-mon[32106]: osdmap e420: 8 total, 8 up, 8 in 2024-09-21T17:54:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:33 smithi162 ceph-mon[32106]: pgmap v619: 228 pgs: 17 creating+peering, 15 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:54:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:33 smithi162 ceph-mon[32106]: osdmap e421: 8 total, 8 up, 8 in 2024-09-21T17:54:34.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:34.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:34 smithi042 ceph-mon[29361]: osdmap e422: 8 total, 8 up, 8 in 2024-09-21T17:54:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:34 smithi042 ceph-mon[38309]: osdmap e422: 8 total, 8 up, 8 in 2024-09-21T17:54:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:34 smithi162 ceph-mon[32106]: osdmap e422: 8 total, 8 up, 8 in 2024-09-21T17:54:35.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:35 smithi042 ceph-mon[29361]: pgmap v622: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:54:35.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:35 smithi042 ceph-mon[29361]: osdmap e423: 8 total, 8 up, 8 in 2024-09-21T17:54:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:35 smithi042 ceph-mon[38309]: pgmap v622: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:54:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:35 smithi042 ceph-mon[38309]: osdmap e423: 8 total, 8 up, 8 in 2024-09-21T17:54:36.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:35 smithi162 ceph-mon[32106]: pgmap v622: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:54:36.078 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:35 smithi162 ceph-mon[32106]: osdmap e423: 8 total, 8 up, 8 in 2024-09-21T17:54:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:36 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "304.b"} : dispatch 2024-09-21T17:54:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:36 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "304.b"}]: dispatch 2024-09-21T17:54:37.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:36 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:37.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "304.b"} : dispatch 2024-09-21T17:54:37.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:36 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "304.b"}]: dispatch 2024-09-21T17:54:37.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:36 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:54:37.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "304.b"} : dispatch 2024-09-21T17:54:37.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:36 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "304.b"}]: dispatch 2024-09-21T17:54:38.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:37 smithi162 ceph-mon[32106]: 304.b deep-scrub starts 2024-09-21T17:54:38.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:37 smithi162 ceph-mon[32106]: 304.b deep-scrub ok 2024-09-21T17:54:38.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:37 smithi162 ceph-mon[32106]: pgmap v624: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 434 B/s wr, 2 op/s 2024-09-21T17:54:38.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:37 smithi042 ceph-mon[29361]: 304.b deep-scrub starts 2024-09-21T17:54:38.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:37 smithi042 ceph-mon[29361]: 304.b deep-scrub ok 2024-09-21T17:54:38.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:37 smithi042 ceph-mon[29361]: pgmap v624: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 434 B/s wr, 2 op/s 2024-09-21T17:54:38.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:37 smithi042 ceph-mon[38309]: 304.b deep-scrub starts 2024-09-21T17:54:38.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:37 smithi042 ceph-mon[38309]: 304.b deep-scrub ok 2024-09-21T17:54:38.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:37 smithi042 ceph-mon[38309]: pgmap v624: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 434 B/s wr, 2 op/s 2024-09-21T17:54:39.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:54:39 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:54:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:40 smithi042 ceph-mon[29361]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:54:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:40 smithi042 ceph-mon[38309]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:54:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:40 smithi162 ceph-mon[32106]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:54:42.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:42 smithi042 ceph-mon[29361]: pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 664 B/s rd, 664 B/s wr, 1 op/s 2024-09-21T17:54:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:42 smithi042 ceph-mon[38309]: pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 664 B/s rd, 664 B/s wr, 1 op/s 2024-09-21T17:54:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:42 smithi162 ceph-mon[32106]: pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 664 B/s rd, 664 B/s wr, 1 op/s 2024-09-21T17:54:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:54:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:54:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:54:44.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:44 smithi042 ceph-mon[29361]: pgmap v627: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 587 B/s wr, 2 op/s 2024-09-21T17:54:44.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:44 smithi042 ceph-mon[38309]: pgmap v627: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 587 B/s wr, 2 op/s 2024-09-21T17:54:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:44 smithi162 ceph-mon[32106]: pgmap v627: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 587 B/s wr, 2 op/s 2024-09-21T17:54:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:46 smithi042 ceph-mon[29361]: pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:54:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:46 smithi042 ceph-mon[38309]: pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:54:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:46 smithi162 ceph-mon[32106]: pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-21T17:54:48.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:48 smithi042 ceph-mon[29361]: pgmap v629: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 437 B/s wr, 1 op/s 2024-09-21T17:54:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:48 smithi042 ceph-mon[38309]: pgmap v629: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 437 B/s wr, 1 op/s 2024-09-21T17:54:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:48 smithi162 ceph-mon[32106]: pgmap v629: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 437 B/s wr, 1 op/s 2024-09-21T17:54:49.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:54:49 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:54:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:50 smithi162 ceph-mon[32106]: pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T17:54:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:50 smithi042 ceph-mon[29361]: pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T17:54:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:54:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:50 smithi042 ceph-mon[38309]: pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T17:54:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:52 smithi162 ceph-mon[32106]: pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T17:54:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:52 smithi042 ceph-mon[29361]: pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T17:54:52.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:52 smithi042 ceph-mon[38309]: pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T17:54:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:54:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:54:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:54:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:54 smithi162 ceph-mon[32106]: pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:54:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:54 smithi042 ceph-mon[29361]: pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:54:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:54 smithi042 ceph-mon[38309]: pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:54:56.075 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 17:54:55 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T17:54:55.677+0000 7fdd4b193640 -1 snap_mapper.add_oid found existing snaps mapped on 304:d270925a:test-rados-api-smithi042-71455-80::foo:2, removing 2024-09-21T17:54:56.164 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:54:55 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1[46957]: 2024-09-21T17:54:55.677+0000 7fe48da7e640 -1 snap_mapper.add_oid found existing snaps mapped on 304:d270925a:test-rados-api-smithi042-71455-80::foo:2, removing 2024-09-21T17:54:56.164 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 17:54:55 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3[58121]: 2024-09-21T17:54:55.677+0000 7fb16a0db640 -1 snap_mapper.add_oid found existing snaps mapped on 304:d270925a:test-rados-api-smithi042-71455-80::foo:2, removing 2024-09-21T17:54:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:56 smithi162 ceph-mon[32106]: pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:54:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-79"} : dispatch 2024-09-21T17:54:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-79"} : dispatch 2024-09-21T17:54:56.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:56 smithi042 ceph-mon[29361]: pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:54:56.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:56.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:56.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-79"} : dispatch 2024-09-21T17:54:56.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-79"} : dispatch 2024-09-21T17:54:56.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:56 smithi042 ceph-mon[38309]: pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T17:54:56.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:56.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:54:56.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-79"} : dispatch 2024-09-21T17:54:56.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-79"} : dispatch 2024-09-21T17:54:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:57 smithi162 ceph-mon[32106]: osdmap e424: 8 total, 8 up, 8 in 2024-09-21T17:54:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:57 smithi162 ceph-mon[32106]: osdmap e425: 8 total, 8 up, 8 in 2024-09-21T17:54:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:57 smithi042 ceph-mon[29361]: osdmap e424: 8 total, 8 up, 8 in 2024-09-21T17:54:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:57 smithi042 ceph-mon[29361]: osdmap e425: 8 total, 8 up, 8 in 2024-09-21T17:54:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:57.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:57 smithi042 ceph-mon[38309]: osdmap e424: 8 total, 8 up, 8 in 2024-09-21T17:54:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:57 smithi042 ceph-mon[38309]: osdmap e425: 8 total, 8 up, 8 in 2024-09-21T17:54:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:54:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:58 smithi162 ceph-mon[32106]: pgmap v635: 196 pgs: 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:54:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:58 smithi162 ceph-mon[32106]: osdmap e426: 8 total, 8 up, 8 in 2024-09-21T17:54:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:58.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:54:58.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:54:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:54:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[29361]: pgmap v635: 196 pgs: 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:54:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[29361]: osdmap e426: 8 total, 8 up, 8 in 2024-09-21T17:54:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:54:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:54:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[38309]: pgmap v635: 196 pgs: 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:54:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:54:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:54:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[38309]: osdmap e426: 8 total, 8 up, 8 in 2024-09-21T17:54:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:54:58.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:54:58.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:54:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:54:59.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:54:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:55:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:00 smithi162 ceph-mon[32106]: pgmap v638: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T17:55:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:00 smithi162 ceph-mon[32106]: osdmap e427: 8 total, 8 up, 8 in 2024-09-21T17:55:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[29361]: pgmap v638: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T17:55:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[29361]: osdmap e427: 8 total, 8 up, 8 in 2024-09-21T17:55:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[38309]: pgmap v638: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T17:55:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[38309]: osdmap e427: 8 total, 8 up, 8 in 2024-09-21T17:55:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:55:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:01 smithi162 ceph-mon[32106]: osdmap e428: 8 total, 8 up, 8 in 2024-09-21T17:55:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:01.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:55:01.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:01 smithi042 ceph-mon[29361]: osdmap e428: 8 total, 8 up, 8 in 2024-09-21T17:55:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:01.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:55:01.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:01 smithi042 ceph-mon[38309]: osdmap e428: 8 total, 8 up, 8 in 2024-09-21T17:55:01.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:01.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:02 smithi162 ceph-mon[32106]: pgmap v641: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T17:55:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:02 smithi162 ceph-mon[32106]: osdmap e429: 8 total, 8 up, 8 in 2024-09-21T17:55:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:02.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:02 smithi042 ceph-mon[29361]: pgmap v641: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T17:55:02.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:02.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:02.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:02 smithi042 ceph-mon[29361]: osdmap e429: 8 total, 8 up, 8 in 2024-09-21T17:55:02.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:02.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:02 smithi042 ceph-mon[38309]: pgmap v641: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T17:55:02.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:02.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:02.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:02 smithi042 ceph-mon[38309]: osdmap e429: 8 total, 8 up, 8 in 2024-09-21T17:55:02.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:03 smithi162 ceph-mon[32106]: osdmap e430: 8 total, 8 up, 8 in 2024-09-21T17:55:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T17:55:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T17:55:03.882 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:03.882 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:03 smithi042 ceph-mon[29361]: osdmap e430: 8 total, 8 up, 8 in 2024-09-21T17:55:03.882 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T17:55:03.882 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T17:55:03.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:03.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:03 smithi042 ceph-mon[38309]: osdmap e430: 8 total, 8 up, 8 in 2024-09-21T17:55:03.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T17:55:03.882 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T17:55:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:55:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:55:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:55:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:04 smithi162 ceph-mon[32106]: pgmap v644: 228 pgs: 13 creating+peering, 215 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.2 KiB/s wr, 4 op/s 2024-09-21T17:55:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-21T17:55:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:04 smithi162 ceph-mon[32106]: osdmap e431: 8 total, 8 up, 8 in 2024-09-21T17:55:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T17:55:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T17:55:04.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:04 smithi042 ceph-mon[38309]: pgmap v644: 228 pgs: 13 creating+peering, 215 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.2 KiB/s wr, 4 op/s 2024-09-21T17:55:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-21T17:55:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:04 smithi042 ceph-mon[38309]: osdmap e431: 8 total, 8 up, 8 in 2024-09-21T17:55:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T17:55:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T17:55:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:04 smithi042 ceph-mon[29361]: pgmap v644: 228 pgs: 13 creating+peering, 215 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.2 KiB/s wr, 4 op/s 2024-09-21T17:55:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-21T17:55:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:04 smithi042 ceph-mon[29361]: osdmap e431: 8 total, 8 up, 8 in 2024-09-21T17:55:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T17:55:04.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T17:55:05.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-21T17:55:05.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:05 smithi162 ceph-mon[32106]: osdmap e432: 8 total, 8 up, 8 in 2024-09-21T17:55:05.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:05 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:05.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:05.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-21T17:55:05.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:05 smithi042 ceph-mon[38309]: osdmap e432: 8 total, 8 up, 8 in 2024-09-21T17:55:05.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:05 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:05.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:05.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-21T17:55:05.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:05 smithi042 ceph-mon[29361]: osdmap e432: 8 total, 8 up, 8 in 2024-09-21T17:55:05.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:05 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:05.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:06 smithi162 ceph-mon[32106]: pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-09-21T17:55:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:06 smithi162 ceph-mon[32106]: osdmap e433: 8 total, 8 up, 8 in 2024-09-21T17:55:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-81"} : dispatch 2024-09-21T17:55:06.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-81"} : dispatch 2024-09-21T17:55:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[29361]: pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-09-21T17:55:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[29361]: osdmap e433: 8 total, 8 up, 8 in 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-81"} : dispatch 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-81"} : dispatch 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[38309]: pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[38309]: osdmap e433: 8 total, 8 up, 8 in 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-81"} : dispatch 2024-09-21T17:55:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-81"} : dispatch 2024-09-21T17:55:07.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:07 smithi162 ceph-mon[32106]: osdmap e434: 8 total, 8 up, 8 in 2024-09-21T17:55:07.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:07 smithi042 ceph-mon[29361]: osdmap e434: 8 total, 8 up, 8 in 2024-09-21T17:55:07.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:07 smithi042 ceph-mon[38309]: osdmap e434: 8 total, 8 up, 8 in 2024-09-21T17:55:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:08 smithi162 ceph-mon[32106]: pgmap v650: 196 pgs: 196 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 2 op/s 2024-09-21T17:55:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:08 smithi162 ceph-mon[32106]: osdmap e435: 8 total, 8 up, 8 in 2024-09-21T17:55:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:08 smithi042 ceph-mon[29361]: pgmap v650: 196 pgs: 196 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 2 op/s 2024-09-21T17:55:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:08 smithi042 ceph-mon[29361]: osdmap e435: 8 total, 8 up, 8 in 2024-09-21T17:55:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:08 smithi042 ceph-mon[38309]: pgmap v650: 196 pgs: 196 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 2 op/s 2024-09-21T17:55:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:08 smithi042 ceph-mon[38309]: osdmap e435: 8 total, 8 up, 8 in 2024-09-21T17:55:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:09.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:55:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:55:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:09 smithi162 ceph-mon[32106]: osdmap e436: 8 total, 8 up, 8 in 2024-09-21T17:55:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:09 smithi042 ceph-mon[29361]: osdmap e436: 8 total, 8 up, 8 in 2024-09-21T17:55:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:09 smithi042 ceph-mon[38309]: osdmap e436: 8 total, 8 up, 8 in 2024-09-21T17:55:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:10 smithi162 ceph-mon[32106]: pgmap v653: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 32 op/s 2024-09-21T17:55:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:10 smithi162 ceph-mon[32106]: osdmap e437: 8 total, 8 up, 8 in 2024-09-21T17:55:10.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:10.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[29361]: pgmap v653: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 32 op/s 2024-09-21T17:55:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[29361]: osdmap e437: 8 total, 8 up, 8 in 2024-09-21T17:55:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[38309]: pgmap v653: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 32 op/s 2024-09-21T17:55:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[38309]: osdmap e437: 8 total, 8 up, 8 in 2024-09-21T17:55:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:55:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:11 smithi162 ceph-mon[32106]: osdmap e438: 8 total, 8 up, 8 in 2024-09-21T17:55:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:11.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:55:11.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:11 smithi042 ceph-mon[29361]: osdmap e438: 8 total, 8 up, 8 in 2024-09-21T17:55:11.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:11.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:55:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:11 smithi042 ceph-mon[38309]: osdmap e438: 8 total, 8 up, 8 in 2024-09-21T17:55:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:12 smithi162 ceph-mon[32106]: pgmap v656: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 9.0 KiB/s wr, 32 op/s 2024-09-21T17:55:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:12 smithi162 ceph-mon[32106]: osdmap e439: 8 total, 8 up, 8 in 2024-09-21T17:55:12.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:12.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:12.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:12 smithi042 ceph-mon[29361]: pgmap v656: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 9.0 KiB/s wr, 32 op/s 2024-09-21T17:55:12.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:12.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:12 smithi042 ceph-mon[29361]: osdmap e439: 8 total, 8 up, 8 in 2024-09-21T17:55:12.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:12.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:12.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:12 smithi042 ceph-mon[38309]: pgmap v656: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 9.0 KiB/s wr, 32 op/s 2024-09-21T17:55:12.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:12.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:12 smithi042 ceph-mon[38309]: osdmap e439: 8 total, 8 up, 8 in 2024-09-21T17:55:12.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:12.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:13 smithi162 ceph-mon[32106]: osdmap e440: 8 total, 8 up, 8 in 2024-09-21T17:55:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:13 smithi042 ceph-mon[29361]: osdmap e440: 8 total, 8 up, 8 in 2024-09-21T17:55:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:13.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:13.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:13 smithi042 ceph-mon[38309]: osdmap e440: 8 total, 8 up, 8 in 2024-09-21T17:55:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:55:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:55:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:55:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:14 smithi162 ceph-mon[32106]: pgmap v659: 228 pgs: 6 creating+peering, 222 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:55:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:14 smithi162 ceph-mon[32106]: osdmap e441: 8 total, 8 up, 8 in 2024-09-21T17:55:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:14 smithi042 ceph-mon[29361]: pgmap v659: 228 pgs: 6 creating+peering, 222 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:55:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:14 smithi042 ceph-mon[29361]: osdmap e441: 8 total, 8 up, 8 in 2024-09-21T17:55:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:14 smithi042 ceph-mon[38309]: pgmap v659: 228 pgs: 6 creating+peering, 222 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:55:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:14 smithi042 ceph-mon[38309]: osdmap e441: 8 total, 8 up, 8 in 2024-09-21T17:55:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:15 smithi162 ceph-mon[32106]: osdmap e442: 8 total, 8 up, 8 in 2024-09-21T17:55:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-83"} : dispatch 2024-09-21T17:55:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-83"} : dispatch 2024-09-21T17:55:15.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:15 smithi042 ceph-mon[29361]: osdmap e442: 8 total, 8 up, 8 in 2024-09-21T17:55:15.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:15.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:15.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-83"} : dispatch 2024-09-21T17:55:15.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-83"} : dispatch 2024-09-21T17:55:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:15 smithi042 ceph-mon[38309]: osdmap e442: 8 total, 8 up, 8 in 2024-09-21T17:55:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-83"} : dispatch 2024-09-21T17:55:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-83"} : dispatch 2024-09-21T17:55:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:16 smithi162 ceph-mon[32106]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:55:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:16 smithi162 ceph-mon[32106]: osdmap e443: 8 total, 8 up, 8 in 2024-09-21T17:55:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:16 smithi042 ceph-mon[29361]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:55:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:16 smithi042 ceph-mon[29361]: osdmap e443: 8 total, 8 up, 8 in 2024-09-21T17:55:16.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:16 smithi042 ceph-mon[38309]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:55:16.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:16 smithi042 ceph-mon[38309]: osdmap e443: 8 total, 8 up, 8 in 2024-09-21T17:55:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:17 smithi162 ceph-mon[32106]: osdmap e444: 8 total, 8 up, 8 in 2024-09-21T17:55:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:17 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:55:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:17 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:55:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:17 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:55:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:17 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:55:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[29361]: osdmap e444: 8 total, 8 up, 8 in 2024-09-21T17:55:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:55:17.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:55:17.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:55:17.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:55:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[38309]: osdmap e444: 8 total, 8 up, 8 in 2024-09-21T17:55:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:55:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:55:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:55:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:17 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:55:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[29361]: pgmap v665: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:55:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[29361]: osdmap e445: 8 total, 8 up, 8 in 2024-09-21T17:55:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[38309]: pgmap v665: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:55:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[38309]: osdmap e445: 8 total, 8 up, 8 in 2024-09-21T17:55:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:18 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:18 smithi162 ceph-mon[32106]: pgmap v665: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:55:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:18 smithi162 ceph-mon[32106]: osdmap e445: 8 total, 8 up, 8 in 2024-09-21T17:55:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:19.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:19.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:19.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:18 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:19.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:55:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:55:19.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:19.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:19.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:19 smithi042 ceph-mon[29361]: osdmap e446: 8 total, 8 up, 8 in 2024-09-21T17:55:19.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:19.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:55:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:19 smithi042 ceph-mon[38309]: osdmap e446: 8 total, 8 up, 8 in 2024-09-21T17:55:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:55:20.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:20.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:20.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:19 smithi162 ceph-mon[32106]: osdmap e446: 8 total, 8 up, 8 in 2024-09-21T17:55:20.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:20.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_tier","val": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:55:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[29361]: pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-21T17:55:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[29361]: osdmap e447: 8 total, 8 up, 8 in 2024-09-21T17:55:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[29361]: osdmap e448: 8 total, 8 up, 8 in 2024-09-21T17:55:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:20.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[38309]: pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-21T17:55:20.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[38309]: osdmap e447: 8 total, 8 up, 8 in 2024-09-21T17:55:20.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:20.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:20.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:20.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[38309]: osdmap e448: 8 total, 8 up, 8 in 2024-09-21T17:55:20.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:20.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:20 smithi162 ceph-mon[32106]: pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-21T17:55:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:20 smithi162 ceph-mon[32106]: osdmap e447: 8 total, 8 up, 8 in 2024-09-21T17:55:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:21.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:21.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:20 smithi162 ceph-mon[32106]: osdmap e448: 8 total, 8 up, 8 in 2024-09-21T17:55:21.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:21.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:22.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:22 smithi042 ceph-mon[29361]: pgmap v671: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-21T17:55:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:22 smithi042 ceph-mon[29361]: osdmap e449: 8 total, 8 up, 8 in 2024-09-21T17:55:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:22 smithi042 ceph-mon[38309]: pgmap v671: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-21T17:55:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:22 smithi042 ceph-mon[38309]: osdmap e449: 8 total, 8 up, 8 in 2024-09-21T17:55:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:22 smithi162 ceph-mon[32106]: pgmap v671: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-21T17:55:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:22 smithi162 ceph-mon[32106]: osdmap e449: 8 total, 8 up, 8 in 2024-09-21T17:55:23.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:23 smithi042 ceph-mon[29361]: osdmap e450: 8 total, 8 up, 8 in 2024-09-21T17:55:23.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:23 smithi042 ceph-mon[29361]: pgmap v674: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T17:55:23.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:23 smithi042 ceph-mon[38309]: osdmap e450: 8 total, 8 up, 8 in 2024-09-21T17:55:23.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:23 smithi042 ceph-mon[38309]: pgmap v674: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T17:55:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:23 smithi162 ceph-mon[32106]: osdmap e450: 8 total, 8 up, 8 in 2024-09-21T17:55:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:23 smithi162 ceph-mon[32106]: pgmap v674: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T17:55:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:55:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:55:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:55:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[29361]: osdmap e451: 8 total, 8 up, 8 in 2024-09-21T17:55:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-85"} : dispatch 2024-09-21T17:55:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-85"} : dispatch 2024-09-21T17:55:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[38309]: osdmap e451: 8 total, 8 up, 8 in 2024-09-21T17:55:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-85"} : dispatch 2024-09-21T17:55:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-85"} : dispatch 2024-09-21T17:55:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:24 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:24 smithi162 ceph-mon[32106]: osdmap e451: 8 total, 8 up, 8 in 2024-09-21T17:55:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:25.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-85"} : dispatch 2024-09-21T17:55:25.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-85"} : dispatch 2024-09-21T17:55:25.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:24 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:25.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:25 smithi042 ceph-mon[29361]: osdmap e452: 8 total, 8 up, 8 in 2024-09-21T17:55:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:25 smithi042 ceph-mon[29361]: pgmap v677: 196 pgs: 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:55:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:25 smithi042 ceph-mon[38309]: osdmap e452: 8 total, 8 up, 8 in 2024-09-21T17:55:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:25 smithi042 ceph-mon[38309]: pgmap v677: 196 pgs: 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:55:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:25 smithi162 ceph-mon[32106]: osdmap e452: 8 total, 8 up, 8 in 2024-09-21T17:55:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:25 smithi162 ceph-mon[32106]: pgmap v677: 196 pgs: 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:55:26.628 INFO:tasks.workunit.client.0.smithi042.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (18083 ms) 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22879 ms) 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3026 ms) 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3015 ms) 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3032 ms) 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3017 ms) 2024-09-21T17:55:26.629 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4024 ms) 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (38694 ms) 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (16204 ms) 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4030 ms) 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3002 ms) 2024-09-21T17:55:26.630 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (25087 ms) 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15058 ms) 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5045 ms) 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4024 ms) 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.631 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: waiting for scrubs... 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: done waiting 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (24792 ms) 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10064 ms) 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9065 ms) 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9047 ms) 2024-09-21T17:55:26.632 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-21T17:55:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:26 smithi042 ceph-mon[29361]: osdmap e453: 8 total, 8 up, 8 in 2024-09-21T17:55:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:26.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:26 smithi042 ceph-mon[38309]: osdmap e453: 8 total, 8 up, 8 in 2024-09-21T17:55:26.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:26.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:26.976 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:26 smithi162 ceph-mon[32106]: osdmap e453: 8 total, 8 up, 8 in 2024-09-21T17:55:26.976 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[29361]: osdmap e454: 8 total, 8 up, 8 in 2024-09-21T17:55:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[29361]: pgmap v680: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-09-21T17:55:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[29361]: osdmap e455: 8 total, 8 up, 8 in 2024-09-21T17:55:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[38309]: osdmap e454: 8 total, 8 up, 8 in 2024-09-21T17:55:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[38309]: pgmap v680: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-09-21T17:55:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[38309]: osdmap e455: 8 total, 8 up, 8 in 2024-09-21T17:55:27.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:27.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:27 smithi162 ceph-mon[32106]: osdmap e454: 8 total, 8 up, 8 in 2024-09-21T17:55:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:27 smithi162 ceph-mon[32106]: pgmap v680: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-09-21T17:55:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:27 smithi162 ceph-mon[32106]: osdmap e455: 8 total, 8 up, 8 in 2024-09-21T17:55:28.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:28.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:28 smithi042 ceph-mon[29361]: osdmap e456: 8 total, 8 up, 8 in 2024-09-21T17:55:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_tier","val": "test-rados-api-smithi042-71455-89-test-flush"} : dispatch 2024-09-21T17:55:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_tier","val": "test-rados-api-smithi042-71455-89-test-flush"} : dispatch 2024-09-21T17:55:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:28 smithi042 ceph-mon[38309]: osdmap e456: 8 total, 8 up, 8 in 2024-09-21T17:55:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_tier","val": "test-rados-api-smithi042-71455-89-test-flush"} : dispatch 2024-09-21T17:55:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_tier","val": "test-rados-api-smithi042-71455-89-test-flush"} : dispatch 2024-09-21T17:55:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:28 smithi162 ceph-mon[32106]: osdmap e456: 8 total, 8 up, 8 in 2024-09-21T17:55:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_tier","val": "test-rados-api-smithi042-71455-89-test-flush"} : dispatch 2024-09-21T17:55:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_tier","val": "test-rados-api-smithi042-71455-89-test-flush"} : dispatch 2024-09-21T17:55:29.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:55:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:55:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[29361]: pgmap v683: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-21T17:55:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_tier","val": "test-rados-api-smithi042-71455-89-test-flush"}]': finished 2024-09-21T17:55:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[29361]: osdmap e457: 8 total, 8 up, 8 in 2024-09-21T17:55:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[38309]: pgmap v683: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-21T17:55:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_tier","val": "test-rados-api-smithi042-71455-89-test-flush"}]': finished 2024-09-21T17:55:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[38309]: osdmap e457: 8 total, 8 up, 8 in 2024-09-21T17:55:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:29.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:29 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:29 smithi162 ceph-mon[32106]: pgmap v683: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-21T17:55:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_tier","val": "test-rados-api-smithi042-71455-89-test-flush"}]': finished 2024-09-21T17:55:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:29 smithi162 ceph-mon[32106]: osdmap e457: 8 total, 8 up, 8 in 2024-09-21T17:55:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:55:30.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:30 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:30.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:30 smithi042 ceph-mon[29361]: osdmap e458: 8 total, 8 up, 8 in 2024-09-21T17:55:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:30 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:30 smithi042 ceph-mon[38309]: osdmap e458: 8 total, 8 up, 8 in 2024-09-21T17:55:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:30 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:55:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:30 smithi162 ceph-mon[32106]: osdmap e458: 8 total, 8 up, 8 in 2024-09-21T17:55:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:55:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:31 smithi042 ceph-mon[29361]: pgmap v686: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-21T17:55:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:31 smithi042 ceph-mon[29361]: osdmap e459: 8 total, 8 up, 8 in 2024-09-21T17:55:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:31 smithi042 ceph-mon[38309]: pgmap v686: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-21T17:55:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:31.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:31 smithi042 ceph-mon[38309]: osdmap e459: 8 total, 8 up, 8 in 2024-09-21T17:55:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:31 smithi162 ceph-mon[32106]: pgmap v686: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-21T17:55:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:55:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:31 smithi162 ceph-mon[32106]: osdmap e459: 8 total, 8 up, 8 in 2024-09-21T17:55:33.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[29361]: osdmap e460: 8 total, 8 up, 8 in 2024-09-21T17:55:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-87"} : dispatch 2024-09-21T17:55:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-87"} : dispatch 2024-09-21T17:55:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[29361]: pgmap v689: 228 pgs: 228 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:55:33.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:55:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:55:33.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[38309]: osdmap e460: 8 total, 8 up, 8 in 2024-09-21T17:55:33.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:33.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:33.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-87"} : dispatch 2024-09-21T17:55:33.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-87"} : dispatch 2024-09-21T17:55:33.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:33 smithi042 ceph-mon[38309]: pgmap v689: 228 pgs: 228 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:55:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:33 smithi162 ceph-mon[32106]: osdmap e460: 8 total, 8 up, 8 in 2024-09-21T17:55:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-87"} : dispatch 2024-09-21T17:55:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-87"} : dispatch 2024-09-21T17:55:34.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:33 smithi162 ceph-mon[32106]: pgmap v689: 228 pgs: 228 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:55:34.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:34 smithi042 ceph-mon[29361]: osdmap e461: 8 total, 8 up, 8 in 2024-09-21T17:55:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:34 smithi042 ceph-mon[38309]: osdmap e461: 8 total, 8 up, 8 in 2024-09-21T17:55:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:34 smithi162 ceph-mon[32106]: osdmap e461: 8 total, 8 up, 8 in 2024-09-21T17:55:35.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:35 smithi042 ceph-mon[29361]: osdmap e462: 8 total, 8 up, 8 in 2024-09-21T17:55:35.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:35.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:35.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:35 smithi042 ceph-mon[29361]: pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T17:55:35.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:35 smithi042 ceph-mon[38309]: osdmap e462: 8 total, 8 up, 8 in 2024-09-21T17:55:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:35 smithi042 ceph-mon[38309]: pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T17:55:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:35 smithi162 ceph-mon[32106]: osdmap e462: 8 total, 8 up, 8 in 2024-09-21T17:55:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:35 smithi162 ceph-mon[32106]: pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T17:55:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:36.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[29361]: osdmap e463: 8 total, 8 up, 8 in 2024-09-21T17:55:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:36.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[29361]: osdmap e464: 8 total, 8 up, 8 in 2024-09-21T17:55:36.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[38309]: osdmap e463: 8 total, 8 up, 8 in 2024-09-21T17:55:36.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:36.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:36.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:36.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:36 smithi042 ceph-mon[38309]: osdmap e464: 8 total, 8 up, 8 in 2024-09-21T17:55:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:36 smithi162 ceph-mon[32106]: osdmap e463: 8 total, 8 up, 8 in 2024-09-21T17:55:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:36 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:55:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:55:37.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:36 smithi162 ceph-mon[32106]: osdmap e464: 8 total, 8 up, 8 in 2024-09-21T17:55:38.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:37 smithi162 ceph-mon[32106]: pgmap v695: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:55:38.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:37 smithi042 ceph-mon[29361]: pgmap v695: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:55:38.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:37 smithi042 ceph-mon[38309]: pgmap v695: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:55:39.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:38 smithi162 ceph-mon[32106]: osdmap e465: 8 total, 8 up, 8 in 2024-09-21T17:55:39.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:38 smithi042 ceph-mon[29361]: osdmap e465: 8 total, 8 up, 8 in 2024-09-21T17:55:39.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:38 smithi042 ceph-mon[38309]: osdmap e465: 8 total, 8 up, 8 in 2024-09-21T17:55:39.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:55:39 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:55:40.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:39 smithi162 ceph-mon[32106]: osdmap e466: 8 total, 8 up, 8 in 2024-09-21T17:55:40.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:40.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:40.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-90"} : dispatch 2024-09-21T17:55:40.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-90"} : dispatch 2024-09-21T17:55:40.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:39 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:40.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:39 smithi162 ceph-mon[32106]: pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 3.0 KiB/s wr, 185 op/s 2024-09-21T17:55:40.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[38309]: osdmap e466: 8 total, 8 up, 8 in 2024-09-21T17:55:40.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:40.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-90"} : dispatch 2024-09-21T17:55:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-90"} : dispatch 2024-09-21T17:55:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[38309]: pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 3.0 KiB/s wr, 185 op/s 2024-09-21T17:55:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[29361]: osdmap e466: 8 total, 8 up, 8 in 2024-09-21T17:55:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-90"} : dispatch 2024-09-21T17:55:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-90"} : dispatch 2024-09-21T17:55:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:39 smithi042 ceph-mon[29361]: pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 3.0 KiB/s wr, 185 op/s 2024-09-21T17:55:41.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:40 smithi162 ceph-mon[32106]: osdmap e467: 8 total, 8 up, 8 in 2024-09-21T17:55:41.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:40 smithi042 ceph-mon[29361]: osdmap e467: 8 total, 8 up, 8 in 2024-09-21T17:55:41.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:40 smithi042 ceph-mon[38309]: osdmap e467: 8 total, 8 up, 8 in 2024-09-21T17:55:42.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:41 smithi162 ceph-mon[32106]: osdmap e468: 8 total, 8 up, 8 in 2024-09-21T17:55:42.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:42.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:42.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:41 smithi162 ceph-mon[32106]: pgmap v701: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 1023 B/s wr, 180 op/s 2024-09-21T17:55:42.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:41 smithi042 ceph-mon[38309]: osdmap e468: 8 total, 8 up, 8 in 2024-09-21T17:55:42.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:42.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:42.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:41 smithi042 ceph-mon[38309]: pgmap v701: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 1023 B/s wr, 180 op/s 2024-09-21T17:55:42.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:41 smithi042 ceph-mon[29361]: osdmap e468: 8 total, 8 up, 8 in 2024-09-21T17:55:42.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:42.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:42.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:41 smithi042 ceph-mon[29361]: pgmap v701: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 1023 B/s wr, 180 op/s 2024-09-21T17:55:43.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:42 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:43.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:43.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:42 smithi162 ceph-mon[32106]: osdmap e469: 8 total, 8 up, 8 in 2024-09-21T17:55:43.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:43.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:42 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:43.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:43.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:42 smithi042 ceph-mon[29361]: osdmap e469: 8 total, 8 up, 8 in 2024-09-21T17:55:43.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:43.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:42 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:43.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:43.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:42 smithi042 ceph-mon[38309]: osdmap e469: 8 total, 8 up, 8 in 2024-09-21T17:55:43.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:43 smithi162 ceph-mon[32106]: osdmap e470: 8 total, 8 up, 8 in 2024-09-21T17:55:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:43 smithi162 ceph-mon[32106]: pgmap v704: 228 pgs: 12 unknown, 216 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:55:44.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:43 smithi042 ceph-mon[29361]: osdmap e470: 8 total, 8 up, 8 in 2024-09-21T17:55:44.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:43 smithi042 ceph-mon[29361]: pgmap v704: 228 pgs: 12 unknown, 216 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:55:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:43 smithi042 ceph-mon[38309]: osdmap e470: 8 total, 8 up, 8 in 2024-09-21T17:55:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:43 smithi042 ceph-mon[38309]: pgmap v704: 228 pgs: 12 unknown, 216 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:55:44.165 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:55:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:55:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:55:45.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:44 smithi162 ceph-mon[32106]: osdmap e471: 8 total, 8 up, 8 in 2024-09-21T17:55:45.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:45.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:45.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-92"} : dispatch 2024-09-21T17:55:45.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-92"} : dispatch 2024-09-21T17:55:45.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:44 smithi042 ceph-mon[29361]: osdmap e471: 8 total, 8 up, 8 in 2024-09-21T17:55:45.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:45.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:45.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-92"} : dispatch 2024-09-21T17:55:45.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-92"} : dispatch 2024-09-21T17:55:45.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:44 smithi042 ceph-mon[38309]: osdmap e471: 8 total, 8 up, 8 in 2024-09-21T17:55:45.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:45.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:55:45.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-92"} : dispatch 2024-09-21T17:55:45.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-92"} : dispatch 2024-09-21T17:55:46.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:45 smithi162 ceph-mon[32106]: osdmap e472: 8 total, 8 up, 8 in 2024-09-21T17:55:46.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:45 smithi162 ceph-mon[32106]: pgmap v707: 196 pgs: 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T17:55:46.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:45 smithi042 ceph-mon[29361]: osdmap e472: 8 total, 8 up, 8 in 2024-09-21T17:55:46.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:45 smithi042 ceph-mon[29361]: pgmap v707: 196 pgs: 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T17:55:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:45 smithi042 ceph-mon[38309]: osdmap e472: 8 total, 8 up, 8 in 2024-09-21T17:55:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:45 smithi042 ceph-mon[38309]: pgmap v707: 196 pgs: 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T17:55:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:46 smithi162 ceph-mon[32106]: osdmap e473: 8 total, 8 up, 8 in 2024-09-21T17:55:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:47.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:46 smithi042 ceph-mon[29361]: osdmap e473: 8 total, 8 up, 8 in 2024-09-21T17:55:47.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:47.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:47.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:46 smithi042 ceph-mon[38309]: osdmap e473: 8 total, 8 up, 8 in 2024-09-21T17:55:47.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:47.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:55:48.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:48.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:47 smithi162 ceph-mon[32106]: osdmap e474: 8 total, 8 up, 8 in 2024-09-21T17:55:48.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:48.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:47 smithi162 ceph-mon[32106]: pgmap v710: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T17:55:48.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:48.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:47 smithi042 ceph-mon[29361]: osdmap e474: 8 total, 8 up, 8 in 2024-09-21T17:55:48.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:48.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:47 smithi042 ceph-mon[29361]: pgmap v710: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T17:55:48.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:55:48.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:47 smithi042 ceph-mon[38309]: osdmap e474: 8 total, 8 up, 8 in 2024-09-21T17:55:48.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:55:48.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:47 smithi042 ceph-mon[38309]: pgmap v710: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T17:55:49.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:48 smithi162 ceph-mon[32106]: osdmap e475: 8 total, 8 up, 8 in 2024-09-21T17:55:49.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:48 smithi042 ceph-mon[29361]: osdmap e475: 8 total, 8 up, 8 in 2024-09-21T17:55:49.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:48 smithi042 ceph-mon[38309]: osdmap e475: 8 total, 8 up, 8 in 2024-09-21T17:55:49.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:55:49 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:55:50.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:49 smithi162 ceph-mon[32106]: osdmap e476: 8 total, 8 up, 8 in 2024-09-21T17:55:50.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:49 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:50.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:49 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:50.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:49 smithi162 ceph-mon[32106]: pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-21T17:55:50.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:49 smithi042 ceph-mon[29361]: osdmap e476: 8 total, 8 up, 8 in 2024-09-21T17:55:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:49 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:49 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:49 smithi042 ceph-mon[29361]: pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-21T17:55:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:49 smithi042 ceph-mon[38309]: osdmap e476: 8 total, 8 up, 8 in 2024-09-21T17:55:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:49 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:55:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:49 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:55:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:49 smithi042 ceph-mon[38309]: pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-21T17:55:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:52 smithi162 ceph-mon[32106]: pgmap v714: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-21T17:55:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:52 smithi042 ceph-mon[29361]: pgmap v714: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-21T17:55:52.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:52 smithi042 ceph-mon[38309]: pgmap v714: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-21T17:55:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:55:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:55:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:55:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:54 smithi162 ceph-mon[32106]: pgmap v715: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-21T17:55:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:54 smithi042 ceph-mon[29361]: pgmap v715: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-21T17:55:54.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:54 smithi042 ceph-mon[38309]: pgmap v715: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-21T17:55:56.717 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:56 smithi042 ceph-mon[29361]: pgmap v716: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-21T17:55:56.717 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:56 smithi042 ceph-mon[38309]: pgmap v716: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-21T17:55:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:56 smithi162 ceph-mon[32106]: pgmap v716: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-21T17:55:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:58 smithi162 ceph-mon[32106]: pgmap v717: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 957 B/s wr, 4 op/s 2024-09-21T17:55:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:55:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:58 smithi042 ceph-mon[29361]: pgmap v717: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 957 B/s wr, 4 op/s 2024-09-21T17:55:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:55:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:58 smithi042 ceph-mon[38309]: pgmap v717: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 957 B/s wr, 4 op/s 2024-09-21T17:55:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:55:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:55:59.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:55:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:56:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:00 smithi162 ceph-mon[32106]: pgmap v718: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 96 B/s wr, 2 op/s 2024-09-21T17:56:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:00 smithi162 ceph-mon[32106]: osdmap e477: 8 total, 8 up, 8 in 2024-09-21T17:56:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:00 smithi042 ceph-mon[29361]: pgmap v718: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 96 B/s wr, 2 op/s 2024-09-21T17:56:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:00 smithi042 ceph-mon[29361]: osdmap e477: 8 total, 8 up, 8 in 2024-09-21T17:56:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:00 smithi042 ceph-mon[38309]: pgmap v718: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 96 B/s wr, 2 op/s 2024-09-21T17:56:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:00 smithi042 ceph-mon[38309]: osdmap e477: 8 total, 8 up, 8 in 2024-09-21T17:56:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:02 smithi162 ceph-mon[32106]: pgmap v720: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T17:56:02.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:02 smithi042 ceph-mon[29361]: pgmap v720: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T17:56:02.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:02 smithi042 ceph-mon[38309]: pgmap v720: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T17:56:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:56:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:56:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:56:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:04 smithi162 ceph-mon[32106]: pgmap v721: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 102 B/s wr, 1 op/s 2024-09-21T17:56:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:04 smithi042 ceph-mon[29361]: pgmap v721: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 102 B/s wr, 1 op/s 2024-09-21T17:56:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:04 smithi042 ceph-mon[38309]: pgmap v721: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 102 B/s wr, 1 op/s 2024-09-21T17:56:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:06 smithi162 ceph-mon[32106]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:06 smithi042 ceph-mon[29361]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:06.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:06 smithi042 ceph-mon[38309]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:08 smithi162 ceph-mon[32106]: pgmap v723: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:08 smithi042 ceph-mon[29361]: pgmap v723: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:08 smithi042 ceph-mon[38309]: pgmap v723: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:09.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:56:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:56:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:10 smithi162 ceph-mon[32106]: osdmap e478: 8 total, 8 up, 8 in 2024-09-21T17:56:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:10 smithi162 ceph-mon[32106]: pgmap v725: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:10.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-94"} : dispatch 2024-09-21T17:56:10.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-94"} : dispatch 2024-09-21T17:56:10.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:10.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[29361]: osdmap e478: 8 total, 8 up, 8 in 2024-09-21T17:56:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[29361]: pgmap v725: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-94"} : dispatch 2024-09-21T17:56:10.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-94"} : dispatch 2024-09-21T17:56:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[38309]: osdmap e478: 8 total, 8 up, 8 in 2024-09-21T17:56:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[38309]: pgmap v725: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:10.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-94"} : dispatch 2024-09-21T17:56:10.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-94"} : dispatch 2024-09-21T17:56:11.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:11 smithi162 ceph-mon[32106]: osdmap e479: 8 total, 8 up, 8 in 2024-09-21T17:56:11.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:11 smithi042 ceph-mon[29361]: osdmap e479: 8 total, 8 up, 8 in 2024-09-21T17:56:11.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:11 smithi042 ceph-mon[38309]: osdmap e479: 8 total, 8 up, 8 in 2024-09-21T17:56:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:12 smithi162 ceph-mon[32106]: osdmap e480: 8 total, 8 up, 8 in 2024-09-21T17:56:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:12.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:12 smithi162 ceph-mon[32106]: pgmap v728: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:12.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:12 smithi042 ceph-mon[29361]: osdmap e480: 8 total, 8 up, 8 in 2024-09-21T17:56:12.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:12.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:12.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:12 smithi042 ceph-mon[29361]: pgmap v728: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:12 smithi042 ceph-mon[38309]: osdmap e480: 8 total, 8 up, 8 in 2024-09-21T17:56:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:12.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:12 smithi042 ceph-mon[38309]: pgmap v728: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:13 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:13 smithi162 ceph-mon[32106]: osdmap e481: 8 total, 8 up, 8 in 2024-09-21T17:56:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:56:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:13.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:13 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:13.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:13.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:13 smithi042 ceph-mon[29361]: osdmap e481: 8 total, 8 up, 8 in 2024-09-21T17:56:13.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:56:13.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:13 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:13 smithi042 ceph-mon[38309]: osdmap e481: 8 total, 8 up, 8 in 2024-09-21T17:56:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:56:13.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:56:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:56:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:56:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:14 smithi162 ceph-mon[32106]: osdmap e482: 8 total, 8 up, 8 in 2024-09-21T17:56:14.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:14 smithi162 ceph-mon[32106]: pgmap v731: 228 pgs: 5 unknown, 223 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:14.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:14 smithi042 ceph-mon[29361]: osdmap e482: 8 total, 8 up, 8 in 2024-09-21T17:56:14.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:14 smithi042 ceph-mon[29361]: pgmap v731: 228 pgs: 5 unknown, 223 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:14.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:14 smithi042 ceph-mon[38309]: osdmap e482: 8 total, 8 up, 8 in 2024-09-21T17:56:14.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:14 smithi042 ceph-mon[38309]: pgmap v731: 228 pgs: 5 unknown, 223 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:16 smithi162 ceph-mon[32106]: pgmap v732: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 994 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:56:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:16 smithi042 ceph-mon[29361]: pgmap v732: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 994 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:56:16.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:16 smithi042 ceph-mon[38309]: pgmap v732: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 994 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:56:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: pgmap v733: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 1000 B/s wr, 2 op/s 2024-09-21T17:56:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:56:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:56:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:56:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: pgmap v733: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 1000 B/s wr, 2 op/s 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:56:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: pgmap v733: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 1000 B/s wr, 2 op/s 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T17:56:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:18.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:18.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:56:18.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:56:18.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:19.439 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:56:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:56:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:19 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi162 to 3248M 2024-09-21T17:56:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:19 smithi162 ceph-mon[32106]: Adjusting osd_memory_target on smithi042 to 3249M 2024-09-21T17:56:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:19 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:19.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:19 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi162 to 3248M 2024-09-21T17:56:19.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:19 smithi042 ceph-mon[29361]: Adjusting osd_memory_target on smithi042 to 3249M 2024-09-21T17:56:19.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:19 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:19 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi162 to 3248M 2024-09-21T17:56:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:19 smithi042 ceph-mon[38309]: Adjusting osd_memory_target on smithi042 to 3249M 2024-09-21T17:56:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:19 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:20 smithi162 ceph-mon[32106]: pgmap v734: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:56:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:20 smithi042 ceph-mon[29361]: pgmap v734: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:56:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:20 smithi042 ceph-mon[38309]: pgmap v734: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T17:56:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:22 smithi162 ceph-mon[32106]: pgmap v735: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 672 B/s wr, 2 op/s 2024-09-21T17:56:22.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:22 smithi042 ceph-mon[29361]: pgmap v735: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 672 B/s wr, 2 op/s 2024-09-21T17:56:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:22 smithi042 ceph-mon[38309]: pgmap v735: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 672 B/s wr, 2 op/s 2024-09-21T17:56:23.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 17:56:23 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T17:56:23.266+0000 7fc3d435a640 -1 snap_mapper.add_oid found existing snaps mapped on 108:e516fc2f:test-rados-api-smithi042-71455-97::foo:21, removing 2024-09-21T17:56:23.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:23 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:23.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:23.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:23 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-96"} : dispatch 2024-09-21T17:56:23.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-96"} : dispatch 2024-09-21T17:56:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:23 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:23 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-96"} : dispatch 2024-09-21T17:56:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-96"} : dispatch 2024-09-21T17:56:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:23 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:23 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-96"} : dispatch 2024-09-21T17:56:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-96"} : dispatch 2024-09-21T17:56:23.665 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 17:56:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0[41623]: 2024-09-21T17:56:23.266+0000 7f434ccaf640 -1 snap_mapper.add_oid found existing snaps mapped on 108:e516fc2f:test-rados-api-smithi042-71455-97::foo:21, removing 2024-09-21T17:56:23.666 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 17:56:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1[46957]: 2024-09-21T17:56:23.266+0000 7fe495a8e640 -1 snap_mapper.add_oid found existing snaps mapped on 108:e516fc2f:test-rados-api-smithi042-71455-97::foo:21, removing 2024-09-21T17:56:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:56:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:56:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:56:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:24 smithi162 ceph-mon[32106]: pgmap v736: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 707 B/s wr, 3 op/s 2024-09-21T17:56:24.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:24 smithi162 ceph-mon[32106]: osdmap e483: 8 total, 8 up, 8 in 2024-09-21T17:56:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:24 smithi042 ceph-mon[29361]: pgmap v736: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 707 B/s wr, 3 op/s 2024-09-21T17:56:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:24 smithi042 ceph-mon[29361]: osdmap e483: 8 total, 8 up, 8 in 2024-09-21T17:56:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:24 smithi042 ceph-mon[38309]: pgmap v736: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 707 B/s wr, 3 op/s 2024-09-21T17:56:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:24 smithi042 ceph-mon[38309]: osdmap e483: 8 total, 8 up, 8 in 2024-09-21T17:56:25.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:25 smithi162 ceph-mon[32106]: osdmap e484: 8 total, 8 up, 8 in 2024-09-21T17:56:25.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:25.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:25.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:25 smithi042 ceph-mon[29361]: osdmap e484: 8 total, 8 up, 8 in 2024-09-21T17:56:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:25 smithi042 ceph-mon[38309]: osdmap e484: 8 total, 8 up, 8 in 2024-09-21T17:56:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:26.726 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:26 smithi162 ceph-mon[32106]: pgmap v739: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 op/s 2024-09-21T17:56:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:26 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:26 smithi162 ceph-mon[32106]: osdmap e485: 8 total, 8 up, 8 in 2024-09-21T17:56:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:26.727 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:26.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[29361]: pgmap v739: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 op/s 2024-09-21T17:56:26.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:26.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:26.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[29361]: osdmap e485: 8 total, 8 up, 8 in 2024-09-21T17:56:26.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:26.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:26.816 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[38309]: pgmap v739: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 op/s 2024-09-21T17:56:26.817 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:26.817 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:26.817 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[38309]: osdmap e485: 8 total, 8 up, 8 in 2024-09-21T17:56:26.817 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:26.817 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:56:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:27 smithi162 ceph-mon[32106]: osdmap e486: 8 total, 8 up, 8 in 2024-09-21T17:56:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-98", "mode": "writeback"} : dispatch 2024-09-21T17:56:27.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-98", "mode": "writeback"} : dispatch 2024-09-21T17:56:27.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:56:27.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:27 smithi042 ceph-mon[38309]: osdmap e486: 8 total, 8 up, 8 in 2024-09-21T17:56:27.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-98", "mode": "writeback"} : dispatch 2024-09-21T17:56:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-98", "mode": "writeback"} : dispatch 2024-09-21T17:56:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:56:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:27 smithi042 ceph-mon[29361]: osdmap e486: 8 total, 8 up, 8 in 2024-09-21T17:56:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-98", "mode": "writeback"} : dispatch 2024-09-21T17:56:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-98", "mode": "writeback"} : dispatch 2024-09-21T17:56:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:28 smithi162 ceph-mon[32106]: pgmap v742: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:28 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:56:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-98", "mode": "writeback"}]': finished 2024-09-21T17:56:28.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:28 smithi162 ceph-mon[32106]: osdmap e487: 8 total, 8 up, 8 in 2024-09-21T17:56:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:28.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[29361]: pgmap v742: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-98", "mode": "writeback"}]': finished 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[29361]: osdmap e487: 8 total, 8 up, 8 in 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[38309]: pgmap v742: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-98", "mode": "writeback"}]': finished 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[38309]: osdmap e487: 8 total, 8 up, 8 in 2024-09-21T17:56:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:28.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:28.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:29.486 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:56:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:56:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-98"}]': finished 2024-09-21T17:56:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:29 smithi162 ceph-mon[32106]: osdmap e488: 8 total, 8 up, 8 in 2024-09-21T17:56:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:56:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:56:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-98"}]': finished 2024-09-21T17:56:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:29 smithi042 ceph-mon[29361]: osdmap e488: 8 total, 8 up, 8 in 2024-09-21T17:56:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:56:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:56:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-98"}]': finished 2024-09-21T17:56:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:29 smithi042 ceph-mon[38309]: osdmap e488: 8 total, 8 up, 8 in 2024-09-21T17:56:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:56:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T17:56:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:30 smithi162 ceph-mon[32106]: pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:56:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:30 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:56:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:56:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:30 smithi162 ceph-mon[32106]: osdmap e489: 8 total, 8 up, 8 in 2024-09-21T17:56:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T17:56:30.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T17:56:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:30.937 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[29361]: pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:56:30.938 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:56:30.938 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:56:30.938 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[29361]: osdmap e489: 8 total, 8 up, 8 in 2024-09-21T17:56:30.938 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T17:56:30.938 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T17:56:30.938 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:30.938 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[38309]: pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:56:30.938 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:56:30.938 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T17:56:30.938 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[38309]: osdmap e489: 8 total, 8 up, 8 in 2024-09-21T17:56:30.938 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T17:56:30.939 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T17:56:31.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_count","val": "1"}]': finished 2024-09-21T17:56:31.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:31 smithi162 ceph-mon[32106]: osdmap e490: 8 total, 8 up, 8 in 2024-09-21T17:56:31.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:31.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:31.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:56:31.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:31 smithi162 ceph-mon[32106]: osdmap e491: 8 total, 8 up, 8 in 2024-09-21T17:56:31.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_count","val": "1"}]': finished 2024-09-21T17:56:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[29361]: osdmap e490: 8 total, 8 up, 8 in 2024-09-21T17:56:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:56:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[29361]: osdmap e491: 8 total, 8 up, 8 in 2024-09-21T17:56:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_count","val": "1"}]': finished 2024-09-21T17:56:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[38309]: osdmap e490: 8 total, 8 up, 8 in 2024-09-21T17:56:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:56:31.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:31 smithi042 ceph-mon[38309]: osdmap e491: 8 total, 8 up, 8 in 2024-09-21T17:56:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:32 smithi162 ceph-mon[32106]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:56:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T17:56:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T17:56:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "target_max_objects","val": "250"}]': finished 2024-09-21T17:56:32.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:32 smithi162 ceph-mon[32106]: osdmap e492: 8 total, 8 up, 8 in 2024-09-21T17:56:32.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:32 smithi042 ceph-mon[29361]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:56:32.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T17:56:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T17:56:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "target_max_objects","val": "250"}]': finished 2024-09-21T17:56:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:32 smithi042 ceph-mon[29361]: osdmap e492: 8 total, 8 up, 8 in 2024-09-21T17:56:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:32 smithi042 ceph-mon[38309]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:56:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T17:56:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T17:56:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-98","var": "target_max_objects","val": "250"}]': finished 2024-09-21T17:56:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:32 smithi042 ceph-mon[38309]: osdmap e492: 8 total, 8 up, 8 in 2024-09-21T17:56:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:33.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:33.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:33.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:33.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:33.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:34.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:56:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:56:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:56:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:34 smithi162 ceph-mon[32106]: pgmap v751: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:56:34.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:34 smithi162 ceph-mon[32106]: osdmap e493: 8 total, 8 up, 8 in 2024-09-21T17:56:34.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:34.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:34.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:34 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:34.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[38309]: pgmap v751: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:34.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:56:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[38309]: osdmap e493: 8 total, 8 up, 8 in 2024-09-21T17:56:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[29361]: pgmap v751: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:56:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[29361]: osdmap e493: 8 total, 8 up, 8 in 2024-09-21T17:56:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98"} : dispatch 2024-09-21T17:56:34.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:34 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:35.819 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98"}]': finished 2024-09-21T17:56:35.819 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:35 smithi162 ceph-mon[32106]: osdmap e494: 8 total, 8 up, 8 in 2024-09-21T17:56:35.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98"}]': finished 2024-09-21T17:56:35.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:35 smithi042 ceph-mon[29361]: osdmap e494: 8 total, 8 up, 8 in 2024-09-21T17:56:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-98"}]': finished 2024-09-21T17:56:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:35 smithi042 ceph-mon[38309]: osdmap e494: 8 total, 8 up, 8 in 2024-09-21T17:56:36.075 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:56:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore.transactions t=2024-09-21T17:56:35.817612779Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T17:56:36.075 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:56:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=cleanup t=2024-09-21T17:56:35.820977827Z level=info msg="Completed cleanup jobs" duration=13.919009ms 2024-09-21T17:56:36.075 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 17:56:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=plugins.update.checker t=2024-09-21T17:56:35.946270006Z level=info msg="Update check succeeded" duration=62.121094ms 2024-09-21T17:56:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:36 smithi162 ceph-mon[32106]: pgmap v754: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:36.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:36 smithi162 ceph-mon[32106]: osdmap e495: 8 total, 8 up, 8 in 2024-09-21T17:56:36.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:36 smithi042 ceph-mon[29361]: pgmap v754: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:36.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:36 smithi042 ceph-mon[29361]: osdmap e495: 8 total, 8 up, 8 in 2024-09-21T17:56:36.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:36 smithi042 ceph-mon[38309]: pgmap v754: 228 pgs: 228 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:36.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:36 smithi042 ceph-mon[38309]: osdmap e495: 8 total, 8 up, 8 in 2024-09-21T17:56:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:37 smithi162 ceph-mon[32106]: osdmap e496: 8 total, 8 up, 8 in 2024-09-21T17:56:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:37.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:37.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:37 smithi042 ceph-mon[38309]: osdmap e496: 8 total, 8 up, 8 in 2024-09-21T17:56:37.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:37.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:37.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:37 smithi042 ceph-mon[29361]: osdmap e496: 8 total, 8 up, 8 in 2024-09-21T17:56:37.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:37.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:38 smithi162 ceph-mon[32106]: pgmap v757: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:38 smithi162 ceph-mon[32106]: osdmap e497: 8 total, 8 up, 8 in 2024-09-21T17:56:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:38.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:38 smithi042 ceph-mon[29361]: pgmap v757: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:38.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:38.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:38 smithi042 ceph-mon[29361]: osdmap e497: 8 total, 8 up, 8 in 2024-09-21T17:56:38.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:38.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:38 smithi042 ceph-mon[38309]: pgmap v757: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:38 smithi042 ceph-mon[38309]: osdmap e497: 8 total, 8 up, 8 in 2024-09-21T17:56:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:56:39.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:56:39 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:56:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:56:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:39 smithi162 ceph-mon[32106]: osdmap e498: 8 total, 8 up, 8 in 2024-09-21T17:56:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:39 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-100"}]': finished 2024-09-21T17:56:39.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:56:39.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[29361]: osdmap e498: 8 total, 8 up, 8 in 2024-09-21T17:56:39.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:39.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:39.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:39.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-100"}]': finished 2024-09-21T17:56:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:56:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[38309]: osdmap e498: 8 total, 8 up, 8 in 2024-09-21T17:56:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-6", "overlaypool": "test-rados-api-smithi042-71455-100"}]': finished 2024-09-21T17:56:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:40 smithi162 ceph-mon[32106]: pgmap v760: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:40 smithi162 ceph-mon[32106]: osdmap e499: 8 total, 8 up, 8 in 2024-09-21T17:56:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-100", "mode": "writeback"} : dispatch 2024-09-21T17:56:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-100", "mode": "writeback"} : dispatch 2024-09-21T17:56:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:40 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:56:40.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-100", "mode": "writeback"}]': finished 2024-09-21T17:56:40.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[29361]: pgmap v760: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[29361]: osdmap e499: 8 total, 8 up, 8 in 2024-09-21T17:56:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-100", "mode": "writeback"} : dispatch 2024-09-21T17:56:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-100", "mode": "writeback"} : dispatch 2024-09-21T17:56:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:56:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-100", "mode": "writeback"}]': finished 2024-09-21T17:56:40.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:40.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[38309]: pgmap v760: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:40.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[38309]: osdmap e499: 8 total, 8 up, 8 in 2024-09-21T17:56:40.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-100", "mode": "writeback"} : dispatch 2024-09-21T17:56:40.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-100", "mode": "writeback"} : dispatch 2024-09-21T17:56:40.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:56:40.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-100", "mode": "writeback"}]': finished 2024-09-21T17:56:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:41 smithi162 ceph-mon[32106]: osdmap e500: 8 total, 8 up, 8 in 2024-09-21T17:56:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:56:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:56:41.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:41 smithi042 ceph-mon[29361]: osdmap e500: 8 total, 8 up, 8 in 2024-09-21T17:56:41.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:56:41.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:56:41.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:41 smithi042 ceph-mon[38309]: osdmap e500: 8 total, 8 up, 8 in 2024-09-21T17:56:41.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:56:41.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:56:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:42 smithi162 ceph-mon[32106]: pgmap v763: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:56:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:42 smithi162 ceph-mon[32106]: osdmap e501: 8 total, 8 up, 8 in 2024-09-21T17:56:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:42 smithi042 ceph-mon[29361]: pgmap v763: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:56:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:42 smithi042 ceph-mon[29361]: osdmap e501: 8 total, 8 up, 8 in 2024-09-21T17:56:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:42 smithi042 ceph-mon[38309]: pgmap v763: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:56:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:42 smithi042 ceph-mon[38309]: osdmap e501: 8 total, 8 up, 8 in 2024-09-21T17:56:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:56:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:56:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:43 smithi162 ceph-mon[32106]: osdmap e502: 8 total, 8 up, 8 in 2024-09-21T17:56:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:56:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:56:43.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:56:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:43 smithi042 ceph-mon[29361]: osdmap e502: 8 total, 8 up, 8 in 2024-09-21T17:56:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:56:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:56:43.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:43.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:56:43.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:43 smithi042 ceph-mon[38309]: osdmap e502: 8 total, 8 up, 8 in 2024-09-21T17:56:43.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:56:43.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:56:43.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:56:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:56:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:56:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:44 smithi162 ceph-mon[32106]: pgmap v766: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:44 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:56:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:56:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T17:56:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:44 smithi162 ceph-mon[32106]: osdmap e503: 8 total, 8 up, 8 in 2024-09-21T17:56:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T17:56:44.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:44 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:44.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[29361]: pgmap v766: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:56:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:56:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T17:56:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[29361]: osdmap e503: 8 total, 8 up, 8 in 2024-09-21T17:56:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T17:56:44.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[38309]: pgmap v766: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:56:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:56:44.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T17:56:44.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[38309]: osdmap e503: 8 total, 8 up, 8 in 2024-09-21T17:56:44.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T17:56:44.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:44 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:45.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-21T17:56:45.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:45 smithi042 ceph-mon[29361]: osdmap e504: 8 total, 8 up, 8 in 2024-09-21T17:56:45.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:45.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:45.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-21T17:56:45.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:45 smithi042 ceph-mon[38309]: osdmap e504: 8 total, 8 up, 8 in 2024-09-21T17:56:45.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:45.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:46.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-21T17:56:46.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:45 smithi162 ceph-mon[32106]: osdmap e504: 8 total, 8 up, 8 in 2024-09-21T17:56:46.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:46.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:46 smithi042 ceph-mon[29361]: pgmap v769: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:46.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:56:46.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:46 smithi042 ceph-mon[29361]: osdmap e505: 8 total, 8 up, 8 in 2024-09-21T17:56:46.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:46.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:46 smithi042 ceph-mon[38309]: pgmap v769: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:56:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:46 smithi042 ceph-mon[38309]: osdmap e505: 8 total, 8 up, 8 in 2024-09-21T17:56:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:46 smithi162 ceph-mon[32106]: pgmap v769: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:56:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"}]': finished 2024-09-21T17:56:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:46 smithi162 ceph-mon[32106]: osdmap e505: 8 total, 8 up, 8 in 2024-09-21T17:56:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100"} : dispatch 2024-09-21T17:56:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100"}]': finished 2024-09-21T17:56:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:47 smithi042 ceph-mon[29361]: osdmap e506: 8 total, 8 up, 8 in 2024-09-21T17:56:47.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100"}]': finished 2024-09-21T17:56:47.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:47 smithi042 ceph-mon[38309]: osdmap e506: 8 total, 8 up, 8 in 2024-09-21T17:56:48.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-100"}]': finished 2024-09-21T17:56:48.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:47 smithi162 ceph-mon[32106]: osdmap e506: 8 total, 8 up, 8 in 2024-09-21T17:56:48.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:48 smithi042 ceph-mon[29361]: pgmap v772: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:48.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:48 smithi042 ceph-mon[29361]: osdmap e507: 8 total, 8 up, 8 in 2024-09-21T17:56:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:48 smithi042 ceph-mon[38309]: pgmap v772: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:48 smithi042 ceph-mon[38309]: osdmap e507: 8 total, 8 up, 8 in 2024-09-21T17:56:49.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:48 smithi162 ceph-mon[32106]: pgmap v772: 228 pgs: 228 active+clean; 8.4 MiB data, 659 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:49.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:48 smithi162 ceph-mon[32106]: osdmap e507: 8 total, 8 up, 8 in 2024-09-21T17:56:49.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:56:49 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:56:49.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:49 smithi042 ceph-mon[29361]: osdmap e508: 8 total, 8 up, 8 in 2024-09-21T17:56:49.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:49.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:49.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:49 smithi042 ceph-mon[38309]: osdmap e508: 8 total, 8 up, 8 in 2024-09-21T17:56:49.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:49.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:50.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:49 smithi162 ceph-mon[32106]: osdmap e508: 8 total, 8 up, 8 in 2024-09-21T17:56:50.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:50.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:56:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[29361]: pgmap v775: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[29361]: osdmap e509: 8 total, 8 up, 8 in 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[38309]: pgmap v775: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[38309]: osdmap e509: 8 total, 8 up, 8 in 2024-09-21T17:56:50.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:56:50.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:56:50.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:56:51.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:56:51.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:50 smithi162 ceph-mon[32106]: pgmap v775: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:51.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:50 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:51.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:56:51.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:50 smithi162 ceph-mon[32106]: osdmap e509: 8 total, 8 up, 8 in 2024-09-21T17:56:51.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T17:56:51.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:56:51.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T17:56:51.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:56:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:51 smithi042 ceph-mon[29361]: osdmap e510: 8 total, 8 up, 8 in 2024-09-21T17:56:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:56:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:56:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:51 smithi042 ceph-mon[29361]: pgmap v778: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:51.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:56:51.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:51 smithi042 ceph-mon[38309]: osdmap e510: 8 total, 8 up, 8 in 2024-09-21T17:56:51.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:56:51.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:56:51.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:51 smithi042 ceph-mon[38309]: pgmap v778: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:52.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T17:56:52.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:51 smithi162 ceph-mon[32106]: osdmap e510: 8 total, 8 up, 8 in 2024-09-21T17:56:52.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:56:52.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T17:56:52.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:51 smithi162 ceph-mon[32106]: pgmap v778: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:56:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:56:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:56:52.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:52 smithi042 ceph-mon[29361]: osdmap e511: 8 total, 8 up, 8 in 2024-09-21T17:56:52.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:56:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:56:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:56:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:52 smithi042 ceph-mon[38309]: osdmap e511: 8 total, 8 up, 8 in 2024-09-21T17:56:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:56:53.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T17:56:53.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:56:53.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:52 smithi162 ceph-mon[32106]: osdmap e511: 8 total, 8 up, 8 in 2024-09-21T17:56:53.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T17:56:53.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:56:53.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[29361]: osdmap e512: 8 total, 8 up, 8 in 2024-09-21T17:56:53.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:53.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:53.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-102"} : dispatch 2024-09-21T17:56:53.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-102"} : dispatch 2024-09-21T17:56:53.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[29361]: pgmap v781: 228 pgs: 3 unknown, 225 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:56:53.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:56:53.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[38309]: osdmap e512: 8 total, 8 up, 8 in 2024-09-21T17:56:53.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:53.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:53.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-102"} : dispatch 2024-09-21T17:56:53.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-102"} : dispatch 2024-09-21T17:56:53.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-mon[38309]: pgmap v781: 228 pgs: 3 unknown, 225 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:56:53.916 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:56:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:56:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:56:54.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T17:56:54.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:53 smithi162 ceph-mon[32106]: osdmap e512: 8 total, 8 up, 8 in 2024-09-21T17:56:54.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:53 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:54.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-6"} : dispatch 2024-09-21T17:56:54.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:53 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2196583422' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-102"} : dispatch 2024-09-21T17:56:54.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-6", "tierpool": "test-rados-api-smithi042-71455-102"} : dispatch 2024-09-21T17:56:54.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:53 smithi162 ceph-mon[32106]: pgmap v781: 228 pgs: 3 unknown, 225 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T17:56:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:54 smithi042 ceph-mon[29361]: osdmap e513: 8 total, 8 up, 8 in 2024-09-21T17:56:54.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:54 smithi042 ceph-mon[38309]: osdmap e513: 8 total, 8 up, 8 in 2024-09-21T17:56:55.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:54 smithi162 ceph-mon[32106]: osdmap e513: 8 total, 8 up, 8 in 2024-09-21T17:56:55.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:55 smithi042 ceph-mon[29361]: osdmap e514: 8 total, 8 up, 8 in 2024-09-21T17:56:55.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:56:55.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:56:55.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:56:55.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:55 smithi042 ceph-mon[29361]: pgmap v784: 164 pgs: 164 active+clean; 583 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:55 smithi042 ceph-mon[38309]: osdmap e514: 8 total, 8 up, 8 in 2024-09-21T17:56:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:56:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:56:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:56:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:55 smithi042 ceph-mon[38309]: pgmap v784: 164 pgs: 164 active+clean; 583 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:56.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:55 smithi162 ceph-mon[32106]: osdmap e514: 8 total, 8 up, 8 in 2024-09-21T17:56:56.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:56:56.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:56:56.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:56:56.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:55 smithi162 ceph-mon[32106]: pgmap v784: 164 pgs: 164 active+clean; 583 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:56.976 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:56:56.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:56 smithi162 ceph-mon[32106]: osdmap e515: 8 total, 8 up, 8 in 2024-09-21T17:56:56.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi042-71455-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:56:57.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:56:57.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:56 smithi042 ceph-mon[29361]: osdmap e515: 8 total, 8 up, 8 in 2024-09-21T17:56:57.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi042-71455-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:56:57.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:56:57.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:56 smithi042 ceph-mon[38309]: osdmap e515: 8 total, 8 up, 8 in 2024-09-21T17:56:57.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi042-71455-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:56:58.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:57 smithi162 ceph-mon[32106]: osdmap e516: 8 total, 8 up, 8 in 2024-09-21T17:56:58.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:57 smithi162 ceph-mon[32106]: pgmap v787: 164 pgs: 164 active+clean; 583 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:58.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi042-71455-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi042-71455-104"}]': finished 2024-09-21T17:56:58.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:57 smithi162 ceph-mon[32106]: osdmap e517: 8 total, 8 up, 8 in 2024-09-21T17:56:58.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:57 smithi042 ceph-mon[29361]: osdmap e516: 8 total, 8 up, 8 in 2024-09-21T17:56:58.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:57 smithi042 ceph-mon[29361]: pgmap v787: 164 pgs: 164 active+clean; 583 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:58.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi042-71455-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi042-71455-104"}]': finished 2024-09-21T17:56:58.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:57 smithi042 ceph-mon[29361]: osdmap e517: 8 total, 8 up, 8 in 2024-09-21T17:56:58.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:57 smithi042 ceph-mon[38309]: osdmap e516: 8 total, 8 up, 8 in 2024-09-21T17:56:58.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:57 smithi042 ceph-mon[38309]: pgmap v787: 164 pgs: 164 active+clean; 583 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:56:58.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi042-71455-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi042-71455-104"}]': finished 2024-09-21T17:56:58.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:57 smithi042 ceph-mon[38309]: osdmap e517: 8 total, 8 up, 8 in 2024-09-21T17:56:59.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:56:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:56:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:59 smithi162 ceph-mon[32106]: osdmap e518: 8 total, 8 up, 8 in 2024-09-21T17:56:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:56:59 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:59.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:59.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:59.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:59 smithi042 ceph-mon[29361]: osdmap e518: 8 total, 8 up, 8 in 2024-09-21T17:56:59.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:56:59 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:56:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:56:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:56:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:59 smithi042 ceph-mon[38309]: osdmap e518: 8 total, 8 up, 8 in 2024-09-21T17:56:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:56:59 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:00 smithi162 ceph-mon[32106]: pgmap v790: 172 pgs: 8 creating+peering, 164 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:00 smithi162 ceph-mon[32106]: osdmap e519: 8 total, 8 up, 8 in 2024-09-21T17:57:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:00.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:00.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:00 smithi042 ceph-mon[29361]: pgmap v790: 172 pgs: 8 creating+peering, 164 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:00 smithi042 ceph-mon[29361]: osdmap e519: 8 total, 8 up, 8 in 2024-09-21T17:57:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:00 smithi042 ceph-mon[38309]: pgmap v790: 172 pgs: 8 creating+peering, 164 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:00 smithi042 ceph-mon[38309]: osdmap e519: 8 total, 8 up, 8 in 2024-09-21T17:57:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:02.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:02.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:01 smithi162 ceph-mon[32106]: osdmap e520: 8 total, 8 up, 8 in 2024-09-21T17:57:02.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:01 smithi162 ceph-mon[32106]: pgmap v793: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:02.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:02.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:01 smithi042 ceph-mon[29361]: osdmap e520: 8 total, 8 up, 8 in 2024-09-21T17:57:02.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:01 smithi042 ceph-mon[29361]: pgmap v793: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:02.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:02.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:01 smithi042 ceph-mon[38309]: osdmap e520: 8 total, 8 up, 8 in 2024-09-21T17:57:02.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:01 smithi042 ceph-mon[38309]: pgmap v793: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:03.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:02 smithi162 ceph-mon[32106]: osdmap e521: 8 total, 8 up, 8 in 2024-09-21T17:57:03.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:03.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:03.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:02 smithi042 ceph-mon[29361]: osdmap e521: 8 total, 8 up, 8 in 2024-09-21T17:57:03.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:03.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:03.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:02 smithi042 ceph-mon[38309]: osdmap e521: 8 total, 8 up, 8 in 2024-09-21T17:57:03.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:03.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:04.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:04.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:03 smithi162 ceph-mon[32106]: osdmap e522: 8 total, 8 up, 8 in 2024-09-21T17:57:04.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:04.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:04.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:03 smithi162 ceph-mon[32106]: pgmap v796: 236 pgs: 5 unknown, 231 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:57:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:57:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:57:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:57:04.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:04.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:03 smithi042 ceph-mon[29361]: osdmap e522: 8 total, 8 up, 8 in 2024-09-21T17:57:04.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:04.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:04.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:03 smithi042 ceph-mon[29361]: pgmap v796: 236 pgs: 5 unknown, 231 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:57:04.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:04.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:03 smithi042 ceph-mon[38309]: osdmap e522: 8 total, 8 up, 8 in 2024-09-21T17:57:04.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:04.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:04.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:03 smithi042 ceph-mon[38309]: pgmap v796: 236 pgs: 5 unknown, 231 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:57:05.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"}]': finished 2024-09-21T17:57:05.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:04 smithi162 ceph-mon[32106]: osdmap e523: 8 total, 8 up, 8 in 2024-09-21T17:57:05.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-107", "overlaypool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:05.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-107", "overlaypool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:05.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:04 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:05.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"}]': finished 2024-09-21T17:57:05.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:04 smithi042 ceph-mon[29361]: osdmap e523: 8 total, 8 up, 8 in 2024-09-21T17:57:05.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-107", "overlaypool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:05.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-107", "overlaypool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:05.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:04 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:05.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"}]': finished 2024-09-21T17:57:05.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:04 smithi042 ceph-mon[38309]: osdmap e523: 8 total, 8 up, 8 in 2024-09-21T17:57:05.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-107", "overlaypool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:05.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-107", "overlaypool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:05.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:04 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-107", "overlaypool": "test-rados-api-smithi042-71455-107-cache"}]': finished 2024-09-21T17:57:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:05 smithi162 ceph-mon[32106]: osdmap e524: 8 total, 8 up, 8 in 2024-09-21T17:57:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:05 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-107-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-107-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:05 smithi162 ceph-mon[32106]: pgmap v799: 236 pgs: 236 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:57:06.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:05 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:06.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:05 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-107-cache", "mode": "writeback"}]': finished 2024-09-21T17:57:06.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-107", "overlaypool": "test-rados-api-smithi042-71455-107-cache"}]': finished 2024-09-21T17:57:06.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[29361]: osdmap e524: 8 total, 8 up, 8 in 2024-09-21T17:57:06.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-107-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:06.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-107-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:06.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[29361]: pgmap v799: 236 pgs: 236 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:57:06.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:06.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-107-cache", "mode": "writeback"}]': finished 2024-09-21T17:57:06.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-107", "overlaypool": "test-rados-api-smithi042-71455-107-cache"}]': finished 2024-09-21T17:57:06.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[38309]: osdmap e524: 8 total, 8 up, 8 in 2024-09-21T17:57:06.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-107-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:06.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-107-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:06.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[38309]: pgmap v799: 236 pgs: 236 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:57:06.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:06.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:05 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-107-cache", "mode": "writeback"}]': finished 2024-09-21T17:57:07.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:06 smithi162 ceph-mon[32106]: osdmap e525: 8 total, 8 up, 8 in 2024-09-21T17:57:07.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-107"} : dispatch 2024-09-21T17:57:07.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:06 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-107"} : dispatch 2024-09-21T17:57:07.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:06 smithi042 ceph-mon[29361]: osdmap e525: 8 total, 8 up, 8 in 2024-09-21T17:57:07.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-107"} : dispatch 2024-09-21T17:57:07.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:06 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-107"} : dispatch 2024-09-21T17:57:07.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:06 smithi042 ceph-mon[38309]: osdmap e525: 8 total, 8 up, 8 in 2024-09-21T17:57:07.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-107"} : dispatch 2024-09-21T17:57:07.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:06 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-107"} : dispatch 2024-09-21T17:57:08.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-107"}]': finished 2024-09-21T17:57:08.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:07 smithi162 ceph-mon[32106]: osdmap e526: 8 total, 8 up, 8 in 2024-09-21T17:57:08.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:08.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:08.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:07 smithi162 ceph-mon[32106]: pgmap v802: 236 pgs: 236 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:08.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-107"}]': finished 2024-09-21T17:57:08.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:07 smithi042 ceph-mon[38309]: osdmap e526: 8 total, 8 up, 8 in 2024-09-21T17:57:08.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:08.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:08.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:07 smithi042 ceph-mon[38309]: pgmap v802: 236 pgs: 236 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:08.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-107"}]': finished 2024-09-21T17:57:08.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:07 smithi042 ceph-mon[29361]: osdmap e526: 8 total, 8 up, 8 in 2024-09-21T17:57:08.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/782036114' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:08.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"} : dispatch 2024-09-21T17:57:08.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:07 smithi042 ceph-mon[29361]: pgmap v802: 236 pgs: 236 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:09.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:08 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:57:09.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"}]': finished 2024-09-21T17:57:09.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:08 smithi162 ceph-mon[32106]: osdmap e527: 8 total, 8 up, 8 in 2024-09-21T17:57:09.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:08 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:57:09.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"}]': finished 2024-09-21T17:57:09.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:08 smithi042 ceph-mon[29361]: osdmap e527: 8 total, 8 up, 8 in 2024-09-21T17:57:09.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:08 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:57:09.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-107", "tierpool": "test-rados-api-smithi042-71455-107-cache"}]': finished 2024-09-21T17:57:09.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:08 smithi042 ceph-mon[38309]: osdmap e527: 8 total, 8 up, 8 in 2024-09-21T17:57:09.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:57:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:57:10.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:09 smithi162 ceph-mon[32106]: osdmap e528: 8 total, 8 up, 8 in 2024-09-21T17:57:10.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:09 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:10.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:09 smithi162 ceph-mon[32106]: pgmap v805: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:10.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:09 smithi042 ceph-mon[29361]: osdmap e528: 8 total, 8 up, 8 in 2024-09-21T17:57:10.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:09 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:10.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:09 smithi042 ceph-mon[29361]: pgmap v805: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:10.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:09 smithi042 ceph-mon[38309]: osdmap e528: 8 total, 8 up, 8 in 2024-09-21T17:57:10.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:09 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:10.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:09 smithi042 ceph-mon[38309]: pgmap v805: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:11.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:10 smithi162 ceph-mon[32106]: osdmap e529: 8 total, 8 up, 8 in 2024-09-21T17:57:11.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:11.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:11.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[29361]: osdmap e529: 8 total, 8 up, 8 in 2024-09-21T17:57:11.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:11.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:11.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[38309]: osdmap e529: 8 total, 8 up, 8 in 2024-09-21T17:57:11.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:11.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:11.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:12.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:57:12.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:11 smithi162 ceph-mon[32106]: osdmap e530: 8 total, 8 up, 8 in 2024-09-21T17:57:12.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:12.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:12.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:11 smithi162 ceph-mon[32106]: pgmap v808: 172 pgs: 172 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:12.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:57:12.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:11 smithi042 ceph-mon[29361]: osdmap e530: 8 total, 8 up, 8 in 2024-09-21T17:57:12.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:12.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:12.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:11 smithi042 ceph-mon[29361]: pgmap v808: 172 pgs: 172 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:12.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:57:12.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:11 smithi042 ceph-mon[38309]: osdmap e530: 8 total, 8 up, 8 in 2024-09-21T17:57:12.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:12.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:12.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:11 smithi042 ceph-mon[38309]: pgmap v808: 172 pgs: 172 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:13.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:12 smithi162 ceph-mon[32106]: osdmap e531: 8 total, 8 up, 8 in 2024-09-21T17:57:13.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:12 smithi042 ceph-mon[29361]: osdmap e531: 8 total, 8 up, 8 in 2024-09-21T17:57:13.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:12 smithi042 ceph-mon[38309]: osdmap e531: 8 total, 8 up, 8 in 2024-09-21T17:57:14.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:14.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:13 smithi162 ceph-mon[32106]: osdmap e532: 8 total, 8 up, 8 in 2024-09-21T17:57:14.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:14.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:13 smithi162 ceph-mon[32106]: pgmap v811: 180 pgs: 5 creating+peering, 3 unknown, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:14.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:13 smithi162 ceph-mon[32106]: osdmap e533: 8 total, 8 up, 8 in 2024-09-21T17:57:14.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:14.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:13 smithi042 ceph-mon[29361]: osdmap e532: 8 total, 8 up, 8 in 2024-09-21T17:57:14.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:14.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:13 smithi042 ceph-mon[29361]: pgmap v811: 180 pgs: 5 creating+peering, 3 unknown, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:14.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:13 smithi042 ceph-mon[29361]: osdmap e533: 8 total, 8 up, 8 in 2024-09-21T17:57:14.165 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:57:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:57:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:57:14.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:14.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:13 smithi042 ceph-mon[38309]: osdmap e532: 8 total, 8 up, 8 in 2024-09-21T17:57:14.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:14.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:13 smithi042 ceph-mon[38309]: pgmap v811: 180 pgs: 5 creating+peering, 3 unknown, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:14.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:13 smithi042 ceph-mon[38309]: osdmap e533: 8 total, 8 up, 8 in 2024-09-21T17:57:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:14 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-109-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-109-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:14 smithi162 ceph-mon[32106]: osdmap e534: 8 total, 8 up, 8 in 2024-09-21T17:57:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:15.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:15.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-109-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-109-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[29361]: osdmap e534: 8 total, 8 up, 8 in 2024-09-21T17:57:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:15.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:15.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:15.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-109-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:15.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-109-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:15.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:15.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[38309]: osdmap e534: 8 total, 8 up, 8 in 2024-09-21T17:57:15.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:15.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:16.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:15 smithi162 ceph-mon[32106]: pgmap v814: 212 pgs: 32 unknown, 8 creating+peering, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:16.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"}]': finished 2024-09-21T17:57:16.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:15 smithi162 ceph-mon[32106]: osdmap e535: 8 total, 8 up, 8 in 2024-09-21T17:57:16.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-109", "overlaypool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:16.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-109", "overlaypool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:16.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:15 smithi042 ceph-mon[29361]: pgmap v814: 212 pgs: 32 unknown, 8 creating+peering, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:16.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"}]': finished 2024-09-21T17:57:16.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:15 smithi042 ceph-mon[29361]: osdmap e535: 8 total, 8 up, 8 in 2024-09-21T17:57:16.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-109", "overlaypool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:16.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-109", "overlaypool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:16.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:15 smithi042 ceph-mon[38309]: pgmap v814: 212 pgs: 32 unknown, 8 creating+peering, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:16.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"}]': finished 2024-09-21T17:57:16.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:15 smithi042 ceph-mon[38309]: osdmap e535: 8 total, 8 up, 8 in 2024-09-21T17:57:16.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-109", "overlaypool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:16.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-109", "overlaypool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:18.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-109", "overlaypool": "test-rados-api-smithi042-71455-109-cache"}]': finished 2024-09-21T17:57:18.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:17 smithi162 ceph-mon[32106]: osdmap e536: 8 total, 8 up, 8 in 2024-09-21T17:57:18.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-109-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:18.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-109-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:18.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:17 smithi162 ceph-mon[32106]: pgmap v817: 212 pgs: 32 unknown, 8 creating+peering, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:18.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-109", "overlaypool": "test-rados-api-smithi042-71455-109-cache"}]': finished 2024-09-21T17:57:18.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:17 smithi042 ceph-mon[29361]: osdmap e536: 8 total, 8 up, 8 in 2024-09-21T17:57:18.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-109-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:18.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-109-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:18.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:17 smithi042 ceph-mon[29361]: pgmap v817: 212 pgs: 32 unknown, 8 creating+peering, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:18.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-109", "overlaypool": "test-rados-api-smithi042-71455-109-cache"}]': finished 2024-09-21T17:57:18.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:17 smithi042 ceph-mon[38309]: osdmap e536: 8 total, 8 up, 8 in 2024-09-21T17:57:18.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-109-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:18.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-109-cache", "mode": "writeback"} : dispatch 2024-09-21T17:57:18.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:17 smithi042 ceph-mon[38309]: pgmap v817: 212 pgs: 32 unknown, 8 creating+peering, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:18 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-109-cache", "mode": "writeback"}]': finished 2024-09-21T17:57:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:18 smithi162 ceph-mon[32106]: osdmap e537: 8 total, 8 up, 8 in 2024-09-21T17:57:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:57:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:57:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:18 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:57:19.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:19.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-109-cache", "mode": "writeback"}]': finished 2024-09-21T17:57:19.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[29361]: osdmap e537: 8 total, 8 up, 8 in 2024-09-21T17:57:19.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:57:19.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:57:19.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:57:19.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:19.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-109-cache", "mode": "writeback"}]': finished 2024-09-21T17:57:19.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[38309]: osdmap e537: 8 total, 8 up, 8 in 2024-09-21T17:57:19.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:57:19.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:57:19.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:18 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:57:19.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:57:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:57:20.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:57:20.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:19 smithi162 ceph-mon[32106]: osdmap e538: 8 total, 8 up, 8 in 2024-09-21T17:57:20.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:57:20.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:57:20.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:19 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:57:20.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:19 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:57:20.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:19 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:57:20.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:19 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:20.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:19 smithi162 ceph-mon[32106]: pgmap v820: 212 pgs: 212 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:20.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:57:20.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:57:20.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[29361]: osdmap e538: 8 total, 8 up, 8 in 2024-09-21T17:57:20.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:57:20.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:57:20.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:57:20.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:57:20.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:57:20.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:20.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[29361]: pgmap v820: 212 pgs: 212 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:20.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:57:20.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:57:20.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[38309]: osdmap e538: 8 total, 8 up, 8 in 2024-09-21T17:57:20.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:57:20.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:57:20.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:57:20.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:57:20.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:57:20.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:20.167 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[38309]: pgmap v820: 212 pgs: 212 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:20.167 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:57:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:20 smithi162 ceph-mon[32106]: osdmap e539: 8 total, 8 up, 8 in 2024-09-21T17:57:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:57:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:57:21.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:20 smithi042 ceph-mon[29361]: osdmap e539: 8 total, 8 up, 8 in 2024-09-21T17:57:21.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:57:21.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:57:21.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:20 smithi042 ceph-mon[38309]: osdmap e539: 8 total, 8 up, 8 in 2024-09-21T17:57:21.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:57:21.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:57:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:21 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:57:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:57:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:21 smithi162 ceph-mon[32106]: osdmap e540: 8 total, 8 up, 8 in 2024-09-21T17:57:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "min_read_recency_for_promote","val": "4"} : dispatch 2024-09-21T17:57:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "min_read_recency_for_promote","val": "4"} : dispatch 2024-09-21T17:57:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:21 smithi162 ceph-mon[32106]: pgmap v823: 212 pgs: 212 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:22.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:57:22.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:57:22.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[29361]: osdmap e540: 8 total, 8 up, 8 in 2024-09-21T17:57:22.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "min_read_recency_for_promote","val": "4"} : dispatch 2024-09-21T17:57:22.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "min_read_recency_for_promote","val": "4"} : dispatch 2024-09-21T17:57:22.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[29361]: pgmap v823: 212 pgs: 212 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:22.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:57:22.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:57:22.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[38309]: osdmap e540: 8 total, 8 up, 8 in 2024-09-21T17:57:22.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "min_read_recency_for_promote","val": "4"} : dispatch 2024-09-21T17:57:22.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "min_read_recency_for_promote","val": "4"} : dispatch 2024-09-21T17:57:22.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:21 smithi042 ceph-mon[38309]: pgmap v823: 212 pgs: 212 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-21T17:57:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:22 smithi162 ceph-mon[32106]: osdmap e541: 8 total, 8 up, 8 in 2024-09-21T17:57:23.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:23.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:23.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-21T17:57:23.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:22 smithi042 ceph-mon[29361]: osdmap e541: 8 total, 8 up, 8 in 2024-09-21T17:57:23.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:23.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:23.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-21T17:57:23.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:22 smithi042 ceph-mon[38309]: osdmap e541: 8 total, 8 up, 8 in 2024-09-21T17:57:23.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:23.167 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:23 smithi162 ceph-mon[32106]: osdmap e542: 8 total, 8 up, 8 in 2024-09-21T17:57:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:23 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:23 smithi162 ceph-mon[32106]: pgmap v826: 212 pgs: 212 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:57:24.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:24.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:23 smithi042 ceph-mon[29361]: osdmap e542: 8 total, 8 up, 8 in 2024-09-21T17:57:24.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:23 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:24.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:24.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:23 smithi042 ceph-mon[29361]: pgmap v826: 212 pgs: 212 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:57:24.165 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:57:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:57:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:57:24.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:24.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:23 smithi042 ceph-mon[38309]: osdmap e542: 8 total, 8 up, 8 in 2024-09-21T17:57:24.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:23 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:24.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"} : dispatch 2024-09-21T17:57:24.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:23 smithi042 ceph-mon[38309]: pgmap v826: 212 pgs: 212 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T17:57:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"}]': finished 2024-09-21T17:57:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:24 smithi162 ceph-mon[32106]: osdmap e543: 8 total, 8 up, 8 in 2024-09-21T17:57:25.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"}]': finished 2024-09-21T17:57:25.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:24 smithi042 ceph-mon[29361]: osdmap e543: 8 total, 8 up, 8 in 2024-09-21T17:57:25.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-109", "tierpool": "test-rados-api-smithi042-71455-109-cache"}]': finished 2024-09-21T17:57:25.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:24 smithi042 ceph-mon[38309]: osdmap e543: 8 total, 8 up, 8 in 2024-09-21T17:57:26.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:25 smithi042 ceph-mon[29361]: osdmap e544: 8 total, 8 up, 8 in 2024-09-21T17:57:26.066 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:25 smithi042 ceph-mon[29361]: pgmap v829: 180 pgs: 180 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:26.066 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:25 smithi042 ceph-mon[38309]: osdmap e544: 8 total, 8 up, 8 in 2024-09-21T17:57:26.066 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:25 smithi042 ceph-mon[38309]: pgmap v829: 180 pgs: 180 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:25 smithi162 ceph-mon[32106]: osdmap e544: 8 total, 8 up, 8 in 2024-09-21T17:57:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:25 smithi162 ceph-mon[32106]: pgmap v829: 180 pgs: 180 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:27.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:26 smithi162 ceph-mon[32106]: osdmap e545: 8 total, 8 up, 8 in 2024-09-21T17:57:27.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:27.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:27.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:26 smithi042 ceph-mon[29361]: osdmap e545: 8 total, 8 up, 8 in 2024-09-21T17:57:27.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:27.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:27.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:26 smithi042 ceph-mon[38309]: osdmap e545: 8 total, 8 up, 8 in 2024-09-21T17:57:27.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:27.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:28.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:28.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:27 smithi042 ceph-mon[29361]: osdmap e546: 8 total, 8 up, 8 in 2024-09-21T17:57:28.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:28.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:28.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:27 smithi042 ceph-mon[29361]: pgmap v832: 172 pgs: 172 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:28.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:28.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:27 smithi042 ceph-mon[38309]: osdmap e546: 8 total, 8 up, 8 in 2024-09-21T17:57:28.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:28.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:28.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:27 smithi042 ceph-mon[38309]: pgmap v832: 172 pgs: 172 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:28.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:28.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:27 smithi162 ceph-mon[32106]: osdmap e546: 8 total, 8 up, 8 in 2024-09-21T17:57:28.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1904531507' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:28.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"} : dispatch 2024-09-21T17:57:28.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:27 smithi162 ceph-mon[32106]: pgmap v832: 172 pgs: 172 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:28.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:28 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:28.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:29.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:28 smithi042 ceph-mon[29361]: osdmap e547: 8 total, 8 up, 8 in 2024-09-21T17:57:29.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:29.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:28 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:29.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:29.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:28 smithi042 ceph-mon[38309]: osdmap e547: 8 total, 8 up, 8 in 2024-09-21T17:57:29.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:29.202 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:28 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:29.202 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-109"}]': finished 2024-09-21T17:57:29.202 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:28 smithi162 ceph-mon[32106]: osdmap e547: 8 total, 8 up, 8 in 2024-09-21T17:57:29.203 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:29.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:57:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:57:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[29361]: osdmap e548: 8 total, 8 up, 8 in 2024-09-21T17:57:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:57:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[29361]: pgmap v835: 164 pgs: 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T17:57:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104"}]': finished 2024-09-21T17:57:30.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[29361]: osdmap e549: 8 total, 8 up, 8 in 2024-09-21T17:57:30.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:57:30.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[38309]: osdmap e548: 8 total, 8 up, 8 in 2024-09-21T17:57:30.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:57:30.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:30.167 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[38309]: pgmap v835: 164 pgs: 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T17:57:30.167 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104"}]': finished 2024-09-21T17:57:30.167 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[38309]: osdmap e549: 8 total, 8 up, 8 in 2024-09-21T17:57:30.167 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:57:30.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:29 smithi162 ceph-mon[32106]: osdmap e548: 8 total, 8 up, 8 in 2024-09-21T17:57:30.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:57:30.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:29 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:30.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:29 smithi162 ceph-mon[32106]: pgmap v835: 164 pgs: 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T17:57:30.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi042-71455-104"}]': finished 2024-09-21T17:57:30.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:29 smithi162 ceph-mon[32106]: osdmap e549: 8 total, 8 up, 8 in 2024-09-21T17:57:30.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi042-71455-104"} : dispatch 2024-09-21T17:57:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi042-71455-104"}]': finished 2024-09-21T17:57:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[29361]: osdmap e550: 8 total, 8 up, 8 in 2024-09-21T17:57:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[29361]: pgmap v838: 164 pgs: 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T17:57:32.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi042-71455-104"}]': finished 2024-09-21T17:57:32.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[38309]: osdmap e550: 8 total, 8 up, 8 in 2024-09-21T17:57:32.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:32.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:32.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:31 smithi042 ceph-mon[38309]: pgmap v838: 164 pgs: 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T17:57:32.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3688225226' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi042-71455-104"}]': finished 2024-09-21T17:57:32.406 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:31 smithi162 ceph-mon[32106]: osdmap e550: 8 total, 8 up, 8 in 2024-09-21T17:57:32.407 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.407 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.407 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.407 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:32.407 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:32.407 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T17:57:32.407 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:31 smithi162 ceph-mon[32106]: pgmap v838: 164 pgs: 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T17:57:33.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:57:33.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:32 smithi042 ceph-mon[29361]: osdmap e551: 8 total, 8 up, 8 in 2024-09-21T17:57:33.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:33.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:33.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:57:33.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:32 smithi042 ceph-mon[38309]: osdmap e551: 8 total, 8 up, 8 in 2024-09-21T17:57:33.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:33.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:33.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi042-71455-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T17:57:33.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:32 smithi162 ceph-mon[32106]: osdmap e551: 8 total, 8 up, 8 in 2024-09-21T17:57:33.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:33.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:34.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:33 smithi042 ceph-mon[29361]: osdmap e552: 8 total, 8 up, 8 in 2024-09-21T17:57:34.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:33 smithi042 ceph-mon[29361]: pgmap v841: 164 pgs: 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:34.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:57:34.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:33 smithi042 ceph-mon[29361]: osdmap e553: 8 total, 8 up, 8 in 2024-09-21T17:57:34.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:33 smithi042 ceph-mon[38309]: osdmap e552: 8 total, 8 up, 8 in 2024-09-21T17:57:34.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:33 smithi042 ceph-mon[38309]: pgmap v841: 164 pgs: 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:34.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:57:34.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:33 smithi042 ceph-mon[38309]: osdmap e553: 8 total, 8 up, 8 in 2024-09-21T17:57:34.165 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:57:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:57:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:57:34.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:33 smithi162 ceph-mon[32106]: osdmap e552: 8 total, 8 up, 8 in 2024-09-21T17:57:34.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:33 smithi162 ceph-mon[32106]: pgmap v841: 164 pgs: 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:34.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi042-71455-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:57:34.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:33 smithi162 ceph-mon[32106]: osdmap e553: 8 total, 8 up, 8 in 2024-09-21T17:57:35.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:34 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:35.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:34 smithi042 ceph-mon[29361]: osdmap e554: 8 total, 8 up, 8 in 2024-09-21T17:57:35.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-112","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:35.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-112","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:35.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:34 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:35.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:34 smithi042 ceph-mon[38309]: osdmap e554: 8 total, 8 up, 8 in 2024-09-21T17:57:35.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-112","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:35.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-112","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:35.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:34 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:35.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:34 smithi162 ceph-mon[32106]: osdmap e554: 8 total, 8 up, 8 in 2024-09-21T17:57:35.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-112","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:35.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-112","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:36.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:35 smithi042 ceph-mon[29361]: pgmap v844: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:36.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:36.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:35 smithi042 ceph-mon[29361]: osdmap e555: 8 total, 8 up, 8 in 2024-09-21T17:57:36.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:35 smithi042 ceph-mon[38309]: pgmap v844: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:36.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:36.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:35 smithi042 ceph-mon[38309]: osdmap e555: 8 total, 8 up, 8 in 2024-09-21T17:57:36.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:35 smithi162 ceph-mon[32106]: pgmap v844: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:36.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:36.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:35 smithi162 ceph-mon[32106]: osdmap e555: 8 total, 8 up, 8 in 2024-09-21T17:57:37.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:37.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:37.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:57:37.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[29361]: osdmap e556: 8 total, 8 up, 8 in 2024-09-21T17:57:37.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:37.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:37.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:37.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:37.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:57:37.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[38309]: osdmap e556: 8 total, 8 up, 8 in 2024-09-21T17:57:37.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:37.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:37.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:37.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:37.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:57:37.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:36 smithi162 ceph-mon[32106]: osdmap e556: 8 total, 8 up, 8 in 2024-09-21T17:57:37.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:37.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:38.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:37 smithi042 ceph-mon[29361]: pgmap v847: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:38.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-112"}]': finished 2024-09-21T17:57:38.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:37 smithi042 ceph-mon[29361]: osdmap e557: 8 total, 8 up, 8 in 2024-09-21T17:57:38.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:37 smithi042 ceph-mon[38309]: pgmap v847: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:38.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-112"}]': finished 2024-09-21T17:57:38.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:37 smithi042 ceph-mon[38309]: osdmap e557: 8 total, 8 up, 8 in 2024-09-21T17:57:38.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:37 smithi162 ceph-mon[32106]: pgmap v847: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:57:38.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-112"}]': finished 2024-09-21T17:57:38.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:37 smithi162 ceph-mon[32106]: osdmap e557: 8 total, 8 up, 8 in 2024-09-21T17:57:39.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:39.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:39.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:39.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:39.213 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:39.213 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:39.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:57:39 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:57:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:57:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[29361]: osdmap e558: 8 total, 8 up, 8 in 2024-09-21T17:57:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:40.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[29361]: pgmap v850: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:57:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:57:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[38309]: osdmap e558: 8 total, 8 up, 8 in 2024-09-21T17:57:40.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:40.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:40.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:40.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:40.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:39 smithi042 ceph-mon[38309]: pgmap v850: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:57:40.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:57:40.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:39 smithi162 ceph-mon[32106]: osdmap e558: 8 total, 8 up, 8 in 2024-09-21T17:57:40.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:40.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112"} : dispatch 2024-09-21T17:57:40.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:39 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:40.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:39 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:57:40.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:39 smithi162 ceph-mon[32106]: pgmap v850: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:57:41.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112"}]': finished 2024-09-21T17:57:41.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:40 smithi042 ceph-mon[29361]: osdmap e559: 8 total, 8 up, 8 in 2024-09-21T17:57:41.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112"}]': finished 2024-09-21T17:57:41.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:40 smithi042 ceph-mon[38309]: osdmap e559: 8 total, 8 up, 8 in 2024-09-21T17:57:41.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-112"}]': finished 2024-09-21T17:57:41.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:40 smithi162 ceph-mon[32106]: osdmap e559: 8 total, 8 up, 8 in 2024-09-21T17:57:42.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:41 smithi162 ceph-mon[32106]: osdmap e560: 8 total, 8 up, 8 in 2024-09-21T17:57:42.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:41 smithi162 ceph-mon[32106]: pgmap v853: 172 pgs: 172 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:42.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:41 smithi042 ceph-mon[29361]: osdmap e560: 8 total, 8 up, 8 in 2024-09-21T17:57:42.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:41 smithi042 ceph-mon[29361]: pgmap v853: 172 pgs: 172 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:42.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:41 smithi042 ceph-mon[38309]: osdmap e560: 8 total, 8 up, 8 in 2024-09-21T17:57:42.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:41 smithi042 ceph-mon[38309]: pgmap v853: 172 pgs: 172 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:43.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:42 smithi162 ceph-mon[32106]: osdmap e561: 8 total, 8 up, 8 in 2024-09-21T17:57:43.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-114","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:43.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-114","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:42 smithi042 ceph-mon[29361]: osdmap e561: 8 total, 8 up, 8 in 2024-09-21T17:57:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-114","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:43.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-114","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:43.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:42 smithi042 ceph-mon[38309]: osdmap e561: 8 total, 8 up, 8 in 2024-09-21T17:57:43.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-114","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:43.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-114","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:44.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[29361]: osdmap e562: 8 total, 8 up, 8 in 2024-09-21T17:57:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[29361]: pgmap v856: 204 pgs: 4 unknown, 200 active+clean; 583 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T17:57:44.165 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:57:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:57:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[38309]: osdmap e562: 8 total, 8 up, 8 in 2024-09-21T17:57:44.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:44.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:44.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:44.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:43 smithi042 ceph-mon[38309]: pgmap v856: 204 pgs: 4 unknown, 200 active+clean; 583 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T17:57:44.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:44.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:43 smithi162 ceph-mon[32106]: osdmap e562: 8 total, 8 up, 8 in 2024-09-21T17:57:44.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:44.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:44.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:44.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:43 smithi162 ceph-mon[32106]: pgmap v856: 204 pgs: 4 unknown, 200 active+clean; 583 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T17:57:45.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:57:45.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:44 smithi162 ceph-mon[32106]: osdmap e563: 8 total, 8 up, 8 in 2024-09-21T17:57:45.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:45.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:45.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:57:45.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:44 smithi042 ceph-mon[29361]: osdmap e563: 8 total, 8 up, 8 in 2024-09-21T17:57:45.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:45.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:45.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:57:45.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:44 smithi042 ceph-mon[38309]: osdmap e563: 8 total, 8 up, 8 in 2024-09-21T17:57:45.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:45.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-114"}]': finished 2024-09-21T17:57:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:45 smithi162 ceph-mon[32106]: osdmap e564: 8 total, 8 up, 8 in 2024-09-21T17:57:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-114", "mode": "writeback"} : dispatch 2024-09-21T17:57:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-114", "mode": "writeback"} : dispatch 2024-09-21T17:57:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:45 smithi162 ceph-mon[32106]: pgmap v859: 204 pgs: 204 active+clean; 583 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:46.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:45 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:46.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-114"}]': finished 2024-09-21T17:57:46.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[29361]: osdmap e564: 8 total, 8 up, 8 in 2024-09-21T17:57:46.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-114", "mode": "writeback"} : dispatch 2024-09-21T17:57:46.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-114", "mode": "writeback"} : dispatch 2024-09-21T17:57:46.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[29361]: pgmap v859: 204 pgs: 204 active+clean; 583 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:46.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:46.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-114"}]': finished 2024-09-21T17:57:46.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[38309]: osdmap e564: 8 total, 8 up, 8 in 2024-09-21T17:57:46.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-114", "mode": "writeback"} : dispatch 2024-09-21T17:57:46.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-114", "mode": "writeback"} : dispatch 2024-09-21T17:57:46.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[38309]: pgmap v859: 204 pgs: 204 active+clean; 583 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:57:46.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:45 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:47.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-114", "mode": "writeback"}]': finished 2024-09-21T17:57:47.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:46 smithi162 ceph-mon[32106]: osdmap e565: 8 total, 8 up, 8 in 2024-09-21T17:57:47.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:47.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:47.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-114", "mode": "writeback"}]': finished 2024-09-21T17:57:47.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:46 smithi042 ceph-mon[29361]: osdmap e565: 8 total, 8 up, 8 in 2024-09-21T17:57:47.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:47.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:47.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-114", "mode": "writeback"}]': finished 2024-09-21T17:57:47.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:46 smithi042 ceph-mon[38309]: osdmap e565: 8 total, 8 up, 8 in 2024-09-21T17:57:47.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:47.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:57:48.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:57:48.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:47 smithi162 ceph-mon[32106]: osdmap e566: 8 total, 8 up, 8 in 2024-09-21T17:57:48.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:48.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:48.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:47 smithi162 ceph-mon[32106]: pgmap v862: 204 pgs: 204 active+clean; 583 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:57:48.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:57:48.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:47 smithi042 ceph-mon[38309]: osdmap e566: 8 total, 8 up, 8 in 2024-09-21T17:57:48.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:48.414 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:48.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:47 smithi042 ceph-mon[38309]: pgmap v862: 204 pgs: 204 active+clean; 583 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:57:48.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:57:48.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:47 smithi042 ceph-mon[29361]: osdmap e566: 8 total, 8 up, 8 in 2024-09-21T17:57:48.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:48.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114"} : dispatch 2024-09-21T17:57:48.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:47 smithi042 ceph-mon[29361]: pgmap v862: 204 pgs: 204 active+clean; 583 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T17:57:49.224 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:48 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:57:49.224 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114"}]': finished 2024-09-21T17:57:49.224 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:48 smithi162 ceph-mon[32106]: osdmap e567: 8 total, 8 up, 8 in 2024-09-21T17:57:49.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:48 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:57:49.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114"}]': finished 2024-09-21T17:57:49.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:48 smithi042 ceph-mon[29361]: osdmap e567: 8 total, 8 up, 8 in 2024-09-21T17:57:49.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:48 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:57:49.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-114"}]': finished 2024-09-21T17:57:49.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:48 smithi042 ceph-mon[38309]: osdmap e567: 8 total, 8 up, 8 in 2024-09-21T17:57:49.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:57:49 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:57:50.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:49 smithi162 ceph-mon[32106]: osdmap e568: 8 total, 8 up, 8 in 2024-09-21T17:57:50.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:49 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:50.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:49 smithi162 ceph-mon[32106]: pgmap v865: 172 pgs: 172 active+clean; 583 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:50.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:49 smithi042 ceph-mon[29361]: osdmap e568: 8 total, 8 up, 8 in 2024-09-21T17:57:50.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:49 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:50.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:49 smithi042 ceph-mon[29361]: pgmap v865: 172 pgs: 172 active+clean; 583 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:50.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:49 smithi042 ceph-mon[38309]: osdmap e568: 8 total, 8 up, 8 in 2024-09-21T17:57:50.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:49 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:57:50.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:49 smithi042 ceph-mon[38309]: pgmap v865: 172 pgs: 172 active+clean; 583 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:50 smithi162 ceph-mon[32106]: osdmap e569: 8 total, 8 up, 8 in 2024-09-21T17:57:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-116","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:51.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-116","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:51.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:50 smithi042 ceph-mon[29361]: osdmap e569: 8 total, 8 up, 8 in 2024-09-21T17:57:51.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-116","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:51.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-116","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:51.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:50 smithi042 ceph-mon[38309]: osdmap e569: 8 total, 8 up, 8 in 2024-09-21T17:57:51.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-116","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:51.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-116","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:57:52.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:52.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:51 smithi162 ceph-mon[32106]: osdmap e570: 8 total, 8 up, 8 in 2024-09-21T17:57:52.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:51 smithi162 ceph-mon[32106]: pgmap v868: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:52.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:52.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:51 smithi042 ceph-mon[29361]: osdmap e570: 8 total, 8 up, 8 in 2024-09-21T17:57:52.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:51 smithi042 ceph-mon[29361]: pgmap v868: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:52.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:57:52.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:51 smithi042 ceph-mon[38309]: osdmap e570: 8 total, 8 up, 8 in 2024-09-21T17:57:52.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:51 smithi042 ceph-mon[38309]: pgmap v868: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:57:53.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:53 smithi162 ceph-mon[32106]: osdmap e571: 8 total, 8 up, 8 in 2024-09-21T17:57:53.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:53 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:53.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:53.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:53 smithi042 ceph-mon[29361]: osdmap e571: 8 total, 8 up, 8 in 2024-09-21T17:57:53.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:53 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:53.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:53.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:53 smithi042 ceph-mon[38309]: osdmap e571: 8 total, 8 up, 8 in 2024-09-21T17:57:53.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:53 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:53.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:57:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:57:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:57:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:57:54.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:57:54.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:54 smithi042 ceph-mon[29361]: osdmap e572: 8 total, 8 up, 8 in 2024-09-21T17:57:54.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:57:54.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:57:54.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:54 smithi042 ceph-mon[29361]: pgmap v871: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:57:54.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:57:54.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:54 smithi042 ceph-mon[38309]: osdmap e572: 8 total, 8 up, 8 in 2024-09-21T17:57:54.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:57:54.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:57:54.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:54 smithi042 ceph-mon[38309]: pgmap v871: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:57:54.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:57:54.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:54 smithi162 ceph-mon[32106]: osdmap e572: 8 total, 8 up, 8 in 2024-09-21T17:57:54.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:57:54.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:57:54.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:54 smithi162 ceph-mon[32106]: pgmap v871: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:57:55.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-116"}]': finished 2024-09-21T17:57:55.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:55 smithi162 ceph-mon[32106]: osdmap e573: 8 total, 8 up, 8 in 2024-09-21T17:57:55.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-116", "mode": "writeback"} : dispatch 2024-09-21T17:57:55.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-116", "mode": "writeback"} : dispatch 2024-09-21T17:57:55.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-116"}]': finished 2024-09-21T17:57:55.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:55 smithi042 ceph-mon[29361]: osdmap e573: 8 total, 8 up, 8 in 2024-09-21T17:57:55.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-116", "mode": "writeback"} : dispatch 2024-09-21T17:57:55.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-116", "mode": "writeback"} : dispatch 2024-09-21T17:57:55.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-116"}]': finished 2024-09-21T17:57:55.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:55 smithi042 ceph-mon[38309]: osdmap e573: 8 total, 8 up, 8 in 2024-09-21T17:57:55.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-116", "mode": "writeback"} : dispatch 2024-09-21T17:57:55.415 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-116", "mode": "writeback"} : dispatch 2024-09-21T17:57:56.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:56.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-116", "mode": "writeback"}]': finished 2024-09-21T17:57:56.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[29361]: osdmap e574: 8 total, 8 up, 8 in 2024-09-21T17:57:56.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "325.1"} : dispatch 2024-09-21T17:57:56.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[29361]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "325.1"}]: dispatch 2024-09-21T17:57:56.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[29361]: 325.1 scrub starts 2024-09-21T17:57:56.316 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[29361]: 325.1 scrub ok 2024-09-21T17:57:56.317 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[29361]: pgmap v874: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:57:56.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:56.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-116", "mode": "writeback"}]': finished 2024-09-21T17:57:56.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[38309]: osdmap e574: 8 total, 8 up, 8 in 2024-09-21T17:57:56.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "325.1"} : dispatch 2024-09-21T17:57:56.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[38309]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "325.1"}]: dispatch 2024-09-21T17:57:56.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[38309]: 325.1 scrub starts 2024-09-21T17:57:56.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[38309]: 325.1 scrub ok 2024-09-21T17:57:56.317 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:56 smithi042 ceph-mon[38309]: pgmap v874: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:57:56.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:56 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:57:56.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-116", "mode": "writeback"}]': finished 2024-09-21T17:57:56.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:56 smithi162 ceph-mon[32106]: osdmap e574: 8 total, 8 up, 8 in 2024-09-21T17:57:56.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "325.1"} : dispatch 2024-09-21T17:57:56.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:56 smithi162 ceph-mon[32106]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "325.1"}]: dispatch 2024-09-21T17:57:56.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:56 smithi162 ceph-mon[32106]: 325.1 scrub starts 2024-09-21T17:57:56.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:56 smithi162 ceph-mon[32106]: 325.1 scrub ok 2024-09-21T17:57:56.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:56 smithi162 ceph-mon[32106]: pgmap v874: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:57:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:58 smithi162 ceph-mon[32106]: pgmap v875: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 945 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-09-21T17:57:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:57:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:57:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:58 smithi042 ceph-mon[29361]: pgmap v875: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 945 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-09-21T17:57:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:57:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:57:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:58 smithi042 ceph-mon[38309]: pgmap v875: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 945 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-09-21T17:57:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:57:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:57:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:57:59.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:57:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:58:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:00 smithi162 ceph-mon[32106]: pgmap v876: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T17:58:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:00 smithi042 ceph-mon[29361]: pgmap v876: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T17:58:00.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:00.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:00 smithi042 ceph-mon[38309]: pgmap v876: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T17:58:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:02 smithi162 ceph-mon[32106]: pgmap v877: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-09-21T17:58:02.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:02 smithi042 ceph-mon[29361]: pgmap v877: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-09-21T17:58:02.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:02 smithi042 ceph-mon[38309]: pgmap v877: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-09-21T17:58:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:58:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:58:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:58:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:04 smithi162 ceph-mon[32106]: pgmap v878: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T17:58:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:04 smithi042 ceph-mon[29361]: pgmap v878: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T17:58:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:04 smithi042 ceph-mon[38309]: pgmap v878: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T17:58:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:06 smithi162 ceph-mon[32106]: pgmap v879: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:06 smithi042 ceph-mon[29361]: pgmap v879: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:06.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:06 smithi042 ceph-mon[38309]: pgmap v879: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:08 smithi162 ceph-mon[32106]: pgmap v880: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T17:58:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:08 smithi042 ceph-mon[29361]: pgmap v880: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T17:58:08.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:08 smithi042 ceph-mon[38309]: pgmap v880: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T17:58:09.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:58:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:58:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:10 smithi162 ceph-mon[32106]: pgmap v881: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T17:58:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:10 smithi042 ceph-mon[29361]: pgmap v881: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T17:58:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:10 smithi042 ceph-mon[38309]: pgmap v881: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T17:58:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:11 smithi162 ceph-mon[32106]: osdmap e575: 8 total, 8 up, 8 in 2024-09-21T17:58:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:11.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:11 smithi042 ceph-mon[29361]: osdmap e575: 8 total, 8 up, 8 in 2024-09-21T17:58:11.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:11.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:11 smithi042 ceph-mon[38309]: osdmap e575: 8 total, 8 up, 8 in 2024-09-21T17:58:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:12 smithi162 ceph-mon[32106]: pgmap v883: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:58:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:12 smithi162 ceph-mon[32106]: osdmap e576: 8 total, 8 up, 8 in 2024-09-21T17:58:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:58:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:58:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:12 smithi042 ceph-mon[29361]: pgmap v883: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:58:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:12 smithi042 ceph-mon[29361]: osdmap e576: 8 total, 8 up, 8 in 2024-09-21T17:58:12.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:58:12.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:58:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:12 smithi042 ceph-mon[38309]: pgmap v883: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:58:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:12 smithi042 ceph-mon[38309]: osdmap e576: 8 total, 8 up, 8 in 2024-09-21T17:58:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:58:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116"} : dispatch 2024-09-21T17:58:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:13 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116"}]': finished 2024-09-21T17:58:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:13 smithi162 ceph-mon[32106]: osdmap e577: 8 total, 8 up, 8 in 2024-09-21T17:58:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:58:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:13 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116"}]': finished 2024-09-21T17:58:13.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:13 smithi042 ceph-mon[29361]: osdmap e577: 8 total, 8 up, 8 in 2024-09-21T17:58:13.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:13.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:58:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:13 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-116"}]': finished 2024-09-21T17:58:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:13 smithi042 ceph-mon[38309]: osdmap e577: 8 total, 8 up, 8 in 2024-09-21T17:58:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:58:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:58:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:58:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:58:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:14 smithi162 ceph-mon[32106]: pgmap v886: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T17:58:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:14 smithi162 ceph-mon[32106]: osdmap e578: 8 total, 8 up, 8 in 2024-09-21T17:58:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:14 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:58:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:14 smithi042 ceph-mon[29361]: pgmap v886: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T17:58:14.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:14 smithi042 ceph-mon[29361]: osdmap e578: 8 total, 8 up, 8 in 2024-09-21T17:58:14.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:14 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:58:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:14 smithi042 ceph-mon[38309]: pgmap v886: 204 pgs: 204 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T17:58:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:14 smithi042 ceph-mon[38309]: osdmap e578: 8 total, 8 up, 8 in 2024-09-21T17:58:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:14 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:58:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:15 smithi162 ceph-mon[32106]: osdmap e579: 8 total, 8 up, 8 in 2024-09-21T17:58:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-118","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-118","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:15.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:15 smithi042 ceph-mon[29361]: osdmap e579: 8 total, 8 up, 8 in 2024-09-21T17:58:15.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-118","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:15.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-118","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:15 smithi042 ceph-mon[38309]: osdmap e579: 8 total, 8 up, 8 in 2024-09-21T17:58:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-118","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-118","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:16 smithi162 ceph-mon[32106]: pgmap v889: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-21T17:58:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:16 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:16 smithi162 ceph-mon[32106]: osdmap e580: 8 total, 8 up, 8 in 2024-09-21T17:58:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:16 smithi042 ceph-mon[29361]: pgmap v889: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-21T17:58:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:16 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:16 smithi042 ceph-mon[29361]: osdmap e580: 8 total, 8 up, 8 in 2024-09-21T17:58:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:16 smithi042 ceph-mon[38309]: pgmap v889: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-21T17:58:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:16 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:16 smithi042 ceph-mon[38309]: osdmap e580: 8 total, 8 up, 8 in 2024-09-21T17:58:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:17 smithi162 ceph-mon[32106]: osdmap e581: 8 total, 8 up, 8 in 2024-09-21T17:58:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:17 smithi042 ceph-mon[29361]: osdmap e581: 8 total, 8 up, 8 in 2024-09-21T17:58:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:17 smithi042 ceph-mon[38309]: osdmap e581: 8 total, 8 up, 8 in 2024-09-21T17:58:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:18 smithi162 ceph-mon[32106]: pgmap v892: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:18 smithi162 ceph-mon[32106]: osdmap e582: 8 total, 8 up, 8 in 2024-09-21T17:58:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:18 smithi042 ceph-mon[29361]: pgmap v892: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:18 smithi042 ceph-mon[29361]: osdmap e582: 8 total, 8 up, 8 in 2024-09-21T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:18 smithi042 ceph-mon[38309]: pgmap v892: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:18 smithi042 ceph-mon[38309]: osdmap e582: 8 total, 8 up, 8 in 2024-09-21T17:58:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:19.543 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:58:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:58:19.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-118"}]': finished 2024-09-21T17:58:19.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:19 smithi162 ceph-mon[32106]: osdmap e583: 8 total, 8 up, 8 in 2024-09-21T17:58:19.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-118", "mode": "writeback"} : dispatch 2024-09-21T17:58:19.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-118", "mode": "writeback"} : dispatch 2024-09-21T17:58:19.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:19 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:58:19.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:19 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:19.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-118", "mode": "writeback"}]': finished 2024-09-21T17:58:19.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:19 smithi162 ceph-mon[32106]: osdmap e584: 8 total, 8 up, 8 in 2024-09-21T17:58:19.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-118"}]': finished 2024-09-21T17:58:19.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[29361]: osdmap e583: 8 total, 8 up, 8 in 2024-09-21T17:58:19.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-118", "mode": "writeback"} : dispatch 2024-09-21T17:58:19.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-118", "mode": "writeback"} : dispatch 2024-09-21T17:58:19.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:58:19.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:19.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-118", "mode": "writeback"}]': finished 2024-09-21T17:58:19.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[29361]: osdmap e584: 8 total, 8 up, 8 in 2024-09-21T17:58:19.870 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-118"}]': finished 2024-09-21T17:58:19.870 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[38309]: osdmap e583: 8 total, 8 up, 8 in 2024-09-21T17:58:19.870 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-118", "mode": "writeback"} : dispatch 2024-09-21T17:58:19.870 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-118", "mode": "writeback"} : dispatch 2024-09-21T17:58:19.870 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:58:19.870 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:19.870 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-118", "mode": "writeback"}]': finished 2024-09-21T17:58:19.870 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:19 smithi042 ceph-mon[38309]: osdmap e584: 8 total, 8 up, 8 in 2024-09-21T17:58:20.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:20.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:20 smithi042 ceph-mon[29361]: pgmap v896: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 525 B/s wr, 1 op/s 2024-09-21T17:58:20.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:20 smithi042 ceph-mon[29361]: osdmap e585: 8 total, 8 up, 8 in 2024-09-21T17:58:20.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:20.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:20.820 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:20.820 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:20 smithi042 ceph-mon[38309]: pgmap v896: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 525 B/s wr, 1 op/s 2024-09-21T17:58:20.821 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:20 smithi042 ceph-mon[38309]: osdmap e585: 8 total, 8 up, 8 in 2024-09-21T17:58:20.821 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:20.821 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:20 smithi162 ceph-mon[32106]: pgmap v896: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 525 B/s wr, 1 op/s 2024-09-21T17:58:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:20 smithi162 ceph-mon[32106]: osdmap e585: 8 total, 8 up, 8 in 2024-09-21T17:58:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:22 smithi162 ceph-mon[32106]: osdmap e586: 8 total, 8 up, 8 in 2024-09-21T17:58:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:22 smithi162 ceph-mon[32106]: pgmap v899: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 527 B/s wr, 1 op/s 2024-09-21T17:58:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:22 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:22.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:22 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[29361]: osdmap e586: 8 total, 8 up, 8 in 2024-09-21T17:58:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:22.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[29361]: pgmap v899: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 527 B/s wr, 1 op/s 2024-09-21T17:58:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:22.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[38309]: osdmap e586: 8 total, 8 up, 8 in 2024-09-21T17:58:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118"} : dispatch 2024-09-21T17:58:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[38309]: pgmap v899: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 527 B/s wr, 1 op/s 2024-09-21T17:58:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:22.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:22 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:23.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:23 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:23.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118"}]': finished 2024-09-21T17:58:23.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:23 smithi162 ceph-mon[32106]: osdmap e587: 8 total, 8 up, 8 in 2024-09-21T17:58:23.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:23 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:23.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:23 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:23 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118"}]': finished 2024-09-21T17:58:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:23 smithi042 ceph-mon[29361]: osdmap e587: 8 total, 8 up, 8 in 2024-09-21T17:58:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:23 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:23.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:23 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:23.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:23 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:23.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-118"}]': finished 2024-09-21T17:58:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:23 smithi042 ceph-mon[38309]: osdmap e587: 8 total, 8 up, 8 in 2024-09-21T17:58:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:23 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:23.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:23 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:58:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:58:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:58:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:24 smithi162 ceph-mon[32106]: osdmap e588: 8 total, 8 up, 8 in 2024-09-21T17:58:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:24 smithi162 ceph-mon[32106]: pgmap v902: 172 pgs: 172 active+clean; 583 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:24.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:58:24.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:58:24.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:24.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:24 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:58:24.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[29361]: osdmap e588: 8 total, 8 up, 8 in 2024-09-21T17:58:24.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[29361]: pgmap v902: 172 pgs: 172 active+clean; 583 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:58:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:58:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:24.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:58:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[38309]: osdmap e588: 8 total, 8 up, 8 in 2024-09-21T17:58:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[38309]: pgmap v902: 172 pgs: 172 active+clean; 583 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:58:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:58:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:24.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:24 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:58:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:25 smithi162 ceph-mon[32106]: osdmap e589: 8 total, 8 up, 8 in 2024-09-21T17:58:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-120","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:25.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-120","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:25.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:25 smithi042 ceph-mon[29361]: osdmap e589: 8 total, 8 up, 8 in 2024-09-21T17:58:25.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-120","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:25.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-120","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:25.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:25 smithi042 ceph-mon[38309]: osdmap e589: 8 total, 8 up, 8 in 2024-09-21T17:58:25.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-120","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:25.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-120","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:26 smithi042 ceph-mon[29361]: osdmap e590: 8 total, 8 up, 8 in 2024-09-21T17:58:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:26.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:26 smithi042 ceph-mon[29361]: pgmap v905: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:26.566 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:26.566 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:26 smithi042 ceph-mon[38309]: osdmap e590: 8 total, 8 up, 8 in 2024-09-21T17:58:26.566 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:26.566 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:26.567 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:26 smithi042 ceph-mon[38309]: pgmap v905: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:26.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:26.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:26 smithi162 ceph-mon[32106]: osdmap e590: 8 total, 8 up, 8 in 2024-09-21T17:58:26.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:26.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:26.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:26 smithi162 ceph-mon[32106]: pgmap v905: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:27 smithi162 ceph-mon[32106]: osdmap e591: 8 total, 8 up, 8 in 2024-09-21T17:58:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:27.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:27.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:27.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:27 smithi042 ceph-mon[29361]: osdmap e591: 8 total, 8 up, 8 in 2024-09-21T17:58:27.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:27.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:27 smithi042 ceph-mon[38309]: osdmap e591: 8 total, 8 up, 8 in 2024-09-21T17:58:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:27.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-120"}]': finished 2024-09-21T17:58:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:28 smithi162 ceph-mon[32106]: osdmap e592: 8 total, 8 up, 8 in 2024-09-21T17:58:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-120", "mode": "writeback"} : dispatch 2024-09-21T17:58:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-120", "mode": "writeback"} : dispatch 2024-09-21T17:58:28.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:28 smithi162 ceph-mon[32106]: pgmap v908: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-120"}]': finished 2024-09-21T17:58:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:28 smithi042 ceph-mon[29361]: osdmap e592: 8 total, 8 up, 8 in 2024-09-21T17:58:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-120", "mode": "writeback"} : dispatch 2024-09-21T17:58:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-120", "mode": "writeback"} : dispatch 2024-09-21T17:58:28.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:28 smithi042 ceph-mon[29361]: pgmap v908: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:28.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-120"}]': finished 2024-09-21T17:58:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:28 smithi042 ceph-mon[38309]: osdmap e592: 8 total, 8 up, 8 in 2024-09-21T17:58:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-120", "mode": "writeback"} : dispatch 2024-09-21T17:58:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-120", "mode": "writeback"} : dispatch 2024-09-21T17:58:28.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:28 smithi042 ceph-mon[38309]: pgmap v908: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:29.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:58:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-120", "mode": "writeback"}]': finished 2024-09-21T17:58:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-mon[32106]: osdmap e593: 8 total, 8 up, 8 in 2024-09-21T17:58:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:58:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-mon[32106]: osdmap e594: 8 total, 8 up, 8 in 2024-09-21T17:58:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:29.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:29.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:29.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-120", "mode": "writeback"}]': finished 2024-09-21T17:58:29.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[29361]: osdmap e593: 8 total, 8 up, 8 in 2024-09-21T17:58:29.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[29361]: osdmap e594: 8 total, 8 up, 8 in 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-120", "mode": "writeback"}]': finished 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[38309]: osdmap e593: 8 total, 8 up, 8 in 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:58:29.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[38309]: osdmap e594: 8 total, 8 up, 8 in 2024-09-21T17:58:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:29.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120"} : dispatch 2024-09-21T17:58:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:30 smithi162 ceph-mon[32106]: pgmap v911: 204 pgs: 204 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:58:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:30 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120"}]': finished 2024-09-21T17:58:30.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:30 smithi162 ceph-mon[32106]: osdmap e595: 8 total, 8 up, 8 in 2024-09-21T17:58:30.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:30.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:30 smithi042 ceph-mon[29361]: pgmap v911: 204 pgs: 204 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:58:30.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:30 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:30.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120"}]': finished 2024-09-21T17:58:30.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:30 smithi042 ceph-mon[29361]: osdmap e595: 8 total, 8 up, 8 in 2024-09-21T17:58:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:30 smithi042 ceph-mon[38309]: pgmap v911: 204 pgs: 204 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:58:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:30 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-120"}]': finished 2024-09-21T17:58:30.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:30 smithi042 ceph-mon[38309]: osdmap e595: 8 total, 8 up, 8 in 2024-09-21T17:58:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:32 smithi162 ceph-mon[32106]: osdmap e596: 8 total, 8 up, 8 in 2024-09-21T17:58:32.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:32 smithi162 ceph-mon[32106]: pgmap v914: 172 pgs: 172 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:58:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:32 smithi042 ceph-mon[29361]: osdmap e596: 8 total, 8 up, 8 in 2024-09-21T17:58:32.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:32 smithi042 ceph-mon[29361]: pgmap v914: 172 pgs: 172 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:58:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:32 smithi042 ceph-mon[38309]: osdmap e596: 8 total, 8 up, 8 in 2024-09-21T17:58:32.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:32 smithi042 ceph-mon[38309]: pgmap v914: 172 pgs: 172 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:58:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:33 smithi162 ceph-mon[32106]: osdmap e597: 8 total, 8 up, 8 in 2024-09-21T17:58:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-122","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:33.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-122","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:33.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:33 smithi042 ceph-mon[29361]: osdmap e597: 8 total, 8 up, 8 in 2024-09-21T17:58:33.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-122","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:33.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-122","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:33 smithi042 ceph-mon[38309]: osdmap e597: 8 total, 8 up, 8 in 2024-09-21T17:58:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-122","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:33.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-122","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:34.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:58:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:58:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:58:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:34 smithi162 ceph-mon[32106]: osdmap e598: 8 total, 8 up, 8 in 2024-09-21T17:58:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:34.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:34 smithi162 ceph-mon[32106]: pgmap v917: 204 pgs: 7 creating+activating, 197 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:34.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:34.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:34 smithi042 ceph-mon[29361]: osdmap e598: 8 total, 8 up, 8 in 2024-09-21T17:58:34.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:34.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:34 smithi042 ceph-mon[29361]: pgmap v917: 204 pgs: 7 creating+activating, 197 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:34 smithi042 ceph-mon[38309]: osdmap e598: 8 total, 8 up, 8 in 2024-09-21T17:58:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:34.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:34 smithi042 ceph-mon[38309]: pgmap v917: 204 pgs: 7 creating+activating, 197 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:35 smithi162 ceph-mon[32106]: osdmap e599: 8 total, 8 up, 8 in 2024-09-21T17:58:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:35.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:35.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:35.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:35 smithi042 ceph-mon[29361]: osdmap e599: 8 total, 8 up, 8 in 2024-09-21T17:58:35.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:35.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:35 smithi042 ceph-mon[38309]: osdmap e599: 8 total, 8 up, 8 in 2024-09-21T17:58:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:35.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-122"}]': finished 2024-09-21T17:58:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:36 smithi162 ceph-mon[32106]: osdmap e600: 8 total, 8 up, 8 in 2024-09-21T17:58:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:36 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-122", "mode": "writeback"} : dispatch 2024-09-21T17:58:36.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-122", "mode": "writeback"} : dispatch 2024-09-21T17:58:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:36 smithi162 ceph-mon[32106]: pgmap v920: 204 pgs: 7 creating+activating, 197 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:58:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:36 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:36 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-122", "mode": "writeback"}]': finished 2024-09-21T17:58:36.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:36 smithi162 ceph-mon[32106]: osdmap e601: 8 total, 8 up, 8 in 2024-09-21T17:58:36.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-122"}]': finished 2024-09-21T17:58:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[29361]: osdmap e600: 8 total, 8 up, 8 in 2024-09-21T17:58:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-122", "mode": "writeback"} : dispatch 2024-09-21T17:58:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-122", "mode": "writeback"} : dispatch 2024-09-21T17:58:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[29361]: pgmap v920: 204 pgs: 7 creating+activating, 197 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:58:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-122", "mode": "writeback"}]': finished 2024-09-21T17:58:36.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[29361]: osdmap e601: 8 total, 8 up, 8 in 2024-09-21T17:58:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-122"}]': finished 2024-09-21T17:58:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[38309]: osdmap e600: 8 total, 8 up, 8 in 2024-09-21T17:58:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-122", "mode": "writeback"} : dispatch 2024-09-21T17:58:36.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-122", "mode": "writeback"} : dispatch 2024-09-21T17:58:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[38309]: pgmap v920: 204 pgs: 7 creating+activating, 197 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:58:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-122", "mode": "writeback"}]': finished 2024-09-21T17:58:36.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:36 smithi042 ceph-mon[38309]: osdmap e601: 8 total, 8 up, 8 in 2024-09-21T17:58:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:37.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:37.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:38 smithi162 ceph-mon[32106]: osdmap e602: 8 total, 8 up, 8 in 2024-09-21T17:58:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:38 smithi162 ceph-mon[32106]: pgmap v923: 204 pgs: 7 creating+activating, 197 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:38.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:38.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:38 smithi042 ceph-mon[29361]: osdmap e602: 8 total, 8 up, 8 in 2024-09-21T17:58:38.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:38 smithi042 ceph-mon[29361]: pgmap v923: 204 pgs: 7 creating+activating, 197 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:38 smithi042 ceph-mon[38309]: osdmap e602: 8 total, 8 up, 8 in 2024-09-21T17:58:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122"} : dispatch 2024-09-21T17:58:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:38 smithi042 ceph-mon[38309]: pgmap v923: 204 pgs: 7 creating+activating, 197 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:39.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:58:39 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:58:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:39 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122"}]': finished 2024-09-21T17:58:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:39 smithi162 ceph-mon[32106]: osdmap e603: 8 total, 8 up, 8 in 2024-09-21T17:58:39.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:39 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:39.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122"}]': finished 2024-09-21T17:58:39.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:39 smithi042 ceph-mon[29361]: osdmap e603: 8 total, 8 up, 8 in 2024-09-21T17:58:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:39 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-122"}]': finished 2024-09-21T17:58:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:39 smithi042 ceph-mon[38309]: osdmap e603: 8 total, 8 up, 8 in 2024-09-21T17:58:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:40 smithi042 ceph-mon[29361]: osdmap e604: 8 total, 8 up, 8 in 2024-09-21T17:58:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:40 smithi042 ceph-mon[29361]: pgmap v926: 172 pgs: 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:58:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:40 smithi042 ceph-mon[38309]: osdmap e604: 8 total, 8 up, 8 in 2024-09-21T17:58:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:40 smithi042 ceph-mon[38309]: pgmap v926: 172 pgs: 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:58:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:40 smithi162 ceph-mon[32106]: osdmap e604: 8 total, 8 up, 8 in 2024-09-21T17:58:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:40 smithi162 ceph-mon[32106]: pgmap v926: 172 pgs: 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:58:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:41 smithi042 ceph-mon[29361]: osdmap e605: 8 total, 8 up, 8 in 2024-09-21T17:58:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-124","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:41.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-124","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:41 smithi042 ceph-mon[38309]: osdmap e605: 8 total, 8 up, 8 in 2024-09-21T17:58:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-124","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-124","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:41 smithi162 ceph-mon[32106]: osdmap e605: 8 total, 8 up, 8 in 2024-09-21T17:58:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-124","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:41.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-124","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:42.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:42.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:42 smithi042 ceph-mon[29361]: osdmap e606: 8 total, 8 up, 8 in 2024-09-21T17:58:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:42 smithi042 ceph-mon[29361]: pgmap v929: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:58:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:42 smithi042 ceph-mon[38309]: osdmap e606: 8 total, 8 up, 8 in 2024-09-21T17:58:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:42 smithi042 ceph-mon[38309]: pgmap v929: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:58:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:42 smithi162 ceph-mon[32106]: osdmap e606: 8 total, 8 up, 8 in 2024-09-21T17:58:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:42 smithi162 ceph-mon[32106]: pgmap v929: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:58:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:43 smithi042 ceph-mon[29361]: osdmap e607: 8 total, 8 up, 8 in 2024-09-21T17:58:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:43 smithi042 ceph-mon[38309]: osdmap e607: 8 total, 8 up, 8 in 2024-09-21T17:58:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:43 smithi162 ceph-mon[32106]: osdmap e607: 8 total, 8 up, 8 in 2024-09-21T17:58:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:43.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:58:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:58:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:58:44.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:44.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[29361]: osdmap e608: 8 total, 8 up, 8 in 2024-09-21T17:58:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:58:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[29361]: pgmap v932: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:58:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[38309]: osdmap e608: 8 total, 8 up, 8 in 2024-09-21T17:58:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:44.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:58:44.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:44 smithi042 ceph-mon[38309]: pgmap v932: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:58:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:44 smithi162 ceph-mon[32106]: osdmap e608: 8 total, 8 up, 8 in 2024-09-21T17:58:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:44.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:44 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:58:44.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:44 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:58:44.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:44 smithi162 ceph-mon[32106]: pgmap v932: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:58:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-124"}]': finished 2024-09-21T17:58:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[29361]: osdmap e609: 8 total, 8 up, 8 in 2024-09-21T17:58:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-124", "mode": "writeback"} : dispatch 2024-09-21T17:58:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-124", "mode": "writeback"} : dispatch 2024-09-21T17:58:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-124", "mode": "writeback"}]': finished 2024-09-21T17:58:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[29361]: osdmap e610: 8 total, 8 up, 8 in 2024-09-21T17:58:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-124"}]': finished 2024-09-21T17:58:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[38309]: osdmap e609: 8 total, 8 up, 8 in 2024-09-21T17:58:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-124", "mode": "writeback"} : dispatch 2024-09-21T17:58:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-124", "mode": "writeback"} : dispatch 2024-09-21T17:58:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:45.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-124", "mode": "writeback"}]': finished 2024-09-21T17:58:45.666 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:45 smithi042 ceph-mon[38309]: osdmap e610: 8 total, 8 up, 8 in 2024-09-21T17:58:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-124"}]': finished 2024-09-21T17:58:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:45 smithi162 ceph-mon[32106]: osdmap e609: 8 total, 8 up, 8 in 2024-09-21T17:58:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-124", "mode": "writeback"} : dispatch 2024-09-21T17:58:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-124", "mode": "writeback"} : dispatch 2024-09-21T17:58:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:45 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-124", "mode": "writeback"}]': finished 2024-09-21T17:58:45.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:45 smithi162 ceph-mon[32106]: osdmap e610: 8 total, 8 up, 8 in 2024-09-21T17:58:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:46 smithi042 ceph-mon[29361]: pgmap v935: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:58:46.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:46 smithi042 ceph-mon[38309]: pgmap v935: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:58:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:46 smithi162 ceph-mon[32106]: pgmap v935: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T17:58:47.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:47 smithi042 ceph-mon[29361]: osdmap e611: 8 total, 8 up, 8 in 2024-09-21T17:58:47.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:47.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:47 smithi042 ceph-mon[38309]: osdmap e611: 8 total, 8 up, 8 in 2024-09-21T17:58:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:47.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:47 smithi162 ceph-mon[32106]: osdmap e611: 8 total, 8 up, 8 in 2024-09-21T17:58:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:48.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:48.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[29361]: osdmap e612: 8 total, 8 up, 8 in 2024-09-21T17:58:48.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[29361]: pgmap v938: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[38309]: osdmap e612: 8 total, 8 up, 8 in 2024-09-21T17:58:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[38309]: pgmap v938: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:48 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:48 smithi162 ceph-mon[32106]: osdmap e612: 8 total, 8 up, 8 in 2024-09-21T17:58:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:48.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124"} : dispatch 2024-09-21T17:58:48.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:48 smithi162 ceph-mon[32106]: pgmap v938: 204 pgs: 204 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:48.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:48 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:49.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:58:49 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:58:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124"}]': finished 2024-09-21T17:58:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:49 smithi162 ceph-mon[32106]: osdmap e613: 8 total, 8 up, 8 in 2024-09-21T17:58:49.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124"}]': finished 2024-09-21T17:58:49.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:49 smithi042 ceph-mon[29361]: osdmap e613: 8 total, 8 up, 8 in 2024-09-21T17:58:49.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-124"}]': finished 2024-09-21T17:58:49.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:49 smithi042 ceph-mon[38309]: osdmap e613: 8 total, 8 up, 8 in 2024-09-21T17:58:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:50 smithi042 ceph-mon[29361]: osdmap e614: 8 total, 8 up, 8 in 2024-09-21T17:58:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:50 smithi042 ceph-mon[29361]: pgmap v941: 172 pgs: 172 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:50 smithi042 ceph-mon[38309]: osdmap e614: 8 total, 8 up, 8 in 2024-09-21T17:58:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:50 smithi042 ceph-mon[38309]: pgmap v941: 172 pgs: 172 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:58:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:50 smithi162 ceph-mon[32106]: osdmap e614: 8 total, 8 up, 8 in 2024-09-21T17:58:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:50 smithi162 ceph-mon[32106]: pgmap v941: 172 pgs: 172 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:51.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:51 smithi042 ceph-mon[29361]: osdmap e615: 8 total, 8 up, 8 in 2024-09-21T17:58:51.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-126","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:51.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-126","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:51.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:51 smithi042 ceph-mon[38309]: osdmap e615: 8 total, 8 up, 8 in 2024-09-21T17:58:51.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-126","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:51.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-126","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:51 smithi162 ceph-mon[32106]: osdmap e615: 8 total, 8 up, 8 in 2024-09-21T17:58:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-126","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-126","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:52.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:52.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:52 smithi042 ceph-mon[29361]: osdmap e616: 8 total, 8 up, 8 in 2024-09-21T17:58:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:52 smithi042 ceph-mon[29361]: pgmap v944: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:52 smithi042 ceph-mon[38309]: osdmap e616: 8 total, 8 up, 8 in 2024-09-21T17:58:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:52 smithi042 ceph-mon[38309]: pgmap v944: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:58:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:52 smithi162 ceph-mon[32106]: osdmap e616: 8 total, 8 up, 8 in 2024-09-21T17:58:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:58:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:52 smithi162 ceph-mon[32106]: pgmap v944: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:53 smithi162 ceph-mon[32106]: osdmap e617: 8 total, 8 up, 8 in 2024-09-21T17:58:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:53 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:53.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:53.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:53 smithi042 ceph-mon[29361]: osdmap e617: 8 total, 8 up, 8 in 2024-09-21T17:58:53.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:53 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:53.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:53.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:58:53.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:53 smithi042 ceph-mon[38309]: osdmap e617: 8 total, 8 up, 8 in 2024-09-21T17:58:53.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:53 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:53.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:58:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:58:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:58:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-126"}]': finished 2024-09-21T17:58:54.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:54 smithi162 ceph-mon[32106]: osdmap e618: 8 total, 8 up, 8 in 2024-09-21T17:58:54.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-126", "mode": "writeback"} : dispatch 2024-09-21T17:58:54.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-126", "mode": "writeback"} : dispatch 2024-09-21T17:58:54.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:54 smithi162 ceph-mon[32106]: pgmap v947: 204 pgs: 204 active+clean; 583 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:54.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:54 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:54.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-126", "mode": "writeback"}]': finished 2024-09-21T17:58:54.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:54 smithi162 ceph-mon[32106]: osdmap e619: 8 total, 8 up, 8 in 2024-09-21T17:58:54.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:54.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-126"}]': finished 2024-09-21T17:58:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[29361]: osdmap e618: 8 total, 8 up, 8 in 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-126", "mode": "writeback"} : dispatch 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-126", "mode": "writeback"} : dispatch 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[29361]: pgmap v947: 204 pgs: 204 active+clean; 583 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-126", "mode": "writeback"}]': finished 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[29361]: osdmap e619: 8 total, 8 up, 8 in 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-126"}]': finished 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[38309]: osdmap e618: 8 total, 8 up, 8 in 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-126", "mode": "writeback"} : dispatch 2024-09-21T17:58:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-126", "mode": "writeback"} : dispatch 2024-09-21T17:58:54.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[38309]: pgmap v947: 204 pgs: 204 active+clean; 583 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:54.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:58:54.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-126", "mode": "writeback"}]': finished 2024-09-21T17:58:54.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[38309]: osdmap e619: 8 total, 8 up, 8 in 2024-09-21T17:58:54.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:54.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:58:56.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:56.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:56 smithi162 ceph-mon[32106]: osdmap e620: 8 total, 8 up, 8 in 2024-09-21T17:58:56.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:56.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:56 smithi162 ceph-mon[32106]: pgmap v950: 204 pgs: 204 active+clean; 583 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:56.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:56.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:56 smithi042 ceph-mon[38309]: osdmap e620: 8 total, 8 up, 8 in 2024-09-21T17:58:56.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:56.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:56.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:56 smithi042 ceph-mon[38309]: pgmap v950: 204 pgs: 204 active+clean; 583 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:58:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:56 smithi042 ceph-mon[29361]: osdmap e620: 8 total, 8 up, 8 in 2024-09-21T17:58:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126"} : dispatch 2024-09-21T17:58:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:56 smithi042 ceph-mon[29361]: pgmap v950: 204 pgs: 204 active+clean; 583 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:58:57.280 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:58:57.280 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9035 ms) 2024-09-21T17:58:57.280 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-21T17:58:57.280 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:58:57.280 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6043 ms) 2024-09-21T17:58:57.280 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-21T17:58:57.280 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:58:57.280 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5028 ms) 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25518 ms) 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (13226 ms) 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12075 ms) 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: 00000010 69 73 |is| 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: 00000012 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12069 ms) 2024-09-21T17:58:57.281 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6044 ms) 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (554520 ms total) 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1111 ms) 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (10960 ms) 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18095 ms) 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (1 ms) 2024-09-21T17:58:57.282 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30167 ms total) 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7061 ms) 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8064 ms) 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: waiting for scrub... 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: done waiting 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (24535 ms) 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9775 ms) 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (7988 ms) 2024-09-21T17:58:57.283 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-21T17:58:57.284 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8056 ms) 2024-09-21T17:58:57.284 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-21T17:58:57.284 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10064 ms) 2024-09-21T17:58:57.284 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-21T17:58:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:57 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126"}]': finished 2024-09-21T17:58:57.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:57 smithi162 ceph-mon[32106]: osdmap e621: 8 total, 8 up, 8 in 2024-09-21T17:58:57.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:57 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:57.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126"}]': finished 2024-09-21T17:58:57.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:57 smithi042 ceph-mon[29361]: osdmap e621: 8 total, 8 up, 8 in 2024-09-21T17:58:57.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:57 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:58:57.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-126"}]': finished 2024-09-21T17:58:57.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:57 smithi042 ceph-mon[38309]: osdmap e621: 8 total, 8 up, 8 in 2024-09-21T17:58:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:58 smithi162 ceph-mon[32106]: osdmap e622: 8 total, 8 up, 8 in 2024-09-21T17:58:58.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:58 smithi162 ceph-mon[32106]: pgmap v953: 172 pgs: 172 active+clean; 583 KiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:58.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:58 smithi042 ceph-mon[29361]: osdmap e622: 8 total, 8 up, 8 in 2024-09-21T17:58:58.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:58 smithi042 ceph-mon[29361]: pgmap v953: 172 pgs: 172 active+clean; 583 KiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:58 smithi042 ceph-mon[38309]: osdmap e622: 8 total, 8 up, 8 in 2024-09-21T17:58:58.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:58 smithi042 ceph-mon[38309]: pgmap v953: 172 pgs: 172 active+clean; 583 KiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:58:59.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:58:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:58:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:59 smithi162 ceph-mon[32106]: osdmap e623: 8 total, 8 up, 8 in 2024-09-21T17:58:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-128","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:59.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-128","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:59.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:58:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:58:59.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:59 smithi042 ceph-mon[29361]: osdmap e623: 8 total, 8 up, 8 in 2024-09-21T17:58:59.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-128","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:59.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-128","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:59.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:58:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:58:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:59 smithi042 ceph-mon[38309]: osdmap e623: 8 total, 8 up, 8 in 2024-09-21T17:58:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-128","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-128","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:58:59.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:58:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:00 smithi162 ceph-mon[32106]: osdmap e624: 8 total, 8 up, 8 in 2024-09-21T17:59:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:00 smithi162 ceph-mon[32106]: pgmap v956: 204 pgs: 29 creating+peering, 3 unknown, 172 active+clean; 583 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:00.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[29361]: osdmap e624: 8 total, 8 up, 8 in 2024-09-21T17:59:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:00.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[29361]: pgmap v956: 204 pgs: 29 creating+peering, 3 unknown, 172 active+clean; 583 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[38309]: osdmap e624: 8 total, 8 up, 8 in 2024-09-21T17:59:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:00 smithi042 ceph-mon[38309]: pgmap v956: 204 pgs: 29 creating+peering, 3 unknown, 172 active+clean; 583 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:01 smithi162 ceph-mon[32106]: osdmap e625: 8 total, 8 up, 8 in 2024-09-21T17:59:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:01.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:01 smithi042 ceph-mon[29361]: osdmap e625: 8 total, 8 up, 8 in 2024-09-21T17:59:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:01.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:01 smithi042 ceph-mon[38309]: osdmap e625: 8 total, 8 up, 8 in 2024-09-21T17:59:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-128"}]': finished 2024-09-21T17:59:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:02 smithi162 ceph-mon[32106]: osdmap e626: 8 total, 8 up, 8 in 2024-09-21T17:59:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:02 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-128", "mode": "writeback"} : dispatch 2024-09-21T17:59:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-128", "mode": "writeback"} : dispatch 2024-09-21T17:59:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:02 smithi162 ceph-mon[32106]: pgmap v959: 204 pgs: 29 creating+peering, 3 unknown, 172 active+clean; 583 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:02.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-128"}]': finished 2024-09-21T17:59:02.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:02 smithi042 ceph-mon[29361]: osdmap e626: 8 total, 8 up, 8 in 2024-09-21T17:59:02.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:02 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-128", "mode": "writeback"} : dispatch 2024-09-21T17:59:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-128", "mode": "writeback"} : dispatch 2024-09-21T17:59:02.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:02 smithi042 ceph-mon[29361]: pgmap v959: 204 pgs: 29 creating+peering, 3 unknown, 172 active+clean; 583 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-128"}]': finished 2024-09-21T17:59:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:02 smithi042 ceph-mon[38309]: osdmap e626: 8 total, 8 up, 8 in 2024-09-21T17:59:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:02 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-128", "mode": "writeback"} : dispatch 2024-09-21T17:59:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-128", "mode": "writeback"} : dispatch 2024-09-21T17:59:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:02 smithi042 ceph-mon[38309]: pgmap v959: 204 pgs: 29 creating+peering, 3 unknown, 172 active+clean; 583 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:03 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-128", "mode": "writeback"}]': finished 2024-09-21T17:59:03.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:03 smithi162 ceph-mon[32106]: osdmap e627: 8 total, 8 up, 8 in 2024-09-21T17:59:03.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:03 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:03.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-128", "mode": "writeback"}]': finished 2024-09-21T17:59:03.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:03 smithi042 ceph-mon[29361]: osdmap e627: 8 total, 8 up, 8 in 2024-09-21T17:59:03.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:03 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:03.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-128", "mode": "writeback"}]': finished 2024-09-21T17:59:03.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:03 smithi042 ceph-mon[38309]: osdmap e627: 8 total, 8 up, 8 in 2024-09-21T17:59:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:59:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:59:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:59:04.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:04 smithi042 ceph-mon[29361]: pgmap v961: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 495 B/s wr, 1 op/s 2024-09-21T17:59:04.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:04 smithi042 ceph-mon[38309]: pgmap v961: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 495 B/s wr, 1 op/s 2024-09-21T17:59:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:04 smithi162 ceph-mon[32106]: pgmap v961: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 495 B/s wr, 1 op/s 2024-09-21T17:59:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:06 smithi162 ceph-mon[32106]: pgmap v962: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-09-21T17:59:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:06 smithi042 ceph-mon[29361]: pgmap v962: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-09-21T17:59:06.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:06 smithi042 ceph-mon[38309]: pgmap v962: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-09-21T17:59:07.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:07.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:07 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:07.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:07.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:07 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:07.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:07.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:07 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:08 smithi162 ceph-mon[32106]: pgmap v963: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 862 B/s rd, 287 B/s wr, 1 op/s 2024-09-21T17:59:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:08 smithi162 ceph-mon[32106]: osdmap e628: 8 total, 8 up, 8 in 2024-09-21T17:59:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:08 smithi042 ceph-mon[29361]: pgmap v963: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 862 B/s rd, 287 B/s wr, 1 op/s 2024-09-21T17:59:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:08 smithi042 ceph-mon[29361]: osdmap e628: 8 total, 8 up, 8 in 2024-09-21T17:59:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:08 smithi042 ceph-mon[38309]: pgmap v963: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 862 B/s rd, 287 B/s wr, 1 op/s 2024-09-21T17:59:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:08 smithi042 ceph-mon[38309]: osdmap e628: 8 total, 8 up, 8 in 2024-09-21T17:59:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128"} : dispatch 2024-09-21T17:59:09.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:59:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:59:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:09 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128"}]': finished 2024-09-21T17:59:09.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:09 smithi162 ceph-mon[32106]: osdmap e629: 8 total, 8 up, 8 in 2024-09-21T17:59:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:09 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128"}]': finished 2024-09-21T17:59:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:09 smithi042 ceph-mon[29361]: osdmap e629: 8 total, 8 up, 8 in 2024-09-21T17:59:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:09 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-128"}]': finished 2024-09-21T17:59:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:09 smithi042 ceph-mon[38309]: osdmap e629: 8 total, 8 up, 8 in 2024-09-21T17:59:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:10 smithi162 ceph-mon[32106]: pgmap v966: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 287 B/s wr, 2 op/s 2024-09-21T17:59:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:10 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:10 smithi162 ceph-mon[32106]: osdmap e630: 8 total, 8 up, 8 in 2024-09-21T17:59:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:10 smithi042 ceph-mon[29361]: pgmap v966: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 287 B/s wr, 2 op/s 2024-09-21T17:59:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:10 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:10 smithi042 ceph-mon[29361]: osdmap e630: 8 total, 8 up, 8 in 2024-09-21T17:59:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:10 smithi042 ceph-mon[38309]: pgmap v966: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 287 B/s wr, 2 op/s 2024-09-21T17:59:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:10 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:10 smithi042 ceph-mon[38309]: osdmap e630: 8 total, 8 up, 8 in 2024-09-21T17:59:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:11 smithi162 ceph-mon[32106]: osdmap e631: 8 total, 8 up, 8 in 2024-09-21T17:59:11.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-130","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:11.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-130","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:11.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:11 smithi042 ceph-mon[29361]: osdmap e631: 8 total, 8 up, 8 in 2024-09-21T17:59:11.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-130","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:11.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-130","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:11 smithi042 ceph-mon[38309]: osdmap e631: 8 total, 8 up, 8 in 2024-09-21T17:59:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-130","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-130","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:12 smithi162 ceph-mon[32106]: pgmap v969: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:59:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:12 smithi162 ceph-mon[32106]: osdmap e632: 8 total, 8 up, 8 in 2024-09-21T17:59:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:12 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:12 smithi042 ceph-mon[29361]: pgmap v969: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:59:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:12.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:12 smithi042 ceph-mon[29361]: osdmap e632: 8 total, 8 up, 8 in 2024-09-21T17:59:12.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:12 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:12.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:12 smithi042 ceph-mon[38309]: pgmap v969: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:59:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:12 smithi042 ceph-mon[38309]: osdmap e632: 8 total, 8 up, 8 in 2024-09-21T17:59:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:12 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:13 smithi162 ceph-mon[32106]: osdmap e633: 8 total, 8 up, 8 in 2024-09-21T17:59:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-130"}]': finished 2024-09-21T17:59:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:13 smithi162 ceph-mon[32106]: osdmap e634: 8 total, 8 up, 8 in 2024-09-21T17:59:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[29361]: osdmap e633: 8 total, 8 up, 8 in 2024-09-21T17:59:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-130"}]': finished 2024-09-21T17:59:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[29361]: osdmap e634: 8 total, 8 up, 8 in 2024-09-21T17:59:13.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[38309]: osdmap e633: 8 total, 8 up, 8 in 2024-09-21T17:59:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-130"}]': finished 2024-09-21T17:59:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-mon[38309]: osdmap e634: 8 total, 8 up, 8 in 2024-09-21T17:59:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:59:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:59:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:59:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:14 smithi162 ceph-mon[32106]: pgmap v972: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:59:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-130", "mode": "writeback"} : dispatch 2024-09-21T17:59:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-130", "mode": "writeback"} : dispatch 2024-09-21T17:59:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:14 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-130", "mode": "writeback"}]': finished 2024-09-21T17:59:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:14 smithi162 ceph-mon[32106]: osdmap e635: 8 total, 8 up, 8 in 2024-09-21T17:59:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[29361]: pgmap v972: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:59:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-130", "mode": "writeback"} : dispatch 2024-09-21T17:59:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-130", "mode": "writeback"} : dispatch 2024-09-21T17:59:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:14.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-130", "mode": "writeback"}]': finished 2024-09-21T17:59:14.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[29361]: osdmap e635: 8 total, 8 up, 8 in 2024-09-21T17:59:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[38309]: pgmap v972: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T17:59:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-130", "mode": "writeback"} : dispatch 2024-09-21T17:59:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-130", "mode": "writeback"} : dispatch 2024-09-21T17:59:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-130", "mode": "writeback"}]': finished 2024-09-21T17:59:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:14 smithi042 ceph-mon[38309]: osdmap e635: 8 total, 8 up, 8 in 2024-09-21T17:59:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:15.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:15.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:16 smithi162 ceph-mon[32106]: pgmap v975: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:16 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:16 smithi162 ceph-mon[32106]: osdmap e636: 8 total, 8 up, 8 in 2024-09-21T17:59:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:16 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:16 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:16 smithi042 ceph-mon[29361]: pgmap v975: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:16 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:16 smithi042 ceph-mon[29361]: osdmap e636: 8 total, 8 up, 8 in 2024-09-21T17:59:16.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:16 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:16.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:16 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:16 smithi042 ceph-mon[38309]: pgmap v975: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:16 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:16 smithi042 ceph-mon[38309]: osdmap e636: 8 total, 8 up, 8 in 2024-09-21T17:59:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:16 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:16 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130"} : dispatch 2024-09-21T17:59:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:17 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130"}]': finished 2024-09-21T17:59:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:17 smithi162 ceph-mon[32106]: osdmap e637: 8 total, 8 up, 8 in 2024-09-21T17:59:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:17 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130"}]': finished 2024-09-21T17:59:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:17 smithi042 ceph-mon[29361]: osdmap e637: 8 total, 8 up, 8 in 2024-09-21T17:59:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:17 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-130"}]': finished 2024-09-21T17:59:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:17 smithi042 ceph-mon[38309]: osdmap e637: 8 total, 8 up, 8 in 2024-09-21T17:59:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:18 smithi162 ceph-mon[32106]: pgmap v978: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:18 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:18 smithi162 ceph-mon[32106]: osdmap e638: 8 total, 8 up, 8 in 2024-09-21T17:59:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:18 smithi042 ceph-mon[29361]: pgmap v978: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:18 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:18 smithi042 ceph-mon[29361]: osdmap e638: 8 total, 8 up, 8 in 2024-09-21T17:59:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:18 smithi042 ceph-mon[38309]: pgmap v978: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:18 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:18 smithi042 ceph-mon[38309]: osdmap e638: 8 total, 8 up, 8 in 2024-09-21T17:59:19.568 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:59:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:59:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:19 smithi162 ceph-mon[32106]: osdmap e639: 8 total, 8 up, 8 in 2024-09-21T17:59:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:19 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-132","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:19 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-132","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:19.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:19 smithi042 ceph-mon[29361]: osdmap e639: 8 total, 8 up, 8 in 2024-09-21T17:59:19.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:19 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-132","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:19.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:19 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-132","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:19 smithi042 ceph-mon[38309]: osdmap e639: 8 total, 8 up, 8 in 2024-09-21T17:59:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:19 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-132","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:19.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:19 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-132","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[29361]: pgmap v981: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[29361]: osdmap e640: 8 total, 8 up, 8 in 2024-09-21T17:59:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[38309]: pgmap v981: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[38309]: osdmap e640: 8 total, 8 up, 8 in 2024-09-21T17:59:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:20 smithi162 ceph-mon[32106]: pgmap v981: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:20 smithi162 ceph-mon[32106]: osdmap e640: 8 total, 8 up, 8 in 2024-09-21T17:59:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:21.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:21.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[29361]: osdmap e641: 8 total, 8 up, 8 in 2024-09-21T17:59:21.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"}]': finished 2024-09-21T17:59:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[29361]: osdmap e642: 8 total, 8 up, 8 in 2024-09-21T17:59:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[38309]: osdmap e641: 8 total, 8 up, 8 in 2024-09-21T17:59:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"}]': finished 2024-09-21T17:59:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:21 smithi042 ceph-mon[38309]: osdmap e642: 8 total, 8 up, 8 in 2024-09-21T17:59:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:21 smithi162 ceph-mon[32106]: osdmap e641: 8 total, 8 up, 8 in 2024-09-21T17:59:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"}]': finished 2024-09-21T17:59:22.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:21 smithi162 ceph-mon[32106]: osdmap e642: 8 total, 8 up, 8 in 2024-09-21T17:59:22.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:22 smithi042 ceph-mon[29361]: pgmap v984: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:22.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-132", "mode": "writeback"} : dispatch 2024-09-21T17:59:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-132", "mode": "writeback"} : dispatch 2024-09-21T17:59:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:22 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-132", "mode": "writeback"}]': finished 2024-09-21T17:59:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:22 smithi042 ceph-mon[38309]: pgmap v984: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-132", "mode": "writeback"} : dispatch 2024-09-21T17:59:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-132", "mode": "writeback"} : dispatch 2024-09-21T17:59:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:22 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-132", "mode": "writeback"}]': finished 2024-09-21T17:59:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:22 smithi162 ceph-mon[32106]: pgmap v984: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-132", "mode": "writeback"} : dispatch 2024-09-21T17:59:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-132", "mode": "writeback"} : dispatch 2024-09-21T17:59:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:22 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-132", "mode": "writeback"}]': finished 2024-09-21T17:59:23.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:23 smithi042 ceph-mon[29361]: osdmap e643: 8 total, 8 up, 8 in 2024-09-21T17:59:23.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:23 smithi042 ceph-mon[38309]: osdmap e643: 8 total, 8 up, 8 in 2024-09-21T17:59:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:23 smithi162 ceph-mon[32106]: osdmap e643: 8 total, 8 up, 8 in 2024-09-21T17:59:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:59:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:59:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:59:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[29361]: pgmap v987: 204 pgs: 204 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[29361]: osdmap e644: 8 total, 8 up, 8 in 2024-09-21T17:59:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:59:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:59:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:59:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:59:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[38309]: pgmap v987: 204 pgs: 204 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[38309]: osdmap e644: 8 total, 8 up, 8 in 2024-09-21T17:59:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:59:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:59:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:59:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:24 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:59:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:24 smithi162 ceph-mon[32106]: pgmap v987: 204 pgs: 204 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:24 smithi162 ceph-mon[32106]: osdmap e644: 8 total, 8 up, 8 in 2024-09-21T17:59:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T17:59:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:24 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T17:59:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T17:59:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:24 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:59:25.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:25 smithi042 ceph-mon[29361]: osdmap e645: 8 total, 8 up, 8 in 2024-09-21T17:59:25.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:25 smithi042 ceph-mon[38309]: osdmap e645: 8 total, 8 up, 8 in 2024-09-21T17:59:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:25 smithi162 ceph-mon[32106]: osdmap e645: 8 total, 8 up, 8 in 2024-09-21T17:59:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:26 smithi042 ceph-mon[29361]: pgmap v990: 204 pgs: 204 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:26 smithi042 ceph-mon[29361]: osdmap e646: 8 total, 8 up, 8 in 2024-09-21T17:59:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:26.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:26 smithi042 ceph-mon[38309]: pgmap v990: 204 pgs: 204 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:26.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:26.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:26 smithi042 ceph-mon[38309]: osdmap e646: 8 total, 8 up, 8 in 2024-09-21T17:59:26.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:26.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:26 smithi162 ceph-mon[32106]: pgmap v990: 204 pgs: 204 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T17:59:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:26 smithi162 ceph-mon[32106]: osdmap e646: 8 total, 8 up, 8 in 2024-09-21T17:59:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"}]': finished 2024-09-21T17:59:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:27 smithi042 ceph-mon[29361]: osdmap e647: 8 total, 8 up, 8 in 2024-09-21T17:59:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"}]': finished 2024-09-21T17:59:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:27 smithi042 ceph-mon[38309]: osdmap e647: 8 total, 8 up, 8 in 2024-09-21T17:59:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-132"}]': finished 2024-09-21T17:59:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:27 smithi162 ceph-mon[32106]: osdmap e647: 8 total, 8 up, 8 in 2024-09-21T17:59:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[29361]: pgmap v993: 204 pgs: 204 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[29361]: osdmap e648: 8 total, 8 up, 8 in 2024-09-21T17:59:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:59:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[38309]: pgmap v993: 204 pgs: 204 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[38309]: osdmap e648: 8 total, 8 up, 8 in 2024-09-21T17:59:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:59:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:28 smithi162 ceph-mon[32106]: pgmap v993: 204 pgs: 204 active+clean; 583 KiB data, 675 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:28 smithi162 ceph-mon[32106]: osdmap e648: 8 total, 8 up, 8 in 2024-09-21T17:59:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:59:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:29.576 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:59:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:59:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:29 smithi042 ceph-mon[29361]: osdmap e649: 8 total, 8 up, 8 in 2024-09-21T17:59:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:29 smithi042 ceph-mon[38309]: osdmap e649: 8 total, 8 up, 8 in 2024-09-21T17:59:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:29 smithi162 ceph-mon[32106]: osdmap e649: 8 total, 8 up, 8 in 2024-09-21T17:59:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132"} : dispatch 2024-09-21T17:59:30.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:30.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:30 smithi042 ceph-mon[29361]: pgmap v996: 204 pgs: 204 active+clean; 583 KiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:59:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:30 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132"}]': finished 2024-09-21T17:59:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:30 smithi042 ceph-mon[29361]: osdmap e650: 8 total, 8 up, 8 in 2024-09-21T17:59:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:30 smithi042 ceph-mon[38309]: pgmap v996: 204 pgs: 204 active+clean; 583 KiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:59:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:30 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132"}]': finished 2024-09-21T17:59:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:30 smithi042 ceph-mon[38309]: osdmap e650: 8 total, 8 up, 8 in 2024-09-21T17:59:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:30 smithi162 ceph-mon[32106]: pgmap v996: 204 pgs: 204 active+clean; 583 KiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T17:59:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:30 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-132"}]': finished 2024-09-21T17:59:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:30 smithi162 ceph-mon[32106]: osdmap e650: 8 total, 8 up, 8 in 2024-09-21T17:59:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:31 smithi042 ceph-mon[29361]: osdmap e651: 8 total, 8 up, 8 in 2024-09-21T17:59:31.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:31 smithi042 ceph-mon[29361]: pgmap v999: 172 pgs: 172 active+clean; 583 KiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:59:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:31 smithi042 ceph-mon[38309]: osdmap e651: 8 total, 8 up, 8 in 2024-09-21T17:59:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:31 smithi042 ceph-mon[38309]: pgmap v999: 172 pgs: 172 active+clean; 583 KiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:59:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:31 smithi162 ceph-mon[32106]: osdmap e651: 8 total, 8 up, 8 in 2024-09-21T17:59:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:31 smithi162 ceph-mon[32106]: pgmap v999: 172 pgs: 172 active+clean; 583 KiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T17:59:32.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:32 smithi042 ceph-mon[29361]: osdmap e652: 8 total, 8 up, 8 in 2024-09-21T17:59:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-134","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-134","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:32 smithi042 ceph-mon[38309]: osdmap e652: 8 total, 8 up, 8 in 2024-09-21T17:59:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-134","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-134","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:32 smithi162 ceph-mon[32106]: osdmap e652: 8 total, 8 up, 8 in 2024-09-21T17:59:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-134","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-134","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:33.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:33.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:33 smithi042 ceph-mon[38309]: osdmap e653: 8 total, 8 up, 8 in 2024-09-21T17:59:33.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:33.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:33.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:33 smithi042 ceph-mon[38309]: pgmap v1002: 204 pgs: 204 active+clean; 583 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T17:59:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:33 smithi042 ceph-mon[29361]: osdmap e653: 8 total, 8 up, 8 in 2024-09-21T17:59:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:33 smithi042 ceph-mon[29361]: pgmap v1002: 204 pgs: 204 active+clean; 583 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T17:59:33.916 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:59:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:59:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:59:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:33 smithi162 ceph-mon[32106]: osdmap e653: 8 total, 8 up, 8 in 2024-09-21T17:59:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:33 smithi162 ceph-mon[32106]: pgmap v1002: 204 pgs: 204 active+clean; 583 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T17:59:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[29361]: osdmap e654: 8 total, 8 up, 8 in 2024-09-21T17:59:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-134"}]': finished 2024-09-21T17:59:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[29361]: osdmap e655: 8 total, 8 up, 8 in 2024-09-21T17:59:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-134", "mode": "writeback"} : dispatch 2024-09-21T17:59:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-134", "mode": "writeback"} : dispatch 2024-09-21T17:59:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[38309]: osdmap e654: 8 total, 8 up, 8 in 2024-09-21T17:59:34.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:34.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:34.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-134"}]': finished 2024-09-21T17:59:34.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[38309]: osdmap e655: 8 total, 8 up, 8 in 2024-09-21T17:59:34.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-134", "mode": "writeback"} : dispatch 2024-09-21T17:59:34.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-134", "mode": "writeback"} : dispatch 2024-09-21T17:59:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:34 smithi162 ceph-mon[32106]: osdmap e654: 8 total, 8 up, 8 in 2024-09-21T17:59:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-134"}]': finished 2024-09-21T17:59:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:34 smithi162 ceph-mon[32106]: osdmap e655: 8 total, 8 up, 8 in 2024-09-21T17:59:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-134", "mode": "writeback"} : dispatch 2024-09-21T17:59:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-134", "mode": "writeback"} : dispatch 2024-09-21T17:59:35.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:35.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-134", "mode": "writeback"}]': finished 2024-09-21T17:59:35.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[29361]: osdmap e656: 8 total, 8 up, 8 in 2024-09-21T17:59:35.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:35.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:35.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[29361]: pgmap v1006: 204 pgs: 204 active+clean; 583 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T17:59:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-134", "mode": "writeback"}]': finished 2024-09-21T17:59:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[38309]: osdmap e656: 8 total, 8 up, 8 in 2024-09-21T17:59:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:35.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:35 smithi042 ceph-mon[38309]: pgmap v1006: 204 pgs: 204 active+clean; 583 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T17:59:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:35 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-134", "mode": "writeback"}]': finished 2024-09-21T17:59:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:35 smithi162 ceph-mon[32106]: osdmap e656: 8 total, 8 up, 8 in 2024-09-21T17:59:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:35 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:36.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:35 smithi162 ceph-mon[32106]: pgmap v1006: 204 pgs: 204 active+clean; 583 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T17:59:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:37 smithi162 ceph-mon[32106]: osdmap e657: 8 total, 8 up, 8 in 2024-09-21T17:59:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:37.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:37 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:37.598 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:37.598 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:37 smithi042 ceph-mon[29361]: osdmap e657: 8 total, 8 up, 8 in 2024-09-21T17:59:37.598 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:37.598 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:37 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:37.599 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:37.599 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:37 smithi042 ceph-mon[38309]: osdmap e657: 8 total, 8 up, 8 in 2024-09-21T17:59:37.599 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:37.599 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:37 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134"} : dispatch 2024-09-21T17:59:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:38 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:38 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134"}]': finished 2024-09-21T17:59:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:38 smithi162 ceph-mon[32106]: osdmap e658: 8 total, 8 up, 8 in 2024-09-21T17:59:38.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:38 smithi162 ceph-mon[32106]: pgmap v1009: 204 pgs: 204 active+clean; 583 KiB data, 698 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:38.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:38 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:38.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:38 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134"}]': finished 2024-09-21T17:59:38.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:38 smithi042 ceph-mon[29361]: osdmap e658: 8 total, 8 up, 8 in 2024-09-21T17:59:38.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:38 smithi042 ceph-mon[29361]: pgmap v1009: 204 pgs: 204 active+clean; 583 KiB data, 698 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:38 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:38 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-134"}]': finished 2024-09-21T17:59:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:38 smithi042 ceph-mon[38309]: osdmap e658: 8 total, 8 up, 8 in 2024-09-21T17:59:38.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:38 smithi042 ceph-mon[38309]: pgmap v1009: 204 pgs: 204 active+clean; 583 KiB data, 698 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:39.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:59:39 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:59:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:39 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:39.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:39 smithi162 ceph-mon[32106]: osdmap e659: 8 total, 8 up, 8 in 2024-09-21T17:59:39.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:39 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:39.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:39 smithi042 ceph-mon[29361]: osdmap e659: 8 total, 8 up, 8 in 2024-09-21T17:59:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:39 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:39.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:39 smithi042 ceph-mon[38309]: osdmap e659: 8 total, 8 up, 8 in 2024-09-21T17:59:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:40 smithi162 ceph-mon[32106]: osdmap e660: 8 total, 8 up, 8 in 2024-09-21T17:59:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:40 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-136","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-136","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:40.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:40 smithi162 ceph-mon[32106]: pgmap v1012: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:59:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:40 smithi042 ceph-mon[29361]: osdmap e660: 8 total, 8 up, 8 in 2024-09-21T17:59:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:40 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-136","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-136","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:40.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:40 smithi042 ceph-mon[29361]: pgmap v1012: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:59:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:40 smithi042 ceph-mon[38309]: osdmap e660: 8 total, 8 up, 8 in 2024-09-21T17:59:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:40 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-136","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-136","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:40 smithi042 ceph-mon[38309]: pgmap v1012: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:59:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:41 smithi162 ceph-mon[32106]: osdmap e661: 8 total, 8 up, 8 in 2024-09-21T17:59:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:41.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:41 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:41 smithi042 ceph-mon[29361]: osdmap e661: 8 total, 8 up, 8 in 2024-09-21T17:59:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:41.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:41 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:41 smithi042 ceph-mon[38309]: osdmap e661: 8 total, 8 up, 8 in 2024-09-21T17:59:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:41.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:41 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:42 smithi162 ceph-mon[32106]: osdmap e662: 8 total, 8 up, 8 in 2024-09-21T17:59:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:42 smithi162 ceph-mon[32106]: pgmap v1015: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:59:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:42 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-136"}]': finished 2024-09-21T17:59:42.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:42 smithi162 ceph-mon[32106]: osdmap e663: 8 total, 8 up, 8 in 2024-09-21T17:59:42.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:42.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[29361]: osdmap e662: 8 total, 8 up, 8 in 2024-09-21T17:59:42.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[29361]: pgmap v1015: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:59:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-136"}]': finished 2024-09-21T17:59:42.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[29361]: osdmap e663: 8 total, 8 up, 8 in 2024-09-21T17:59:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[38309]: osdmap e662: 8 total, 8 up, 8 in 2024-09-21T17:59:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[38309]: pgmap v1015: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T17:59:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-136"}]': finished 2024-09-21T17:59:42.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:42 smithi042 ceph-mon[38309]: osdmap e663: 8 total, 8 up, 8 in 2024-09-21T17:59:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-136", "mode": "writeback"} : dispatch 2024-09-21T17:59:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-136", "mode": "writeback"} : dispatch 2024-09-21T17:59:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:43 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:43 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-136", "mode": "writeback"}]': finished 2024-09-21T17:59:43.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:43 smithi162 ceph-mon[32106]: osdmap e664: 8 total, 8 up, 8 in 2024-09-21T17:59:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-136", "mode": "writeback"} : dispatch 2024-09-21T17:59:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-136", "mode": "writeback"} : dispatch 2024-09-21T17:59:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:43 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:43 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-136", "mode": "writeback"}]': finished 2024-09-21T17:59:43.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:43 smithi042 ceph-mon[29361]: osdmap e664: 8 total, 8 up, 8 in 2024-09-21T17:59:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-136", "mode": "writeback"} : dispatch 2024-09-21T17:59:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-136", "mode": "writeback"} : dispatch 2024-09-21T17:59:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:43 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T17:59:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:43 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-136", "mode": "writeback"}]': finished 2024-09-21T17:59:43.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:43 smithi042 ceph-mon[38309]: osdmap e664: 8 total, 8 up, 8 in 2024-09-21T17:59:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:59:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:59:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:59:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:44 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:44 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:44 smithi162 ceph-mon[32106]: pgmap v1018: 204 pgs: 204 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:44.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:44 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:44.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:44 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:44 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:44 smithi042 ceph-mon[29361]: pgmap v1018: 204 pgs: 204 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:44.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:44 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:44 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:44 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:44 smithi042 ceph-mon[38309]: pgmap v1018: 204 pgs: 204 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:44.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:44 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:45 smithi042 ceph-mon[29361]: osdmap e665: 8 total, 8 up, 8 in 2024-09-21T17:59:45.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:45.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:45 smithi042 ceph-mon[38309]: osdmap e665: 8 total, 8 up, 8 in 2024-09-21T17:59:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:45.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T17:59:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:45 smithi162 ceph-mon[32106]: osdmap e665: 8 total, 8 up, 8 in 2024-09-21T17:59:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136"} : dispatch 2024-09-21T17:59:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:46 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136"}]': finished 2024-09-21T17:59:46.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:46 smithi042 ceph-mon[29361]: osdmap e666: 8 total, 8 up, 8 in 2024-09-21T17:59:46.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:46 smithi042 ceph-mon[29361]: pgmap v1021: 204 pgs: 204 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:46 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136"}]': finished 2024-09-21T17:59:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:46 smithi042 ceph-mon[38309]: osdmap e666: 8 total, 8 up, 8 in 2024-09-21T17:59:46.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:46 smithi042 ceph-mon[38309]: pgmap v1021: 204 pgs: 204 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:46 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T17:59:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-136"}]': finished 2024-09-21T17:59:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:46 smithi162 ceph-mon[32106]: osdmap e666: 8 total, 8 up, 8 in 2024-09-21T17:59:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:46 smithi162 ceph-mon[32106]: pgmap v1021: 204 pgs: 204 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:47.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:47 smithi042 ceph-mon[29361]: osdmap e667: 8 total, 8 up, 8 in 2024-09-21T17:59:47.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:47 smithi042 ceph-mon[38309]: osdmap e667: 8 total, 8 up, 8 in 2024-09-21T17:59:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:47 smithi162 ceph-mon[32106]: osdmap e667: 8 total, 8 up, 8 in 2024-09-21T17:59:48.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:48 smithi042 ceph-mon[29361]: osdmap e668: 8 total, 8 up, 8 in 2024-09-21T17:59:48.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-138","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-138","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:48.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:48 smithi042 ceph-mon[29361]: pgmap v1024: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:48 smithi042 ceph-mon[38309]: osdmap e668: 8 total, 8 up, 8 in 2024-09-21T17:59:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-138","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-138","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:48.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:48 smithi042 ceph-mon[38309]: pgmap v1024: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:48 smithi162 ceph-mon[32106]: osdmap e668: 8 total, 8 up, 8 in 2024-09-21T17:59:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-138","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-138","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:48 smithi162 ceph-mon[32106]: pgmap v1024: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:49.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:59:49 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:59:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:49.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:49 smithi162 ceph-mon[32106]: osdmap e669: 8 total, 8 up, 8 in 2024-09-21T17:59:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:49.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:49 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:49.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:49.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:49 smithi042 ceph-mon[29361]: osdmap e669: 8 total, 8 up, 8 in 2024-09-21T17:59:49.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:49.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:49 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:49.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:49.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:49 smithi042 ceph-mon[38309]: osdmap e669: 8 total, 8 up, 8 in 2024-09-21T17:59:49.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:49.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:49.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:49 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:50.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[29361]: osdmap e670: 8 total, 8 up, 8 in 2024-09-21T17:59:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:59:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:59:50.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[29361]: pgmap v1027: 204 pgs: 5 creating+activating, 18 creating+peering, 181 active+clean; 4.4 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-21T17:59:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[38309]: osdmap e670: 8 total, 8 up, 8 in 2024-09-21T17:59:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:59:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:59:50.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:50 smithi042 ceph-mon[38309]: pgmap v1027: 204 pgs: 5 creating+activating, 18 creating+peering, 181 active+clean; 4.4 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-21T17:59:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T17:59:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:50 smithi162 ceph-mon[32106]: osdmap e670: 8 total, 8 up, 8 in 2024-09-21T17:59:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:59:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T17:59:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:50 smithi162 ceph-mon[32106]: pgmap v1027: 204 pgs: 5 creating+activating, 18 creating+peering, 181 active+clean; 4.4 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-21T17:59:51.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:59:51.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:51 smithi042 ceph-mon[29361]: osdmap e671: 8 total, 8 up, 8 in 2024-09-21T17:59:51.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:59:51.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:59:51.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:59:51.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:51 smithi042 ceph-mon[38309]: osdmap e671: 8 total, 8 up, 8 in 2024-09-21T17:59:51.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:59:51.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:59:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_count","val": "2"}]': finished 2024-09-21T17:59:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:51 smithi162 ceph-mon[32106]: osdmap e671: 8 total, 8 up, 8 in 2024-09-21T17:59:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:59:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T17:59:52.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:59:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:52 smithi042 ceph-mon[29361]: osdmap e672: 8 total, 8 up, 8 in 2024-09-21T17:59:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:59:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:59:52.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:52 smithi042 ceph-mon[29361]: pgmap v1030: 204 pgs: 5 creating+activating, 18 creating+peering, 181 active+clean; 4.4 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-21T17:59:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:59:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:52 smithi042 ceph-mon[38309]: osdmap e672: 8 total, 8 up, 8 in 2024-09-21T17:59:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:59:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:59:52.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:52 smithi042 ceph-mon[38309]: pgmap v1030: 204 pgs: 5 creating+activating, 18 creating+peering, 181 active+clean; 4.4 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-21T17:59:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_period","val": "600"}]': finished 2024-09-21T17:59:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:52 smithi162 ceph-mon[32106]: osdmap e672: 8 total, 8 up, 8 in 2024-09-21T17:59:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:59:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T17:59:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:52 smithi162 ceph-mon[32106]: pgmap v1030: 204 pgs: 5 creating+activating, 18 creating+peering, 181 active+clean; 4.4 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-21T17:59:53.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:59:53.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:53 smithi042 ceph-mon[29361]: osdmap e673: 8 total, 8 up, 8 in 2024-09-21T17:59:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:59:53.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:53 smithi042 ceph-mon[38309]: osdmap e673: 8 total, 8 up, 8 in 2024-09-21T17:59:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T17:59:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:53 smithi162 ceph-mon[32106]: osdmap e673: 8 total, 8 up, 8 in 2024-09-21T17:59:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 17:59:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:17:59:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T17:59:54.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:54.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:54.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138"} : dispatch 2024-09-21T17:59:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138"} : dispatch 2024-09-21T17:59:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[29361]: pgmap v1032: 204 pgs: 204 active+clean; 4.4 MiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:54.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138"} : dispatch 2024-09-21T17:59:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138"} : dispatch 2024-09-21T17:59:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[38309]: pgmap v1032: 204 pgs: 204 active+clean; 4.4 MiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:54.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:54 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T17:59:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138"} : dispatch 2024-09-21T17:59:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138"} : dispatch 2024-09-21T17:59:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:54 smithi162 ceph-mon[32106]: pgmap v1032: 204 pgs: 204 active+clean; 4.4 MiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:54 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T17:59:55.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138"}]': finished 2024-09-21T17:59:55.703 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:55 smithi042 ceph-mon[29361]: osdmap e674: 8 total, 8 up, 8 in 2024-09-21T17:59:55.703 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138"}]': finished 2024-09-21T17:59:55.704 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:55 smithi042 ceph-mon[38309]: osdmap e674: 8 total, 8 up, 8 in 2024-09-21T17:59:55.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-138"}]': finished 2024-09-21T17:59:55.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:55 smithi162 ceph-mon[32106]: osdmap e674: 8 total, 8 up, 8 in 2024-09-21T17:59:56.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:56 smithi042 ceph-mon[29361]: osdmap e675: 8 total, 8 up, 8 in 2024-09-21T17:59:56.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:56 smithi042 ceph-mon[29361]: pgmap v1035: 172 pgs: 172 active+clean; 4.4 MiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:56.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:56 smithi042 ceph-mon[38309]: osdmap e675: 8 total, 8 up, 8 in 2024-09-21T17:59:56.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:56 smithi042 ceph-mon[38309]: pgmap v1035: 172 pgs: 172 active+clean; 4.4 MiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:56.726 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:56 smithi162 ceph-mon[32106]: osdmap e675: 8 total, 8 up, 8 in 2024-09-21T17:59:56.726 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:56 smithi162 ceph-mon[32106]: pgmap v1035: 172 pgs: 172 active+clean; 4.4 MiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T17:59:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:57 smithi162 ceph-mon[32106]: osdmap e676: 8 total, 8 up, 8 in 2024-09-21T17:59:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-140","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-140","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:57 smithi042 ceph-mon[29361]: osdmap e676: 8 total, 8 up, 8 in 2024-09-21T17:59:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-140","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-140","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:57 smithi042 ceph-mon[38309]: osdmap e676: 8 total, 8 up, 8 in 2024-09-21T17:59:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-140","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-140","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T17:59:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:58 smithi162 ceph-mon[32106]: osdmap e677: 8 total, 8 up, 8 in 2024-09-21T17:59:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:58 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:58 smithi162 ceph-mon[32106]: pgmap v1038: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 715 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:58 smithi042 ceph-mon[29361]: osdmap e677: 8 total, 8 up, 8 in 2024-09-21T17:59:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:58 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:58 smithi042 ceph-mon[29361]: pgmap v1038: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 715 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T17:59:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:58 smithi042 ceph-mon[38309]: osdmap e677: 8 total, 8 up, 8 in 2024-09-21T17:59:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:58 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T17:59:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:58 smithi042 ceph-mon[38309]: pgmap v1038: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 715 MiB used, 715 GiB / 715 GiB avail 2024-09-21T17:59:59.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 17:59:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T17:59:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:59 smithi162 ceph-mon[32106]: osdmap e678: 8 total, 8 up, 8 in 2024-09-21T17:59:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:59 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:59:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:59 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:59:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:59:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 17:59:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:59.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:59.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[38309]: osdmap e678: 8 total, 8 up, 8 in 2024-09-21T17:59:59.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:59:59.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:59:59.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:59:59.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T17:59:59.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T17:59:59.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[29361]: osdmap e678: 8 total, 8 up, 8 in 2024-09-21T17:59:59.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:59:59.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T17:59:59.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T17:59:59.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 17:59:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_count","val": "3"}]': finished 2024-09-21T18:00:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: osdmap e679: 8 total, 8 up, 8 in 2024-09-21T18:00:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T18:00:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T18:00:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: pgmap v1041: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-09-21T18:00:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-09-21T18:00:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-21T18:00:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: application not enabled on pool 'test-rados-api-smithi042-71455-111' 2024-09-21T18:00:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-21T18:00:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_period","val": "3"}]': finished 2024-09-21T18:00:00.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:00 smithi162 ceph-mon[32106]: osdmap e680: 8 total, 8 up, 8 in 2024-09-21T18:00:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_count","val": "3"}]': finished 2024-09-21T18:00:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: osdmap e679: 8 total, 8 up, 8 in 2024-09-21T18:00:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T18:00:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T18:00:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: pgmap v1041: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-09-21T18:00:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-09-21T18:00:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-21T18:00:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: application not enabled on pool 'test-rados-api-smithi042-71455-111' 2024-09-21T18:00:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-21T18:00:00.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_period","val": "3"}]': finished 2024-09-21T18:00:00.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[29361]: osdmap e680: 8 total, 8 up, 8 in 2024-09-21T18:00:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_count","val": "3"}]': finished 2024-09-21T18:00:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: osdmap e679: 8 total, 8 up, 8 in 2024-09-21T18:00:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T18:00:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T18:00:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: pgmap v1041: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-09-21T18:00:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-09-21T18:00:00.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-21T18:00:00.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: application not enabled on pool 'test-rados-api-smithi042-71455-111' 2024-09-21T18:00:00.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-21T18:00:00.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_period","val": "3"}]': finished 2024-09-21T18:00:00.917 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:00 smithi042 ceph-mon[38309]: osdmap e680: 8 total, 8 up, 8 in 2024-09-21T18:00:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T18:00:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:01 smithi162 ceph-mon[32106]: osdmap e681: 8 total, 8 up, 8 in 2024-09-21T18:00:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:01 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T18:00:01.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:01 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T18:00:01.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:01.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:01.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T18:00:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[29361]: osdmap e681: 8 total, 8 up, 8 in 2024-09-21T18:00:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T18:00:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T18:00:01.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:01.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:01.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T18:00:01.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[38309]: osdmap e681: 8 total, 8 up, 8 in 2024-09-21T18:00:01.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T18:00:01.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:01 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T18:00:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:02 smithi162 ceph-mon[32106]: pgmap v1044: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:02 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T18:00:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:02 smithi162 ceph-mon[32106]: osdmap e682: 8 total, 8 up, 8 in 2024-09-21T18:00:02.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:02 smithi042 ceph-mon[29361]: pgmap v1044: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:02.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:02 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T18:00:02.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:02 smithi042 ceph-mon[29361]: osdmap e682: 8 total, 8 up, 8 in 2024-09-21T18:00:02.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:02 smithi042 ceph-mon[38309]: pgmap v1044: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:02.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:02 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T18:00:02.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:02 smithi042 ceph-mon[38309]: osdmap e682: 8 total, 8 up, 8 in 2024-09-21T18:00:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:00:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:00:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:00:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:04 smithi162 ceph-mon[32106]: pgmap v1046: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-09-21T18:00:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:04 smithi042 ceph-mon[29361]: pgmap v1046: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-09-21T18:00:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:04 smithi042 ceph-mon[38309]: pgmap v1046: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-09-21T18:00:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:06 smithi162 ceph-mon[32106]: pgmap v1047: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1.3 KiB/s wr, 0 op/s 2024-09-21T18:00:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:06 smithi042 ceph-mon[29361]: pgmap v1047: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1.3 KiB/s wr, 0 op/s 2024-09-21T18:00:06.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:06 smithi042 ceph-mon[38309]: pgmap v1047: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1.3 KiB/s wr, 0 op/s 2024-09-21T18:00:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:08 smithi162 ceph-mon[32106]: pgmap v1048: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 728 B/s rd, 1.1 KiB/s wr, 0 op/s 2024-09-21T18:00:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:08 smithi042 ceph-mon[29361]: pgmap v1048: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 728 B/s rd, 1.1 KiB/s wr, 0 op/s 2024-09-21T18:00:08.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:08 smithi042 ceph-mon[38309]: pgmap v1048: 204 pgs: 204 active+clean; 4.4 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 728 B/s rd, 1.1 KiB/s wr, 0 op/s 2024-09-21T18:00:09.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:00:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:00:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:10 smithi162 ceph-mon[32106]: pgmap v1049: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.1 KiB/s wr, 2 op/s 2024-09-21T18:00:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:10 smithi042 ceph-mon[29361]: pgmap v1049: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.1 KiB/s wr, 2 op/s 2024-09-21T18:00:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:10 smithi042 ceph-mon[38309]: pgmap v1049: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.1 KiB/s wr, 2 op/s 2024-09-21T18:00:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:12 smithi162 ceph-mon[32106]: pgmap v1050: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 4.9 KiB/s wr, 1 op/s 2024-09-21T18:00:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:12 smithi042 ceph-mon[29361]: pgmap v1050: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 4.9 KiB/s wr, 1 op/s 2024-09-21T18:00:12.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:12 smithi042 ceph-mon[38309]: pgmap v1050: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 4.9 KiB/s wr, 1 op/s 2024-09-21T18:00:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:13.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:00:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:00:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:00:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:14 smithi162 ceph-mon[32106]: pgmap v1051: 204 pgs: 204 active+clean; 4.5 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 8.3 KiB/s wr, 2 op/s 2024-09-21T18:00:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:14 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140"} : dispatch 2024-09-21T18:00:14.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140"} : dispatch 2024-09-21T18:00:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:14 smithi042 ceph-mon[29361]: pgmap v1051: 204 pgs: 204 active+clean; 4.5 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 8.3 KiB/s wr, 2 op/s 2024-09-21T18:00:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:14.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:14.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:14 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140"} : dispatch 2024-09-21T18:00:14.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140"} : dispatch 2024-09-21T18:00:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:14 smithi042 ceph-mon[38309]: pgmap v1051: 204 pgs: 204 active+clean; 4.5 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 8.3 KiB/s wr, 2 op/s 2024-09-21T18:00:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:14 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140"} : dispatch 2024-09-21T18:00:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140"} : dispatch 2024-09-21T18:00:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140"}]': finished 2024-09-21T18:00:15.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:15 smithi162 ceph-mon[32106]: osdmap e683: 8 total, 8 up, 8 in 2024-09-21T18:00:15.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140"}]': finished 2024-09-21T18:00:15.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:15 smithi042 ceph-mon[29361]: osdmap e683: 8 total, 8 up, 8 in 2024-09-21T18:00:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-140"}]': finished 2024-09-21T18:00:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:15 smithi042 ceph-mon[38309]: osdmap e683: 8 total, 8 up, 8 in 2024-09-21T18:00:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:16 smithi162 ceph-mon[32106]: pgmap v1053: 204 pgs: 204 active+clean; 4.5 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-09-21T18:00:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:16 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:16.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:16 smithi162 ceph-mon[32106]: osdmap e684: 8 total, 8 up, 8 in 2024-09-21T18:00:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:16 smithi042 ceph-mon[29361]: pgmap v1053: 204 pgs: 204 active+clean; 4.5 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-09-21T18:00:16.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:16 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:16.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:16 smithi042 ceph-mon[29361]: osdmap e684: 8 total, 8 up, 8 in 2024-09-21T18:00:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:16 smithi042 ceph-mon[38309]: pgmap v1053: 204 pgs: 204 active+clean; 4.5 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-09-21T18:00:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:16 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:16 smithi042 ceph-mon[38309]: osdmap e684: 8 total, 8 up, 8 in 2024-09-21T18:00:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:17 smithi162 ceph-mon[32106]: osdmap e685: 8 total, 8 up, 8 in 2024-09-21T18:00:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-142","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-142","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:00:17.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:17 smithi162 ceph-mon[32106]: osdmap e686: 8 total, 8 up, 8 in 2024-09-21T18:00:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:17 smithi042 ceph-mon[29361]: osdmap e685: 8 total, 8 up, 8 in 2024-09-21T18:00:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-142","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:17.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-142","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:17.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:00:17.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:17 smithi042 ceph-mon[29361]: osdmap e686: 8 total, 8 up, 8 in 2024-09-21T18:00:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:17 smithi042 ceph-mon[38309]: osdmap e685: 8 total, 8 up, 8 in 2024-09-21T18:00:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-142","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-142","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:00:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:17 smithi042 ceph-mon[38309]: osdmap e686: 8 total, 8 up, 8 in 2024-09-21T18:00:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:18 smithi162 ceph-mon[32106]: pgmap v1056: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:00:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:00:18.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:18 smithi162 ceph-mon[32106]: osdmap e687: 8 total, 8 up, 8 in 2024-09-21T18:00:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:18.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[29361]: pgmap v1056: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:00:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:00:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[29361]: osdmap e687: 8 total, 8 up, 8 in 2024-09-21T18:00:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[38309]: pgmap v1056: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:00:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:00:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[38309]: osdmap e687: 8 total, 8 up, 8 in 2024-09-21T18:00:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:19.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:00:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:00:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:20 smithi162 ceph-mon[32106]: pgmap v1059: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T18:00:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-142"}]': finished 2024-09-21T18:00:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:20 smithi162 ceph-mon[32106]: osdmap e688: 8 total, 8 up, 8 in 2024-09-21T18:00:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-142", "mode": "writeback"} : dispatch 2024-09-21T18:00:20.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-142", "mode": "writeback"} : dispatch 2024-09-21T18:00:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[29361]: pgmap v1059: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T18:00:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-142"}]': finished 2024-09-21T18:00:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[29361]: osdmap e688: 8 total, 8 up, 8 in 2024-09-21T18:00:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-142", "mode": "writeback"} : dispatch 2024-09-21T18:00:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-142", "mode": "writeback"} : dispatch 2024-09-21T18:00:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[38309]: pgmap v1059: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T18:00:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-142"}]': finished 2024-09-21T18:00:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[38309]: osdmap e688: 8 total, 8 up, 8 in 2024-09-21T18:00:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-142", "mode": "writeback"} : dispatch 2024-09-21T18:00:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-142", "mode": "writeback"} : dispatch 2024-09-21T18:00:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:21 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T18:00:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-142", "mode": "writeback"}]': finished 2024-09-21T18:00:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:21 smithi162 ceph-mon[32106]: osdmap e689: 8 total, 8 up, 8 in 2024-09-21T18:00:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:21.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:21.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:21 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T18:00:21.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-142", "mode": "writeback"}]': finished 2024-09-21T18:00:21.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:21 smithi042 ceph-mon[29361]: osdmap e689: 8 total, 8 up, 8 in 2024-09-21T18:00:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:21 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T18:00:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-142", "mode": "writeback"}]': finished 2024-09-21T18:00:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:21 smithi042 ceph-mon[38309]: osdmap e689: 8 total, 8 up, 8 in 2024-09-21T18:00:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:22.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:22 smithi042 ceph-mon[29361]: pgmap v1062: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T18:00:22.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_count","val": "2"}]': finished 2024-09-21T18:00:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:22 smithi042 ceph-mon[29361]: osdmap e690: 8 total, 8 up, 8 in 2024-09-21T18:00:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:22.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:22 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:22 smithi042 ceph-mon[38309]: pgmap v1062: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T18:00:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_count","val": "2"}]': finished 2024-09-21T18:00:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:22 smithi042 ceph-mon[38309]: osdmap e690: 8 total, 8 up, 8 in 2024-09-21T18:00:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:22 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:22 smithi162 ceph-mon[32106]: pgmap v1062: 204 pgs: 204 active+clean; 4.4 MiB data, 718 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T18:00:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_count","val": "2"}]': finished 2024-09-21T18:00:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:22 smithi162 ceph-mon[32106]: osdmap e690: 8 total, 8 up, 8 in 2024-09-21T18:00:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:22 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:23.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_period","val": "600"}]': finished 2024-09-21T18:00:23.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[29361]: osdmap e691: 8 total, 8 up, 8 in 2024-09-21T18:00:23.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:23.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:23.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T18:00:23.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T18:00:23.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[29361]: osdmap e692: 8 total, 8 up, 8 in 2024-09-21T18:00:23.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_period","val": "600"}]': finished 2024-09-21T18:00:23.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[38309]: osdmap e691: 8 total, 8 up, 8 in 2024-09-21T18:00:23.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:23.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:23.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T18:00:23.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T18:00:23.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-mon[38309]: osdmap e692: 8 total, 8 up, 8 in 2024-09-21T18:00:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_period","val": "600"}]': finished 2024-09-21T18:00:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:23 smithi162 ceph-mon[32106]: osdmap e691: 8 total, 8 up, 8 in 2024-09-21T18:00:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:23 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:23 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T18:00:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T18:00:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:23 smithi162 ceph-mon[32106]: osdmap e692: 8 total, 8 up, 8 in 2024-09-21T18:00:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:00:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:00:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:00:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[29361]: pgmap v1065: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T18:00:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[29361]: osdmap e693: 8 total, 8 up, 8 in 2024-09-21T18:00:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[38309]: pgmap v1065: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T18:00:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:24 smithi042 ceph-mon[38309]: osdmap e693: 8 total, 8 up, 8 in 2024-09-21T18:00:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:24 smithi162 ceph-mon[32106]: pgmap v1065: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:24 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T18:00:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:24 smithi162 ceph-mon[32106]: osdmap e693: 8 total, 8 up, 8 in 2024-09-21T18:00:25.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T18:00:25.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T18:00:25.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[29361]: osdmap e694: 8 total, 8 up, 8 in 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:00:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:00:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T18:00:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[38309]: osdmap e694: 8 total, 8 up, 8 in 2024-09-21T18:00:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T18:00:25.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:25 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T18:00:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T18:00:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T18:00:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:25 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:00:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:25 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:00:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:25 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:00:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:25 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:00:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T18:00:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:25 smithi162 ceph-mon[32106]: osdmap e694: 8 total, 8 up, 8 in 2024-09-21T18:00:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:25 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T18:00:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:25 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T18:00:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:26 smithi042 ceph-mon[29361]: pgmap v1068: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T18:00:26.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:26 smithi042 ceph-mon[29361]: osdmap e695: 8 total, 8 up, 8 in 2024-09-21T18:00:26.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:26 smithi042 ceph-mon[38309]: pgmap v1068: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:26.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T18:00:26.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:26 smithi042 ceph-mon[38309]: osdmap e695: 8 total, 8 up, 8 in 2024-09-21T18:00:26.976 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:26 smithi162 ceph-mon[32106]: pgmap v1068: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:26.976 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T18:00:26.976 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:26 smithi162 ceph-mon[32106]: osdmap e695: 8 total, 8 up, 8 in 2024-09-21T18:00:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[29361]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail 2024-09-21T18:00:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:00:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[29361]: osdmap e696: 8 total, 8 up, 8 in 2024-09-21T18:00:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[38309]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail 2024-09-21T18:00:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:00:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[38309]: osdmap e696: 8 total, 8 up, 8 in 2024-09-21T18:00:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:28 smithi162 ceph-mon[32106]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail 2024-09-21T18:00:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:00:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:28 smithi162 ceph-mon[32106]: osdmap e696: 8 total, 8 up, 8 in 2024-09-21T18:00:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:29.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:00:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:00:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"}]': finished 2024-09-21T18:00:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:29 smithi162 ceph-mon[32106]: osdmap e697: 8 total, 8 up, 8 in 2024-09-21T18:00:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:29.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:29.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:29.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"}]': finished 2024-09-21T18:00:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[29361]: osdmap e697: 8 total, 8 up, 8 in 2024-09-21T18:00:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:29.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"}]': finished 2024-09-21T18:00:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[38309]: osdmap e697: 8 total, 8 up, 8 in 2024-09-21T18:00:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-142"} : dispatch 2024-09-21T18:00:30.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:30 smithi042 ceph-mon[29361]: pgmap v1074: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T18:00:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:30 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:30.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:30 smithi042 ceph-mon[29361]: osdmap e698: 8 total, 8 up, 8 in 2024-09-21T18:00:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:30 smithi042 ceph-mon[38309]: pgmap v1074: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T18:00:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:30 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:30 smithi042 ceph-mon[38309]: osdmap e698: 8 total, 8 up, 8 in 2024-09-21T18:00:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:30 smithi162 ceph-mon[32106]: pgmap v1074: 204 pgs: 204 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T18:00:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:30 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:30 smithi162 ceph-mon[32106]: osdmap e698: 8 total, 8 up, 8 in 2024-09-21T18:00:31.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:31 smithi042 ceph-mon[29361]: osdmap e699: 8 total, 8 up, 8 in 2024-09-21T18:00:31.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-144","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:31.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-144","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:31 smithi042 ceph-mon[38309]: osdmap e699: 8 total, 8 up, 8 in 2024-09-21T18:00:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-144","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:31.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-144","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:31 smithi162 ceph-mon[32106]: osdmap e699: 8 total, 8 up, 8 in 2024-09-21T18:00:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-144","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-144","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:32 smithi042 ceph-mon[29361]: pgmap v1077: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T18:00:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:00:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:32 smithi042 ceph-mon[29361]: osdmap e700: 8 total, 8 up, 8 in 2024-09-21T18:00:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:32.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:32 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:32 smithi042 ceph-mon[38309]: pgmap v1077: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T18:00:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:00:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:32 smithi042 ceph-mon[38309]: osdmap e700: 8 total, 8 up, 8 in 2024-09-21T18:00:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:32.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:32 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:32 smithi162 ceph-mon[32106]: pgmap v1077: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T18:00:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:00:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:32 smithi162 ceph-mon[32106]: osdmap e700: 8 total, 8 up, 8 in 2024-09-21T18:00:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:32 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:33.914 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:00:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:00:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:00:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:00:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:33 smithi042 ceph-mon[29361]: osdmap e701: 8 total, 8 up, 8 in 2024-09-21T18:00:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:33.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:33 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:33.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:00:33.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:33 smithi042 ceph-mon[38309]: osdmap e701: 8 total, 8 up, 8 in 2024-09-21T18:00:33.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:33.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:33 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:00:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:33 smithi162 ceph-mon[32106]: osdmap e701: 8 total, 8 up, 8 in 2024-09-21T18:00:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:33 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:34.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:34 smithi042 ceph-mon[29361]: pgmap v1080: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T18:00:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-144"}]': finished 2024-09-21T18:00:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:34 smithi042 ceph-mon[29361]: osdmap e702: 8 total, 8 up, 8 in 2024-09-21T18:00:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:34 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-144", "mode": "readproxy"} : dispatch 2024-09-21T18:00:34.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:34 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-144", "mode": "readproxy"} : dispatch 2024-09-21T18:00:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:34 smithi042 ceph-mon[38309]: pgmap v1080: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T18:00:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-144"}]': finished 2024-09-21T18:00:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:34 smithi042 ceph-mon[38309]: osdmap e702: 8 total, 8 up, 8 in 2024-09-21T18:00:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:34 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-144", "mode": "readproxy"} : dispatch 2024-09-21T18:00:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:34 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-144", "mode": "readproxy"} : dispatch 2024-09-21T18:00:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:34 smithi162 ceph-mon[32106]: pgmap v1080: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T18:00:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-144"}]': finished 2024-09-21T18:00:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:34 smithi162 ceph-mon[32106]: osdmap e702: 8 total, 8 up, 8 in 2024-09-21T18:00:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:34 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-144", "mode": "readproxy"} : dispatch 2024-09-21T18:00:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:34 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-144", "mode": "readproxy"} : dispatch 2024-09-21T18:00:35.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:35 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T18:00:35.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:35 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-144", "mode": "readproxy"}]': finished 2024-09-21T18:00:35.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:35 smithi042 ceph-mon[29361]: osdmap e703: 8 total, 8 up, 8 in 2024-09-21T18:00:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:35 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T18:00:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:35 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-144", "mode": "readproxy"}]': finished 2024-09-21T18:00:35.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:35 smithi042 ceph-mon[38309]: osdmap e703: 8 total, 8 up, 8 in 2024-09-21T18:00:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:35 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T18:00:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:35 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-144", "mode": "readproxy"}]': finished 2024-09-21T18:00:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:35 smithi162 ceph-mon[32106]: osdmap e703: 8 total, 8 up, 8 in 2024-09-21T18:00:36.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:36 smithi042 ceph-mon[29361]: pgmap v1083: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T18:00:36.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:36 smithi042 ceph-mon[38309]: pgmap v1083: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T18:00:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:36 smithi162 ceph-mon[32106]: pgmap v1083: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T18:00:37.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:37 smithi042 ceph-mon[29361]: pgmap v1084: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 876 B/s rd, 175 B/s wr, 1 op/s 2024-09-21T18:00:37.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:37 smithi042 ceph-mon[38309]: pgmap v1084: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 876 B/s rd, 175 B/s wr, 1 op/s 2024-09-21T18:00:38.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:37 smithi162 ceph-mon[32106]: pgmap v1084: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 876 B/s rd, 175 B/s wr, 1 op/s 2024-09-21T18:00:39.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:39 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:39.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:39 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:39 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:39.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:00:39 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:00:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:40.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:40 smithi042 ceph-mon[29361]: pgmap v1085: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 149 B/s wr, 1 op/s 2024-09-21T18:00:40.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:40.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:40 smithi042 ceph-mon[38309]: pgmap v1085: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 149 B/s wr, 1 op/s 2024-09-21T18:00:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:40 smithi162 ceph-mon[32106]: pgmap v1085: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 149 B/s wr, 1 op/s 2024-09-21T18:00:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:42 smithi162 ceph-mon[32106]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T18:00:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:42 smithi042 ceph-mon[29361]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T18:00:42.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:42 smithi042 ceph-mon[38309]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T18:00:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:00:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:00:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:00:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:44 smithi162 ceph-mon[32106]: pgmap v1087: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T18:00:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:44 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:00:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:44 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:44.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:44 smithi042 ceph-mon[29361]: pgmap v1087: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T18:00:44.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:44 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:00:44.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:44 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:44 smithi042 ceph-mon[38309]: pgmap v1087: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T18:00:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:44 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:00:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:44 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:45.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:45 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:45.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:45.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:45 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:45.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:45.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:45 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:46 smithi162 ceph-mon[32106]: pgmap v1088: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T18:00:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:00:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:46 smithi162 ceph-mon[32106]: osdmap e704: 8 total, 8 up, 8 in 2024-09-21T18:00:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:46 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:46 smithi042 ceph-mon[29361]: pgmap v1088: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T18:00:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:00:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:46 smithi042 ceph-mon[29361]: osdmap e704: 8 total, 8 up, 8 in 2024-09-21T18:00:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:46.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:46 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:46 smithi042 ceph-mon[38309]: pgmap v1088: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T18:00:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:00:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:46 smithi042 ceph-mon[38309]: osdmap e704: 8 total, 8 up, 8 in 2024-09-21T18:00:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:46.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:46 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:47 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T18:00:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"}]': finished 2024-09-21T18:00:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:47 smithi162 ceph-mon[32106]: osdmap e705: 8 total, 8 up, 8 in 2024-09-21T18:00:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:47.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:47 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:47.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T18:00:47.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"}]': finished 2024-09-21T18:00:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[29361]: osdmap e705: 8 total, 8 up, 8 in 2024-09-21T18:00:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:47.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:47.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T18:00:47.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"}]': finished 2024-09-21T18:00:47.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[38309]: osdmap e705: 8 total, 8 up, 8 in 2024-09-21T18:00:47.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:47.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:00:47.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:47.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:47 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-144"} : dispatch 2024-09-21T18:00:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:48 smithi162 ceph-mon[32106]: pgmap v1091: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T18:00:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:48 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:48 smithi162 ceph-mon[32106]: osdmap e706: 8 total, 8 up, 8 in 2024-09-21T18:00:48.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:48 smithi042 ceph-mon[29361]: pgmap v1091: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T18:00:48.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:48 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:48.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:48 smithi042 ceph-mon[29361]: osdmap e706: 8 total, 8 up, 8 in 2024-09-21T18:00:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:48 smithi042 ceph-mon[38309]: pgmap v1091: 204 pgs: 204 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T18:00:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:48 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:48.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:48 smithi042 ceph-mon[38309]: osdmap e706: 8 total, 8 up, 8 in 2024-09-21T18:00:49.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:00:49 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:00:49.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:49 smithi162 ceph-mon[32106]: osdmap e707: 8 total, 8 up, 8 in 2024-09-21T18:00:49.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-146","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:49.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-146","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:49.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:49 smithi042 ceph-mon[29361]: osdmap e707: 8 total, 8 up, 8 in 2024-09-21T18:00:49.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-146","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:49.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-146","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:49.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:49 smithi042 ceph-mon[38309]: osdmap e707: 8 total, 8 up, 8 in 2024-09-21T18:00:49.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-146","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:49.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-146","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:00:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:50 smithi162 ceph-mon[32106]: pgmap v1094: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:00:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:50 smithi162 ceph-mon[32106]: osdmap e708: 8 total, 8 up, 8 in 2024-09-21T18:00:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:50 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[29361]: pgmap v1094: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:00:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[29361]: osdmap e708: 8 total, 8 up, 8 in 2024-09-21T18:00:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:50.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:00:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[38309]: pgmap v1094: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:00:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[38309]: osdmap e708: 8 total, 8 up, 8 in 2024-09-21T18:00:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:00:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:00:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:51 smithi162 ceph-mon[32106]: osdmap e709: 8 total, 8 up, 8 in 2024-09-21T18:00:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:51 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:00:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:00:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:51 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-146"}]': finished 2024-09-21T18:00:51.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:51 smithi162 ceph-mon[32106]: osdmap e710: 8 total, 8 up, 8 in 2024-09-21T18:00:51.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:00:51.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[29361]: osdmap e709: 8 total, 8 up, 8 in 2024-09-21T18:00:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:00:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:00:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-146"}]': finished 2024-09-21T18:00:51.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[29361]: osdmap e710: 8 total, 8 up, 8 in 2024-09-21T18:00:51.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:00:51.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[38309]: osdmap e709: 8 total, 8 up, 8 in 2024-09-21T18:00:51.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:00:51.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:00:51.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi042-71455-111", "overlaypool": "test-rados-api-smithi042-71455-146"}]': finished 2024-09-21T18:00:51.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:51 smithi042 ceph-mon[38309]: osdmap e710: 8 total, 8 up, 8 in 2024-09-21T18:00:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:52 smithi162 ceph-mon[32106]: pgmap v1097: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:52 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-146", "mode": "writeback"} : dispatch 2024-09-21T18:00:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-146", "mode": "writeback"} : dispatch 2024-09-21T18:00:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:52 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T18:00:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:52 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-146", "mode": "writeback"}]': finished 2024-09-21T18:00:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:52 smithi162 ceph-mon[32106]: osdmap e711: 8 total, 8 up, 8 in 2024-09-21T18:00:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[29361]: pgmap v1097: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-146", "mode": "writeback"} : dispatch 2024-09-21T18:00:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-146", "mode": "writeback"} : dispatch 2024-09-21T18:00:52.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T18:00:52.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-146", "mode": "writeback"}]': finished 2024-09-21T18:00:52.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[29361]: osdmap e711: 8 total, 8 up, 8 in 2024-09-21T18:00:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[38309]: pgmap v1097: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:00:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-146", "mode": "writeback"} : dispatch 2024-09-21T18:00:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-146", "mode": "writeback"} : dispatch 2024-09-21T18:00:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T18:00:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi042-71455-146", "mode": "writeback"}]': finished 2024-09-21T18:00:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:52 smithi042 ceph-mon[38309]: osdmap e711: 8 total, 8 up, 8 in 2024-09-21T18:00:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:53 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:53.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:53 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:53.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:53 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:53.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:53 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:53.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:53 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:53.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:53 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T18:00:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:00:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:00:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:00:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:54 smithi162 ceph-mon[32106]: pgmap v1100: 204 pgs: 204 active+clean; 4.4 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T18:00:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_count","val": "2"}]': finished 2024-09-21T18:00:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:54 smithi162 ceph-mon[32106]: osdmap e712: 8 total, 8 up, 8 in 2024-09-21T18:00:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:54 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:54 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:54 smithi162 ceph-mon[32106]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[29361]: pgmap v1100: 204 pgs: 204 active+clean; 4.4 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T18:00:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_count","val": "2"}]': finished 2024-09-21T18:00:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[29361]: osdmap e712: 8 total, 8 up, 8 in 2024-09-21T18:00:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[29361]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[38309]: pgmap v1100: 204 pgs: 204 active+clean; 4.4 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T18:00:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_count","val": "2"}]': finished 2024-09-21T18:00:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[38309]: osdmap e712: 8 total, 8 up, 8 in 2024-09-21T18:00:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T18:00:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:54 smithi042 ceph-mon[38309]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:00:55.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_period","val": "600"}]': finished 2024-09-21T18:00:55.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:55 smithi162 ceph-mon[32106]: osdmap e713: 8 total, 8 up, 8 in 2024-09-21T18:00:55.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:55 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:55.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:55 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:55.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_period","val": "600"}]': finished 2024-09-21T18:00:55.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:55 smithi042 ceph-mon[29361]: osdmap e713: 8 total, 8 up, 8 in 2024-09-21T18:00:55.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:55 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:55.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:55 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_period","val": "600"}]': finished 2024-09-21T18:00:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:55 smithi042 ceph-mon[38309]: osdmap e713: 8 total, 8 up, 8 in 2024-09-21T18:00:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:55 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:55.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:55 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T18:00:56.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[29361]: pgmap v1103: 204 pgs: 204 active+clean; 4.4 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T18:00:56.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T18:00:56.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T18:00:56.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[29361]: osdmap e714: 8 total, 8 up, 8 in 2024-09-21T18:00:56.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:56.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:56.816 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[38309]: pgmap v1103: 204 pgs: 204 active+clean; 4.4 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T18:00:56.816 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T18:00:56.816 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T18:00:56.816 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[38309]: osdmap e714: 8 total, 8 up, 8 in 2024-09-21T18:00:56.817 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:56.817 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:56 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:56 smithi162 ceph-mon[32106]: pgmap v1103: 204 pgs: 204 active+clean; 4.4 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-21T18:00:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:56 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T18:00:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T18:00:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:56 smithi162 ceph-mon[32106]: osdmap e714: 8 total, 8 up, 8 in 2024-09-21T18:00:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:56 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:56 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T18:00:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T18:00:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:57 smithi162 ceph-mon[32106]: osdmap e715: 8 total, 8 up, 8 in 2024-09-21T18:00:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:57 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T18:00:57.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:57 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T18:00:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T18:00:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:57 smithi042 ceph-mon[29361]: osdmap e715: 8 total, 8 up, 8 in 2024-09-21T18:00:57.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:57 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T18:00:57.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:57 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T18:00:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T18:00:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:57 smithi042 ceph-mon[38309]: osdmap e715: 8 total, 8 up, 8 in 2024-09-21T18:00:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:57 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T18:00:57.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:57 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T18:00:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:58 smithi162 ceph-mon[32106]: pgmap v1106: 204 pgs: 204 active+clean; 4.4 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:00:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:58 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "target_max_objects","val": "1"}]': finished 2024-09-21T18:00:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:58 smithi162 ceph-mon[32106]: osdmap e716: 8 total, 8 up, 8 in 2024-09-21T18:00:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:00:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:00:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:58 smithi042 ceph-mon[29361]: pgmap v1106: 204 pgs: 204 active+clean; 4.4 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:00:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:58 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "target_max_objects","val": "1"}]': finished 2024-09-21T18:00:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:58 smithi042 ceph-mon[29361]: osdmap e716: 8 total, 8 up, 8 in 2024-09-21T18:00:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:00:58.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:00:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:58 smithi042 ceph-mon[38309]: pgmap v1106: 204 pgs: 204 active+clean; 4.4 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:00:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:58 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-146","var": "target_max_objects","val": "1"}]': finished 2024-09-21T18:00:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:58 smithi042 ceph-mon[38309]: osdmap e716: 8 total, 8 up, 8 in 2024-09-21T18:00:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:00:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:00:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:00:59.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:00:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:01:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:00.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:00 smithi162 ceph-mon[32106]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:00.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:00.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:00 smithi042 ceph-mon[29361]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:00.664 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:00.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:00 smithi042 ceph-mon[38309]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:01.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:01 smithi162 ceph-mon[32106]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T18:01:01.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:01 smithi042 ceph-mon[29361]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T18:01:01.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:01 smithi042 ceph-mon[38309]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T18:01:02.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:02 smithi162 ceph-mon[32106]: pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:02.664 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:02 smithi042 ceph-mon[29361]: pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:02.665 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:02 smithi042 ceph-mon[38309]: pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:01:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:01:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:01:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:04 smithi162 ceph-mon[32106]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:04 smithi042 ceph-mon[29361]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:04.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:04 smithi042 ceph-mon[38309]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:06.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:06 smithi162 ceph-mon[32106]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:06 smithi042 ceph-mon[29361]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:06.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:06 smithi042 ceph-mon[38309]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:08 smithi162 ceph-mon[32106]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:08 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:08.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:08 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:08 smithi042 ceph-mon[29361]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:08 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:08.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:08 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:08 smithi042 ceph-mon[38309]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T18:01:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:08 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:08.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:08 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:09.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:01:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:01:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:01:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:09 smithi162 ceph-mon[32106]: osdmap e717: 8 total, 8 up, 8 in 2024-09-21T18:01:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:09 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:09 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:01:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:09 smithi042 ceph-mon[29361]: osdmap e717: 8 total, 8 up, 8 in 2024-09-21T18:01:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:09 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:09.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:09 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:01:09.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:09 smithi042 ceph-mon[38309]: osdmap e717: 8 total, 8 up, 8 in 2024-09-21T18:01:09.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:09 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:09.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:09 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:10 smithi162 ceph-mon[32106]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T18:01:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"}]': finished 2024-09-21T18:01:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:10 smithi162 ceph-mon[32106]: osdmap e718: 8 total, 8 up, 8 in 2024-09-21T18:01:10.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:10.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:10.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:10 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:10.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:10 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[29361]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T18:01:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"}]': finished 2024-09-21T18:01:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[29361]: osdmap e718: 8 total, 8 up, 8 in 2024-09-21T18:01:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[38309]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T18:01:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"}]': finished 2024-09-21T18:01:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[38309]: osdmap e718: 8 total, 8 up, 8 in 2024-09-21T18:01:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:10.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:10.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:10.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:10 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-146"} : dispatch 2024-09-21T18:01:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:11 smithi162 ceph-mon[32106]: osdmap e719: 8 total, 8 up, 8 in 2024-09-21T18:01:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:11 smithi162 ceph-mon[32106]: osdmap e720: 8 total, 8 up, 8 in 2024-09-21T18:01:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:11 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-148","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:11.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:11 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-148","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:11.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:11 smithi042 ceph-mon[29361]: osdmap e719: 8 total, 8 up, 8 in 2024-09-21T18:01:11.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:11 smithi042 ceph-mon[29361]: osdmap e720: 8 total, 8 up, 8 in 2024-09-21T18:01:11.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:11 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-148","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:11.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:11 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-148","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:11 smithi042 ceph-mon[38309]: osdmap e719: 8 total, 8 up, 8 in 2024-09-21T18:01:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:11 smithi042 ceph-mon[38309]: osdmap e720: 8 total, 8 up, 8 in 2024-09-21T18:01:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:11 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-148","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:11.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:11 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-148","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:12 smithi162 ceph-mon[32106]: pgmap v1117: 172 pgs: 172 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-21T18:01:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:12 smithi162 ceph-mon[32106]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T18:01:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:12 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:12.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:12 smithi162 ceph-mon[32106]: osdmap e721: 8 total, 8 up, 8 in 2024-09-21T18:01:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:12 smithi042 ceph-mon[29361]: pgmap v1117: 172 pgs: 172 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-21T18:01:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:12 smithi042 ceph-mon[29361]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T18:01:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:12 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:12.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:12 smithi042 ceph-mon[29361]: osdmap e721: 8 total, 8 up, 8 in 2024-09-21T18:01:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:12 smithi042 ceph-mon[38309]: pgmap v1117: 172 pgs: 172 active+clean; 4.4 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-21T18:01:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:12 smithi042 ceph-mon[38309]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T18:01:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:12 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:12 smithi042 ceph-mon[38309]: osdmap e721: 8 total, 8 up, 8 in 2024-09-21T18:01:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:01:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:01:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:01:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:13 smithi162 ceph-mon[32106]: osdmap e722: 8 total, 8 up, 8 in 2024-09-21T18:01:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:13 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:13.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:13 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:13.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:01:13.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:01:13.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:13.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:01:13.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[38309]: osdmap e722: 8 total, 8 up, 8 in 2024-09-21T18:01:13.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:13.880 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:13.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:01:13.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T18:01:13.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:13.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T18:01:13.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[29361]: osdmap e722: 8 total, 8 up, 8 in 2024-09-21T18:01:13.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:13.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:01:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:01:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:01:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:14 smithi162 ceph-mon[32106]: pgmap v1120: 204 pgs: 204 active+clean; 4.4 MiB data, 766 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:14 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"}]': finished 2024-09-21T18:01:14.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:14 smithi162 ceph-mon[32106]: osdmap e723: 8 total, 8 up, 8 in 2024-09-21T18:01:14.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:14 smithi042 ceph-mon[38309]: pgmap v1120: 204 pgs: 204 active+clean; 4.4 MiB data, 766 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:14 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"}]': finished 2024-09-21T18:01:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:14 smithi042 ceph-mon[38309]: osdmap e723: 8 total, 8 up, 8 in 2024-09-21T18:01:14.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:14 smithi042 ceph-mon[29361]: pgmap v1120: 204 pgs: 204 active+clean; 4.4 MiB data, 766 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:14.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:14 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"}]': finished 2024-09-21T18:01:14.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:14 smithi042 ceph-mon[29361]: osdmap e723: 8 total, 8 up, 8 in 2024-09-21T18:01:15.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:15.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:15.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:15 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:15.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:15 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:15.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:15.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:15.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:15 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:15.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:15 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:16.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:16.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:16.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:15 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:16.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:15 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-148"} : dispatch 2024-09-21T18:01:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:16 smithi042 ceph-mon[29361]: pgmap v1123: 204 pgs: 204 active+clean; 4.4 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T18:01:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:16 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:01:16.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:16 smithi042 ceph-mon[29361]: osdmap e724: 8 total, 8 up, 8 in 2024-09-21T18:01:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:16 smithi042 ceph-mon[38309]: pgmap v1123: 204 pgs: 204 active+clean; 4.4 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T18:01:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:16 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:01:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:16 smithi042 ceph-mon[38309]: osdmap e724: 8 total, 8 up, 8 in 2024-09-21T18:01:17.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:16 smithi162 ceph-mon[32106]: pgmap v1123: 204 pgs: 204 active+clean; 4.4 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T18:01:17.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:16 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:01:17.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:16 smithi162 ceph-mon[32106]: osdmap e724: 8 total, 8 up, 8 in 2024-09-21T18:01:17.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:17 smithi042 ceph-mon[29361]: osdmap e725: 8 total, 8 up, 8 in 2024-09-21T18:01:17.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:17 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-150","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:17.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:17 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-150","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:17 smithi042 ceph-mon[38309]: osdmap e725: 8 total, 8 up, 8 in 2024-09-21T18:01:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:17 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-150","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:17.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:17 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-150","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:18.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:17 smithi162 ceph-mon[32106]: osdmap e725: 8 total, 8 up, 8 in 2024-09-21T18:01:18.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:17 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-150","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:18.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:17 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-150","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[29361]: pgmap v1126: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 766 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[29361]: osdmap e726: 8 total, 8 up, 8 in 2024-09-21T18:01:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-150"} : dispatch 2024-09-21T18:01:18.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-150"} : dispatch 2024-09-21T18:01:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[38309]: pgmap v1126: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 766 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[38309]: osdmap e726: 8 total, 8 up, 8 in 2024-09-21T18:01:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-150"} : dispatch 2024-09-21T18:01:18.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:18 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-150"} : dispatch 2024-09-21T18:01:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:18 smithi162 ceph-mon[32106]: pgmap v1126: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 766 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:18 smithi162 ceph-mon[32106]: osdmap e726: 8 total, 8 up, 8 in 2024-09-21T18:01:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:18 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-150"} : dispatch 2024-09-21T18:01:19.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:18 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-150"} : dispatch 2024-09-21T18:01:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:19 smithi162 ceph-mon[32106]: osdmap e727: 8 total, 8 up, 8 in 2024-09-21T18:01:19.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:01:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:01:19.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:19 smithi042 ceph-mon[29361]: osdmap e727: 8 total, 8 up, 8 in 2024-09-21T18:01:19.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:19 smithi042 ceph-mon[38309]: osdmap e727: 8 total, 8 up, 8 in 2024-09-21T18:01:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:20 smithi042 ceph-mon[29361]: pgmap v1129: 172 pgs: 172 active+clean; 4.4 MiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T18:01:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:20 smithi042 ceph-mon[29361]: osdmap e728: 8 total, 8 up, 8 in 2024-09-21T18:01:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-152","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-152","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:20 smithi042 ceph-mon[38309]: pgmap v1129: 172 pgs: 172 active+clean; 4.4 MiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T18:01:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:20 smithi042 ceph-mon[38309]: osdmap e728: 8 total, 8 up, 8 in 2024-09-21T18:01:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-152","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-152","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:20 smithi162 ceph-mon[32106]: pgmap v1129: 172 pgs: 172 active+clean; 4.4 MiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T18:01:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:20 smithi162 ceph-mon[32106]: osdmap e728: 8 total, 8 up, 8 in 2024-09-21T18:01:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-152","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-152","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:21.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:21.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[29361]: osdmap e729: 8 total, 8 up, 8 in 2024-09-21T18:01:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-152"} : dispatch 2024-09-21T18:01:21.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-152"} : dispatch 2024-09-21T18:01:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[38309]: osdmap e729: 8 total, 8 up, 8 in 2024-09-21T18:01:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-152"} : dispatch 2024-09-21T18:01:21.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-152"} : dispatch 2024-09-21T18:01:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:21 smithi162 ceph-mon[32106]: osdmap e729: 8 total, 8 up, 8 in 2024-09-21T18:01:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-152"} : dispatch 2024-09-21T18:01:22.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-152"} : dispatch 2024-09-21T18:01:22.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:22 smithi042 ceph-mon[29361]: pgmap v1132: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T18:01:22.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:22 smithi042 ceph-mon[29361]: osdmap e730: 8 total, 8 up, 8 in 2024-09-21T18:01:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:22 smithi042 ceph-mon[38309]: pgmap v1132: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T18:01:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:22 smithi042 ceph-mon[38309]: osdmap e730: 8 total, 8 up, 8 in 2024-09-21T18:01:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:22 smithi162 ceph-mon[32106]: pgmap v1132: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T18:01:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:22 smithi162 ceph-mon[32106]: osdmap e730: 8 total, 8 up, 8 in 2024-09-21T18:01:23.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:23 smithi042 ceph-mon[29361]: osdmap e731: 8 total, 8 up, 8 in 2024-09-21T18:01:23.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:23 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-154","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:23.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:23 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-154","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:23.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:01:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:01:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:01:23.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:23 smithi042 ceph-mon[38309]: osdmap e731: 8 total, 8 up, 8 in 2024-09-21T18:01:23.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:23 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-154","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:23.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:23 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-154","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:23 smithi162 ceph-mon[32106]: osdmap e731: 8 total, 8 up, 8 in 2024-09-21T18:01:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:23 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-154","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:24.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:23 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-154","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T18:01:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[29361]: pgmap v1135: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-21T18:01:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[29361]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:01:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[29361]: osdmap e732: 8 total, 8 up, 8 in 2024-09-21T18:01:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-111","var": "dedup_tier","val": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-111","var": "dedup_tier","val": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[38309]: pgmap v1135: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-21T18:01:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[38309]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:01:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[38309]: osdmap e732: 8 total, 8 up, 8 in 2024-09-21T18:01:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-111","var": "dedup_tier","val": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-111","var": "dedup_tier","val": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:24.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:24 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:24 smithi162 ceph-mon[32106]: pgmap v1135: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-21T18:01:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:24 smithi162 ceph-mon[32106]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:01:25.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi042-71455-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T18:01:25.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:24 smithi162 ceph-mon[32106]: osdmap e732: 8 total, 8 up, 8 in 2024-09-21T18:01:25.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-111","var": "dedup_tier","val": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:25.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi042-71455-111","var": "dedup_tier","val": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:25.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:25.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:25.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:24 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:25.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:24 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi042-71455-111", "tierpool": "test-rados-api-smithi042-71455-154"} : dispatch 2024-09-21T18:01:25.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:25 smithi042 ceph-mon[29361]: osdmap e733: 8 total, 8 up, 8 in 2024-09-21T18:01:25.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:25 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:01:25.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:25 smithi042 ceph-mon[38309]: osdmap e733: 8 total, 8 up, 8 in 2024-09-21T18:01:25.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:25 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:01:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:25 smithi162 ceph-mon[32106]: osdmap e733: 8 total, 8 up, 8 in 2024-09-21T18:01:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:25 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:01:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[29361]: pgmap v1138: 172 pgs: 172 active+clean; 4.4 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-21T18:01:26.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[29361]: osdmap e734: 8 total, 8 up, 8 in 2024-09-21T18:01:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:01:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:01:26.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:26.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[38309]: pgmap v1138: 172 pgs: 172 active+clean; 4.4 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-21T18:01:26.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[38309]: osdmap e734: 8 total, 8 up, 8 in 2024-09-21T18:01:26.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:26.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:26.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:26.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:26.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:01:26.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:01:26.919 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:26 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:26.976 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:26 smithi162 ceph-mon[32106]: pgmap v1138: 172 pgs: 172 active+clean; 4.4 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-21T18:01:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:26 smithi162 ceph-mon[32106]: osdmap e734: 8 total, 8 up, 8 in 2024-09-21T18:01:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:26 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:26 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:26 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:26 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:26 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:01:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:26 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:01:26.977 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:26 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:27.668 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7892 ms) 2024-09-21T18:01:27.668 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-21T18:01:27.668 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (12234 ms) 2024-09-21T18:01:27.668 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-21T18:01:27.668 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8044 ms) 2024-09-21T18:01:27.668 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-21T18:01:27.668 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13074 ms) 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7668 ms) 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8049 ms) 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: hmm, no HitSet yet 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: ok, hit_set contains 336:602f83fe:::foo:head 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9045 ms) 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,0 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: first is 1726941603 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,0 2024-09-21T18:01:27.669 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,1726941605,1726941606,0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,1726941605,1726941606,0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,1726941605,1726941606,0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,1726941605,1726941606,1726941608,1726941609,0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,1726941605,1726941606,1726941608,1726941609,0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,1726941605,1726941606,1726941608,1726941609,0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,1726941605,1726941606,1726941608,1726941609,1726941611,1726941612,0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,1726941605,1726941606,1726941608,1726941609,1726941611,1726941612,0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941603,1726941605,1726941606,1726941608,1726941609,1726941611,1726941612,0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: got ls 1726941606,1726941608,1726941609,1726941611,1726941612,1726941614,1726941615,0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: first now 1726941606, trimmed 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (20146 ms) 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: foo0 2024-09-21T18:01:27.670 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14069 ms) 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (17888 ms) 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (23049 ms) 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5038 ms) 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3019 ms) 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3021 ms) 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3019 ms) 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (230799 ms total) 2024-09-21T18:01:27.671 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: 2024-09-21T18:01:27.672 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-09-21T18:01:27.672 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (843889 ms total) 2024-09-21T18:01:27.672 INFO:tasks.workunit.client.0.smithi042.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-09-21T18:01:27.676 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.676 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71243 2024-09-21T18:01:27.676 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71243 2024-09-21T18:01:27.676 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.676 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71496 2024-09-21T18:01:27.676 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71496 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71977 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71977 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71780 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71780 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71617 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71617 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71318 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71318 2024-09-21T18:01:27.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71677 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71677 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72173 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72173 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72244 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72244 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71356 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71356 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72022 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72022 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71216 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71216 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71279 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71279 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71907 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71907 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71207 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71207 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71227 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71227 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72462 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72462 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71535 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71535 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72528 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72528 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71651 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71651 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72124 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72124 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72577 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72577 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71584 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71584 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71934 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71934 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72395 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72395 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72048 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72048 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72486 2024-09-21T18:01:27.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72486 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71889 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71889 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71444 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71444 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72549 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72549 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71794 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71794 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71200 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71200 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71258 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71258 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71716 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71716 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71304 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71304 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71811 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71811 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=71846 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 71846 2024-09-21T18:01:27.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.684 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72305 2024-09-21T18:01:27.684 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72305 2024-09-21T18:01:27.684 INFO:tasks.workunit.client.0.smithi042.stderr:+ for t in "${!pids[@]}" 2024-09-21T18:01:27.684 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=72608 2024-09-21T18:01:27.684 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 72608 2024-09-21T18:01:27.684 INFO:tasks.workunit.client.0.smithi042.stderr:+ exit 0 2024-09-21T18:01:27.684 INFO:tasks.workunit.client.0.smithi042.stderr:+ cleanup 2024-09-21T18:01:27.684 INFO:tasks.workunit.client.0.smithi042.stderr:+ pkill -P 71194 2024-09-21T18:01:27.694 INFO:tasks.workunit.client.0.smithi042.stderr:+ true 2024-09-21T18:01:27.694 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T18:01:27.695 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T18:01:27.726 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-21T18:01:27.728 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-21T18:01:27.728 DEBUG:teuthology.orchestra.run.smithi042:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0ecbb435437226bc091a0c2d4549ba25bf724efe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-21T18:01:27.789 INFO:tasks.workunit.client.0.smithi042.stderr:++ uuidgen 2024-09-21T18:01:27.797 INFO:tasks.workunit.client.0.smithi042.stderr:+ p=277077be-0cb2-4630-9bef-40c97902f85f 2024-09-21T18:01:27.797 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool create 277077be-0cb2-4630-9bef-40c97902f85f 12 2024-09-21T18:01:27.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.882+0000 7f03eed00640 1 -- 172.21.15.42:0/1710757122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e8109080 msgr2=0x7f03e810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:27.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.882+0000 7f03eed00640 1 --2- 172.21.15.42:0/1710757122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e8109080 0x7f03e810f880 secure :-1 s=READY pgs=2891 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009ca0 tx=0x7f03e002a8c0 comp rx=0 tx=0).stop 2024-09-21T18:01:27.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.882+0000 7f03eed00640 1 -- 172.21.15.42:0/1710757122 shutdown_connections 2024-09-21T18:01:27.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.882+0000 7f03eed00640 1 --2- 172.21.15.42:0/1710757122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e8109080 0x7f03e810f880 unknown :-1 s=CLOSED pgs=2891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:27.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.882+0000 7f03eed00640 1 --2- 172.21.15.42:0/1710757122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03e8108700 0x7f03e8108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:27.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.882+0000 7f03eed00640 1 --2- 172.21.15.42:0/1710757122 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f03e8102d00 0x7f03e81030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:27.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.882+0000 7f03eed00640 1 -- 172.21.15.42:0/1710757122 >> 172.21.15.42:0/1710757122 conn(0x7f03e80fe740 msgr2=0x7f03e8100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:01:27.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.882+0000 7f03eed00640 1 -- 172.21.15.42:0/1710757122 shutdown_connections 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.882+0000 7f03eed00640 1 -- 172.21.15.42:0/1710757122 wait complete. 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03eed00640 1 Processor -- start 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03eed00640 1 -- start start 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03eed00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03e8102d00 0x7f03e80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03eed00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f03e8108700 0x7f03e80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03eed00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e8109080 0x7f03e8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03eed00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f03e8112450 con 0x7f03e8109080 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03eed00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03e81122d0 con 0x7f03e8102d00 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03eed00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f03e81125d0 con 0x7f03e8108700 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03e7fff640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f03e8108700 0x7f03e80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03ed29d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e8109080 0x7f03e8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03e7fff640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f03e8108700 0x7f03e80759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:48492/0 (socket says 172.21.15.42:48492) 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03e7fff640 1 -- 172.21.15.42:0/2216585243 learned_addr learned my addr 172.21.15.42:0/2216585243 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:01:27.886 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03e7fff640 1 -- 172.21.15.42:0/2216585243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03e8102d00 msgr2=0x7f03e80754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:27.887 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03e7fff640 1 --2- 172.21.15.42:0/2216585243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03e8102d00 0x7f03e80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:27.887 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03e7fff640 1 -- 172.21.15.42:0/2216585243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e8109080 msgr2=0x7f03e8075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:27.887 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03e7fff640 1 --2- 172.21.15.42:0/2216585243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e8109080 0x7f03e8075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:27.887 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03e7fff640 1 -- 172.21.15.42:0/2216585243 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e81a6de0 con 0x7f03e8108700 2024-09-21T18:01:27.887 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.883+0000 7f03e7fff640 1 --2- 172.21.15.42:0/2216585243 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f03e8108700 0x7f03e80759e0 secure :-1 s=READY pgs=2968 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00d950 tx=0x7f03dc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:01:27.887 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.884+0000 7f03e5ffb640 1 -- 172.21.15.42:0/2216585243 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc017030 con 0x7f03e8108700 2024-09-21T18:01:27.887 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.884+0000 7f03eed00640 1 -- 172.21.15.42:0/2216585243 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e81a70d0 con 0x7f03e8108700 2024-09-21T18:01:27.887 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.884+0000 7f03e5ffb640 1 -- 172.21.15.42:0/2216585243 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f03dc004020 con 0x7f03e8108700 2024-09-21T18:01:27.887 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.884+0000 7f03e5ffb640 1 -- 172.21.15.42:0/2216585243 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc0055a0 con 0x7f03e8108700 2024-09-21T18:01:27.887 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.884+0000 7f03eed00640 1 -- 172.21.15.42:0/2216585243 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e81a7620 con 0x7f03e8108700 2024-09-21T18:01:27.888 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.885+0000 7f03eed00640 1 -- 172.21.15.42:0/2216585243 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e81030e0 con 0x7f03e8108700 2024-09-21T18:01:27.888 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.885+0000 7f03e5ffb640 1 -- 172.21.15.42:0/2216585243 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f03dc009a30 con 0x7f03e8108700 2024-09-21T18:01:27.888 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.886+0000 7f03e5ffb640 1 --2- 172.21.15.42:0/2216585243 >> v2:172.21.15.42:6800/36970769 conn(0x7f03d007b110 0x7f03d007d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:27.888 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.886+0000 7f03e5ffb640 1 -- 172.21.15.42:0/2216585243 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(736..736 src has 1..736) ==== 7426+0+0 (secure 0 0 0) 0x7f03dc09e170 con 0x7f03e8108700 2024-09-21T18:01:27.888 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.886+0000 7f03eca9c640 1 --2- 172.21.15.42:0/2216585243 >> v2:172.21.15.42:6800/36970769 conn(0x7f03d007b110 0x7f03d007d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:01:27.888 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.886+0000 7f03eca9c640 1 --2- 172.21.15.42:0/2216585243 >> v2:172.21.15.42:6800/36970769 conn(0x7f03d007b110 0x7f03d007d5d0 secure :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0x7f03d80058c0 tx=0x7f03d8005850 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:01:27.892 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:27.891+0000 7f03e5ffb640 1 -- 172.21.15.42:0/2216585243 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f03dc069270 con 0x7f03e8108700 2024-09-21T18:01:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:01:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:27 smithi042 ceph-mon[29361]: osdmap e735: 8 total, 8 up, 8 in 2024-09-21T18:01:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:27 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:27 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:01:27.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:01:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:27 smithi042 ceph-mon[38309]: osdmap e735: 8 total, 8 up, 8 in 2024-09-21T18:01:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:27 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:27 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:01:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:01:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:27 smithi162 ceph-mon[32106]: osdmap e735: 8 total, 8 up, 8 in 2024-09-21T18:01:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:27 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2240905856' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"} : dispatch 2024-09-21T18:01:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:27 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi042-71455-111"}]': finished 2024-09-21T18:01:28.082 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.081+0000 7f03eed00640 1 -- 172.21.15.42:0/2216585243 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} v 0) -- 0x7f03e810ae60 con 0x7f03e8108700 2024-09-21T18:01:28.670 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.668+0000 7f03e5ffb640 1 -- 172.21.15.42:0/2216585243 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12}]=0 pool '277077be-0cb2-4630-9bef-40c97902f85f' created v737) ==== 176+0+0 (secure 0 0 0) 0x7f03dc06e120 con 0x7f03e8108700 2024-09-21T18:01:28.785 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.784+0000 7f03eed00640 1 -- 172.21.15.42:0/2216585243 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} v 0) -- 0x7f03e810a9f0 con 0x7f03e8108700 2024-09-21T18:01:28.786 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.785+0000 7f03e5ffb640 1 -- 172.21.15.42:0/2216585243 <== mon.2 v2:172.21.15.42:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12}]=0 pool '277077be-0cb2-4630-9bef-40c97902f85f' already exists v737) ==== 183+0+0 (secure 0 0 0) 0x7f03dc009d20 con 0x7f03e8108700 2024-09-21T18:01:28.786 INFO:tasks.workunit.client.0.smithi042.stderr:pool '277077be-0cb2-4630-9bef-40c97902f85f' already exists 2024-09-21T18:01:28.788 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 -- 172.21.15.42:0/2216585243 >> v2:172.21.15.42:6800/36970769 conn(0x7f03d007b110 msgr2=0x7f03d007d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:28.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 --2- 172.21.15.42:0/2216585243 >> v2:172.21.15.42:6800/36970769 conn(0x7f03d007b110 0x7f03d007d5d0 secure :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0x7f03d80058c0 tx=0x7f03d8005850 comp rx=0 tx=0).stop 2024-09-21T18:01:28.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 -- 172.21.15.42:0/2216585243 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f03e8108700 msgr2=0x7f03e80759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:28.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 --2- 172.21.15.42:0/2216585243 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f03e8108700 0x7f03e80759e0 secure :-1 s=READY pgs=2968 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00d950 tx=0x7f03dc00de10 comp rx=0 tx=0).stop 2024-09-21T18:01:28.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 -- 172.21.15.42:0/2216585243 shutdown_connections 2024-09-21T18:01:28.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 --2- 172.21.15.42:0/2216585243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e8109080 0x7f03e8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:28.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 --2- 172.21.15.42:0/2216585243 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f03e8108700 0x7f03e80759e0 unknown :-1 s=CLOSED pgs=2968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:28.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 --2- 172.21.15.42:0/2216585243 >> v2:172.21.15.42:6800/36970769 conn(0x7f03d007b110 0x7f03d007d5d0 unknown :-1 s=CLOSED pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:28.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 --2- 172.21.15.42:0/2216585243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03e8102d00 0x7f03e80754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:28.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 -- 172.21.15.42:0/2216585243 >> 172.21.15.42:0/2216585243 conn(0x7f03e80fe740 msgr2=0x7f03e8100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:01:28.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 -- 172.21.15.42:0/2216585243 shutdown_connections 2024-09-21T18:01:28.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.787+0000 7f03eed00640 1 -- 172.21.15.42:0/2216585243 wait complete. 2024-09-21T18:01:28.797 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool set-quota 277077be-0cb2-4630-9bef-40c97902f85f max_objects 10 2024-09-21T18:01:28.884 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.882+0000 7ff18172b640 1 -- 172.21.15.42:0/2169586983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff17c1086d0 msgr2=0x7ff17c108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:28.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.882+0000 7ff18172b640 1 --2- 172.21.15.42:0/2169586983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff17c1086d0 0x7ff17c108b10 secure :-1 s=READY pgs=2892 cs=0 l=1 rev1=1 crypto rx=0x7ff170009900 tx=0x7ff17002a410 comp rx=0 tx=0).stop 2024-09-21T18:01:28.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.883+0000 7ff18172b640 1 -- 172.21.15.42:0/2169586983 shutdown_connections 2024-09-21T18:01:28.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.883+0000 7ff18172b640 1 --2- 172.21.15.42:0/2169586983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff17c109050 0x7ff17c10f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:28.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.883+0000 7ff18172b640 1 --2- 172.21.15.42:0/2169586983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff17c1086d0 0x7ff17c108b10 unknown :-1 s=CLOSED pgs=2892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:28.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.883+0000 7ff18172b640 1 --2- 172.21.15.42:0/2169586983 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff17c06a540 0x7ff17c06a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:28.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.883+0000 7ff18172b640 1 -- 172.21.15.42:0/2169586983 >> 172.21.15.42:0/2169586983 conn(0x7ff17c0776a0 msgr2=0x7ff17c077ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:01:28.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.883+0000 7ff18172b640 1 -- 172.21.15.42:0/2169586983 shutdown_connections 2024-09-21T18:01:28.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.883+0000 7ff18172b640 1 -- 172.21.15.42:0/2169586983 wait complete. 2024-09-21T18:01:28.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.883+0000 7ff18172b640 1 Processor -- start 2024-09-21T18:01:28.885 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.883+0000 7ff18172b640 1 -- start start 2024-09-21T18:01:28.888 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff18172b640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff17c06a540 0x7ff17c101e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:28.888 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff18172b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff17c1086d0 0x7ff17c102380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:28.889 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff18172b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff17c109050 0x7ff17c1028c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:28.889 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff18172b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff17c1123b0 con 0x7ff17c109050 2024-09-21T18:01:28.889 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff18172b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff17c112230 con 0x7ff17c1086d0 2024-09-21T18:01:28.889 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff18172b640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7ff17c112530 con 0x7ff17c06a540 2024-09-21T18:01:28.889 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17affd640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff17c06a540 0x7ff17c101e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:01:28.889 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff17c109050 0x7ff17c1028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:01:28.890 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17affd640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff17c06a540 0x7ff17c101e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:48502/0 (socket says 172.21.15.42:48502) 2024-09-21T18:01:28.890 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff17c109050 0x7ff17c1028c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43018/0 (socket says 172.21.15.42:43018) 2024-09-21T18:01:28.890 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17affd640 1 -- 172.21.15.42:0/1640273479 learned_addr learned my addr 172.21.15.42:0/1640273479 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:01:28.890 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17a7fc640 1 --2- 172.21.15.42:0/1640273479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff17c1086d0 0x7ff17c102380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:01:28.890 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17affd640 1 -- 172.21.15.42:0/1640273479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff17c1086d0 msgr2=0x7ff17c102380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:28.890 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17affd640 1 --2- 172.21.15.42:0/1640273479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff17c1086d0 0x7ff17c102380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:28.890 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17affd640 1 -- 172.21.15.42:0/1640273479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff17c109050 msgr2=0x7ff17c1028c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:28.891 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17affd640 1 --2- 172.21.15.42:0/1640273479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff17c109050 0x7ff17c1028c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:28.891 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17affd640 1 -- 172.21.15.42:0/1640273479 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17c1a6cb0 con 0x7ff17c06a540 2024-09-21T18:01:28.891 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17a7fc640 1 --2- 172.21.15.42:0/1640273479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff17c1086d0 0x7ff17c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T18:01:28.891 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17b7fe640 1 --2- 172.21.15.42:0/1640273479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff17c109050 0x7ff17c1028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T18:01:28.891 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff17affd640 1 --2- 172.21.15.42:0/1640273479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff17c06a540 0x7ff17c101e40 secure :-1 s=READY pgs=2969 cs=0 l=1 rev1=1 crypto rx=0x7ff16c00ea60 tx=0x7ff16c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:01:28.891 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.884+0000 7ff163fff640 1 -- 172.21.15.42:0/1640273479 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c00cde0 con 0x7ff17c06a540 2024-09-21T18:01:28.891 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.885+0000 7ff163fff640 1 -- 172.21.15.42:0/1640273479 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff16c0035f0 con 0x7ff17c06a540 2024-09-21T18:01:28.891 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.885+0000 7ff18172b640 1 -- 172.21.15.42:0/1640273479 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17c1a6fa0 con 0x7ff17c06a540 2024-09-21T18:01:28.892 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.885+0000 7ff163fff640 1 -- 172.21.15.42:0/1640273479 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0044a0 con 0x7ff17c06a540 2024-09-21T18:01:28.892 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.885+0000 7ff18172b640 1 -- 172.21.15.42:0/1640273479 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17c1a7460 con 0x7ff17c06a540 2024-09-21T18:01:28.892 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.886+0000 7ff18172b640 1 -- 172.21.15.42:0/1640273479 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff17c06a920 con 0x7ff17c06a540 2024-09-21T18:01:28.892 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.886+0000 7ff163fff640 1 -- 172.21.15.42:0/1640273479 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7ff16c004000 con 0x7ff17c06a540 2024-09-21T18:01:28.892 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.887+0000 7ff163fff640 1 --2- 172.21.15.42:0/1640273479 >> v2:172.21.15.42:6800/36970769 conn(0x7ff16407b110 0x7ff16407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:28.892 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.887+0000 7ff163fff640 1 -- 172.21.15.42:0/1640273479 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(737..737 src has 1..737) ==== 7801+0+0 (secure 0 0 0) 0x7ff16c09ed60 con 0x7ff17c06a540 2024-09-21T18:01:28.892 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.887+0000 7ff17a7fc640 1 --2- 172.21.15.42:0/1640273479 >> v2:172.21.15.42:6800/36970769 conn(0x7ff16407b110 0x7ff16407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:01:28.893 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.887+0000 7ff17a7fc640 1 --2- 172.21.15.42:0/1640273479 >> v2:172.21.15.42:6800/36970769 conn(0x7ff16407b110 0x7ff16407d5d0 secure :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0x7ff170000c00 tx=0x7ff170031400 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:01:28.893 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:28.891+0000 7ff163fff640 1 -- 172.21.15.42:0/1640273479 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7ff16c069cf0 con 0x7ff17c06a540 2024-09-21T18:01:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:28 smithi042 ceph-mon[29361]: pgmap v1141: 164 pgs: 164 active+clean; 583 KiB data, 771 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:28 smithi042 ceph-mon[29361]: osdmap e736: 8 total, 8 up, 8 in 2024-09-21T18:01:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:28 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2216585243' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:28 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:28.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:28 smithi042 ceph-mon[38309]: pgmap v1141: 164 pgs: 164 active+clean; 583 KiB data, 771 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:28 smithi042 ceph-mon[38309]: osdmap e736: 8 total, 8 up, 8 in 2024-09-21T18:01:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:28 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2216585243' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:28 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:28 smithi162 ceph-mon[32106]: pgmap v1141: 164 pgs: 164 active+clean; 583 KiB data, 771 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:28 smithi162 ceph-mon[32106]: osdmap e736: 8 total, 8 up, 8 in 2024-09-21T18:01:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:28 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2216585243' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:28 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:29.083 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:29.082+0000 7ff18172b640 1 -- 172.21.15.42:0/1640273479 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} v 0) -- 0x7ff17c1a77c0 con 0x7ff17c06a540 2024-09-21T18:01:29.672 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:01:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:01:29.676 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:29.675+0000 7ff163fff640 1 -- 172.21.15.42:0/1640273479 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 277077be-0cb2-4630-9bef-40c97902f85f v738) ==== 223+0+0 (secure 0 0 0) 0x7ff16c06eba0 con 0x7ff17c06a540 2024-09-21T18:01:29.800 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:29.799+0000 7ff18172b640 1 -- 172.21.15.42:0/1640273479 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} v 0) -- 0x7ff17c1a7c20 con 0x7ff17c06a540 2024-09-21T18:01:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12}]': finished 2024-09-21T18:01:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:29 smithi162 ceph-mon[32106]: osdmap e737: 8 total, 8 up, 8 in 2024-09-21T18:01:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2216585243' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:29 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1640273479' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:29 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:29 smithi162 ceph-mon[32106]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:01:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:29 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:30.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:29 smithi162 ceph-mon[32106]: pgmap v1144: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 787 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12}]': finished 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[29361]: osdmap e737: 8 total, 8 up, 8 in 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2216585243' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1640273479' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[29361]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[29361]: pgmap v1144: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 787 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12}]': finished 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[38309]: osdmap e737: 8 total, 8 up, 8 in 2024-09-21T18:01:30.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2216585243' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:30.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pg_num": 12} : dispatch 2024-09-21T18:01:30.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1640273479' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:30.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:30.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[38309]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T18:01:30.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:30.166 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:29 smithi042 ceph-mon[38309]: pgmap v1144: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 787 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:01:30.682 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.681+0000 7ff163fff640 1 -- 172.21.15.42:0/1640273479 <== mon.2 v2:172.21.15.42:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 277077be-0cb2-4630-9bef-40c97902f85f v739) ==== 223+0+0 (secure 0 0 0) 0x7ff16c09cb70 con 0x7ff17c06a540 2024-09-21T18:01:30.682 INFO:tasks.workunit.client.0.smithi042.stderr:set-quota max_objects = 10 for pool 277077be-0cb2-4630-9bef-40c97902f85f 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 -- 172.21.15.42:0/1640273479 >> v2:172.21.15.42:6800/36970769 conn(0x7ff16407b110 msgr2=0x7ff16407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 --2- 172.21.15.42:0/1640273479 >> v2:172.21.15.42:6800/36970769 conn(0x7ff16407b110 0x7ff16407d5d0 secure :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0x7ff170000c00 tx=0x7ff170031400 comp rx=0 tx=0).stop 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 -- 172.21.15.42:0/1640273479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff17c06a540 msgr2=0x7ff17c101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 --2- 172.21.15.42:0/1640273479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff17c06a540 0x7ff17c101e40 secure :-1 s=READY pgs=2969 cs=0 l=1 rev1=1 crypto rx=0x7ff16c00ea60 tx=0x7ff16c00ef20 comp rx=0 tx=0).stop 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 -- 172.21.15.42:0/1640273479 shutdown_connections 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 --2- 172.21.15.42:0/1640273479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff17c109050 0x7ff17c1028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 --2- 172.21.15.42:0/1640273479 >> v2:172.21.15.42:6800/36970769 conn(0x7ff16407b110 0x7ff16407d5d0 unknown :-1 s=CLOSED pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 --2- 172.21.15.42:0/1640273479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff17c1086d0 0x7ff17c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 --2- 172.21.15.42:0/1640273479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff17c06a540 0x7ff17c101e40 unknown :-1 s=CLOSED pgs=2969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 -- 172.21.15.42:0/1640273479 >> 172.21.15.42:0/1640273479 conn(0x7ff17c0776a0 msgr2=0x7ff17c100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 -- 172.21.15.42:0/1640273479 shutdown_connections 2024-09-21T18:01:30.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.684+0000 7ff18172b640 1 -- 172.21.15.42:0/1640273479 wait complete. 2024-09-21T18:01:30.697 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool application enable 277077be-0cb2-4630-9bef-40c97902f85f rados 2024-09-21T18:01:30.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.787+0000 7f3884048640 1 -- 172.21.15.42:0/1715754969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f387c1043b0 msgr2=0x7f387c104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:30.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.787+0000 7f3884048640 1 --2- 172.21.15.42:0/1715754969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f387c1043b0 0x7f387c104810 secure :-1 s=READY pgs=2893 cs=0 l=1 rev1=1 crypto rx=0x7f386c009900 tx=0x7f386c02a410 comp rx=0 tx=0).stop 2024-09-21T18:01:30.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.787+0000 7f3884048640 1 -- 172.21.15.42:0/1715754969 shutdown_connections 2024-09-21T18:01:30.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.787+0000 7f3884048640 1 --2- 172.21.15.42:0/1715754969 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f387c104d50 0x7f387c10e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:30.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.787+0000 7f3884048640 1 --2- 172.21.15.42:0/1715754969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f387c1043b0 0x7f387c104810 unknown :-1 s=CLOSED pgs=2893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:30.789 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.787+0000 7f3884048640 1 --2- 172.21.15.42:0/1715754969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f387c101f90 0x7f387c102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:30.790 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.787+0000 7f3884048640 1 -- 172.21.15.42:0/1715754969 >> 172.21.15.42:0/1715754969 conn(0x7f387c0776a0 msgr2=0x7f387c077ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:01:30.790 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.787+0000 7f3884048640 1 -- 172.21.15.42:0/1715754969 shutdown_connections 2024-09-21T18:01:30.790 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.787+0000 7f3884048640 1 -- 172.21.15.42:0/1715754969 wait complete. 2024-09-21T18:01:30.790 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f3884048640 1 Processor -- start 2024-09-21T18:01:30.790 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f3884048640 1 -- start start 2024-09-21T18:01:30.791 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f3884048640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f387c101f90 0x7f387c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:30.791 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f3884048640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f387c1043b0 0x7f387c198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:30.791 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f3884048640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f387c104d50 0x7f387c19e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f3884048640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f387c111320 con 0x7f387c101f90 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f3884048640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f387c1111a0 con 0x7f387c1043b0 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f3884048640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f387c1114a0 con 0x7f387c104d50 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f3881de4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f387c101f90 0x7f387c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f3881de4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f387c101f90 0x7f387c198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43030/0 (socket says 172.21.15.42:43030) 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f3881de4640 1 -- 172.21.15.42:0/2869263765 learned_addr learned my addr 172.21.15.42:0/2869263765 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f38825e5640 1 --2- 172.21.15.42:0/2869263765 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f387c104d50 0x7f387c19e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.788+0000 7f38815e3640 1 --2- 172.21.15.42:0/2869263765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f387c1043b0 0x7f387c198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f3881de4640 1 -- 172.21.15.42:0/2869263765 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f387c104d50 msgr2=0x7f387c19e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f3881de4640 1 --2- 172.21.15.42:0/2869263765 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f387c104d50 0x7f387c19e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f3881de4640 1 -- 172.21.15.42:0/2869263765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f387c1043b0 msgr2=0x7f387c198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f3881de4640 1 --2- 172.21.15.42:0/2869263765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f387c1043b0 0x7f387c198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f3881de4640 1 -- 172.21.15.42:0/2869263765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387c19ea00 con 0x7f387c101f90 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f38815e3640 1 --2- 172.21.15.42:0/2869263765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f387c1043b0 0x7f387c198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f3881de4640 1 --2- 172.21.15.42:0/2869263765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f387c101f90 0x7f387c198960 secure :-1 s=READY pgs=2894 cs=0 l=1 rev1=1 crypto rx=0x7f387800d950 tx=0x7f387800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:01:30.792 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f3872ffd640 1 -- 172.21.15.42:0/2869263765 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878017070 con 0x7f387c101f90 2024-09-21T18:01:30.793 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f3872ffd640 1 -- 172.21.15.42:0/2869263765 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f387800de80 con 0x7f387c101f90 2024-09-21T18:01:30.793 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f3884048640 1 -- 172.21.15.42:0/2869263765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387c19ecf0 con 0x7f387c101f90 2024-09-21T18:01:30.793 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f3872ffd640 1 -- 172.21.15.42:0/2869263765 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878010e60 con 0x7f387c101f90 2024-09-21T18:01:30.793 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.789+0000 7f3884048640 1 -- 172.21.15.42:0/2869263765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387c1a53b0 con 0x7f387c101f90 2024-09-21T18:01:30.793 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.790+0000 7f3884048640 1 -- 172.21.15.42:0/2869263765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f387c102370 con 0x7f387c101f90 2024-09-21T18:01:30.793 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.791+0000 7f3872ffd640 1 -- 172.21.15.42:0/2869263765 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f3878010460 con 0x7f387c101f90 2024-09-21T18:01:30.794 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.792+0000 7f3872ffd640 1 --2- 172.21.15.42:0/2869263765 >> v2:172.21.15.42:6800/36970769 conn(0x7f386807b110 0x7f386807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:01:30.794 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.792+0000 7f3872ffd640 1 -- 172.21.15.42:0/2869263765 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(739..739 src has 1..739) ==== 7801+0+0 (secure 0 0 0) 0x7f387809e4c0 con 0x7f387c101f90 2024-09-21T18:01:30.794 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.792+0000 7f38815e3640 1 --2- 172.21.15.42:0/2869263765 >> v2:172.21.15.42:6800/36970769 conn(0x7f386807b110 0x7f386807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:01:30.794 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.792+0000 7f38815e3640 1 --2- 172.21.15.42:0/2869263765 >> v2:172.21.15.42:6800/36970769 conn(0x7f386807b110 0x7f386807d5d0 secure :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0x7f386c031440 tx=0x7f386c005a20 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:01:30.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.796+0000 7f3872ffd640 1 -- 172.21.15.42:0/2869263765 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f38780695b0 con 0x7f387c101f90 2024-09-21T18:01:30.988 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:30.986+0000 7f3884048640 1 -- 172.21.15.42:0/2869263765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"} v 0) -- 0x7f387c199a80 con 0x7f387c101f90 2024-09-21T18:01:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:01:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:30 smithi162 ceph-mon[32106]: osdmap e738: 8 total, 8 up, 8 in 2024-09-21T18:01:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:30 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1640273479' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:30 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:31.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:01:31.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:30 smithi042 ceph-mon[29361]: osdmap e738: 8 total, 8 up, 8 in 2024-09-21T18:01:31.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:30 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1640273479' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:31.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:30 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:31.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:01:31.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:30 smithi042 ceph-mon[38309]: osdmap e738: 8 total, 8 up, 8 in 2024-09-21T18:01:31.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:30 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1640273479' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:31.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:30 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:01:31.683 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:31.682+0000 7f3872ffd640 1 -- 172.21.15.42:0/2869263765 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"}]=0 enabled application 'rados' on pool '277077be-0cb2-4630-9bef-40c97902f85f' v740) ==== 213+0+0 (secure 0 0 0) 0x7f387806e460 con 0x7f387c101f90 2024-09-21T18:01:31.807 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:31.806+0000 7f3884048640 1 -- 172.21.15.42:0/2869263765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"} v 0) -- 0x7f387c063730 con 0x7f387c101f90 2024-09-21T18:01:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:31 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:01:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:31 smithi162 ceph-mon[32106]: osdmap e739: 8 total, 8 up, 8 in 2024-09-21T18:01:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:31 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"} : dispatch 2024-09-21T18:01:32.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:31 smithi162 ceph-mon[32106]: pgmap v1147: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:01:32.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:31 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:01:32.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:31 smithi042 ceph-mon[38309]: osdmap e739: 8 total, 8 up, 8 in 2024-09-21T18:01:32.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:31 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"} : dispatch 2024-09-21T18:01:32.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:31 smithi042 ceph-mon[38309]: pgmap v1147: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:01:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:31 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:01:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:31 smithi042 ceph-mon[29361]: osdmap e739: 8 total, 8 up, 8 in 2024-09-21T18:01:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:31 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"} : dispatch 2024-09-21T18:01:32.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:31 smithi042 ceph-mon[29361]: pgmap v1147: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:01:32.685 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.683+0000 7f3872ffd640 1 -- 172.21.15.42:0/2869263765 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"}]=0 enabled application 'rados' on pool '277077be-0cb2-4630-9bef-40c97902f85f' v741) ==== 213+0+0 (secure 0 0 0) 0x7f3878060d40 con 0x7f387c101f90 2024-09-21T18:01:32.685 INFO:tasks.workunit.client.0.smithi042.stderr:enabled application 'rados' on pool '277077be-0cb2-4630-9bef-40c97902f85f' 2024-09-21T18:01:32.689 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.688+0000 7f3884048640 1 -- 172.21.15.42:0/2869263765 >> v2:172.21.15.42:6800/36970769 conn(0x7f386807b110 msgr2=0x7f386807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:32.689 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.688+0000 7f3884048640 1 --2- 172.21.15.42:0/2869263765 >> v2:172.21.15.42:6800/36970769 conn(0x7f386807b110 0x7f386807d5d0 secure :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0x7f386c031440 tx=0x7f386c005a20 comp rx=0 tx=0).stop 2024-09-21T18:01:32.689 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.688+0000 7f3884048640 1 -- 172.21.15.42:0/2869263765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f387c101f90 msgr2=0x7f387c198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:01:32.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.688+0000 7f3884048640 1 --2- 172.21.15.42:0/2869263765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f387c101f90 0x7f387c198960 secure :-1 s=READY pgs=2894 cs=0 l=1 rev1=1 crypto rx=0x7f387800d950 tx=0x7f387800dd50 comp rx=0 tx=0).stop 2024-09-21T18:01:32.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.688+0000 7f3884048640 1 -- 172.21.15.42:0/2869263765 shutdown_connections 2024-09-21T18:01:32.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.688+0000 7f3884048640 1 --2- 172.21.15.42:0/2869263765 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f387c104d50 0x7f387c19e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:32.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.688+0000 7f3884048640 1 --2- 172.21.15.42:0/2869263765 >> v2:172.21.15.42:6800/36970769 conn(0x7f386807b110 0x7f386807d5d0 unknown :-1 s=CLOSED pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:32.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.688+0000 7f3884048640 1 --2- 172.21.15.42:0/2869263765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f387c1043b0 0x7f387c198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:32.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.688+0000 7f3884048640 1 --2- 172.21.15.42:0/2869263765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f387c101f90 0x7f387c198960 unknown :-1 s=CLOSED pgs=2894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:01:32.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.688+0000 7f3884048640 1 -- 172.21.15.42:0/2869263765 >> 172.21.15.42:0/2869263765 conn(0x7f387c0776a0 msgr2=0x7f387c06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:01:32.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.689+0000 7f3884048640 1 -- 172.21.15.42:0/2869263765 shutdown_connections 2024-09-21T18:01:32.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:01:32.689+0000 7f3884048640 1 -- 172.21.15.42:0/2869263765 wait complete. 2024-09-21T18:01:32.703 INFO:tasks.workunit.client.0.smithi042.stderr:++ seq 1 10 2024-09-21T18:01:32.712 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:01:32.712 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put obj1 /etc/passwd 2024-09-21T18:01:32.757 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:01:32.757 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put obj2 /etc/passwd 2024-09-21T18:01:32.799 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:01:32.799 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put obj3 /etc/passwd 2024-09-21T18:01:32.837 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:01:32.837 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put obj4 /etc/passwd 2024-09-21T18:01:32.873 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:01:32.874 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put obj5 /etc/passwd 2024-09-21T18:01:32.911 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:01:32.911 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put obj6 /etc/passwd 2024-09-21T18:01:32.947 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:01:32.947 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put obj7 /etc/passwd 2024-09-21T18:01:32.984 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:01:32.985 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put obj8 /etc/passwd 2024-09-21T18:01:33.022 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:01:33.022 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put obj9 /etc/passwd 2024-09-21T18:01:33.059 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:01:33.059 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put obj10 /etc/passwd 2024-09-21T18:01:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"}]': finished 2024-09-21T18:01:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:32 smithi162 ceph-mon[32106]: osdmap e740: 8 total, 8 up, 8 in 2024-09-21T18:01:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:32 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"} : dispatch 2024-09-21T18:01:33.096 INFO:tasks.workunit.client.0.smithi042.stderr:+ sleep 30 2024-09-21T18:01:33.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"}]': finished 2024-09-21T18:01:33.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:32 smithi042 ceph-mon[29361]: osdmap e740: 8 total, 8 up, 8 in 2024-09-21T18:01:33.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:32 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"} : dispatch 2024-09-21T18:01:33.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"}]': finished 2024-09-21T18:01:33.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:32 smithi042 ceph-mon[38309]: osdmap e740: 8 total, 8 up, 8 in 2024-09-21T18:01:33.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:32 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"} : dispatch 2024-09-21T18:01:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:33 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"}]': finished 2024-09-21T18:01:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:33 smithi162 ceph-mon[32106]: osdmap e741: 8 total, 8 up, 8 in 2024-09-21T18:01:34.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:33 smithi162 ceph-mon[32106]: pgmap v1150: 176 pgs: 176 active+clean; 708 KiB data, 788 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 32 KiB/s wr, 3 op/s 2024-09-21T18:01:34.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:33 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"}]': finished 2024-09-21T18:01:34.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:33 smithi042 ceph-mon[29361]: osdmap e741: 8 total, 8 up, 8 in 2024-09-21T18:01:34.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:33 smithi042 ceph-mon[29361]: pgmap v1150: 176 pgs: 176 active+clean; 708 KiB data, 788 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 32 KiB/s wr, 3 op/s 2024-09-21T18:01:34.165 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:01:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:01:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:01:34.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:33 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/2869263765' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "app": "rados"}]': finished 2024-09-21T18:01:34.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:33 smithi042 ceph-mon[38309]: osdmap e741: 8 total, 8 up, 8 in 2024-09-21T18:01:34.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:33 smithi042 ceph-mon[38309]: pgmap v1150: 176 pgs: 176 active+clean; 708 KiB data, 788 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 32 KiB/s wr, 3 op/s 2024-09-21T18:01:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:34 smithi162 ceph-mon[32106]: pool '277077be-0cb2-4630-9bef-40c97902f85f' is full (reached quota's max_objects: 10) 2024-09-21T18:01:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:34 smithi162 ceph-mon[32106]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T18:01:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:34 smithi162 ceph-mon[32106]: osdmap e742: 8 total, 8 up, 8 in 2024-09-21T18:01:35.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:34 smithi042 ceph-mon[29361]: pool '277077be-0cb2-4630-9bef-40c97902f85f' is full (reached quota's max_objects: 10) 2024-09-21T18:01:35.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:34 smithi042 ceph-mon[29361]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T18:01:35.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:34 smithi042 ceph-mon[29361]: osdmap e742: 8 total, 8 up, 8 in 2024-09-21T18:01:35.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:34 smithi042 ceph-mon[38309]: pool '277077be-0cb2-4630-9bef-40c97902f85f' is full (reached quota's max_objects: 10) 2024-09-21T18:01:35.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:34 smithi042 ceph-mon[38309]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T18:01:35.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:34 smithi042 ceph-mon[38309]: osdmap e742: 8 total, 8 up, 8 in 2024-09-21T18:01:36.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:35 smithi162 ceph-mon[32106]: pgmap v1152: 176 pgs: 176 active+clean; 708 KiB data, 788 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 27 KiB/s wr, 3 op/s 2024-09-21T18:01:36.075 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:01:35 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=sqlstore.transactions t=2024-09-21T18:01:35.779770093Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T18:01:36.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:35 smithi042 ceph-mon[29361]: pgmap v1152: 176 pgs: 176 active+clean; 708 KiB data, 788 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 27 KiB/s wr, 3 op/s 2024-09-21T18:01:36.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:35 smithi042 ceph-mon[38309]: pgmap v1152: 176 pgs: 176 active+clean; 708 KiB data, 788 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 27 KiB/s wr, 3 op/s 2024-09-21T18:01:38.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:38 smithi162 ceph-mon[32106]: pgmap v1153: 176 pgs: 176 active+clean; 708 KiB data, 788 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-21T18:01:38.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:38 smithi042 ceph-mon[29361]: pgmap v1153: 176 pgs: 176 active+clean; 708 KiB data, 788 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-21T18:01:38.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:38 smithi042 ceph-mon[38309]: pgmap v1153: 176 pgs: 176 active+clean; 708 KiB data, 788 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-21T18:01:39.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:01:39 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:01:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:40.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:40 smithi162 ceph-mon[32106]: pgmap v1154: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-09-21T18:01:40.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:40.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:40 smithi042 ceph-mon[29361]: pgmap v1154: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-09-21T18:01:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:40 smithi042 ceph-mon[38309]: pgmap v1154: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-09-21T18:01:42.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:42 smithi162 ceph-mon[32106]: pgmap v1155: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-09-21T18:01:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:42 smithi042 ceph-mon[29361]: pgmap v1155: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-09-21T18:01:42.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:42 smithi042 ceph-mon[38309]: pgmap v1155: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-09-21T18:01:44.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:01:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:01:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:01:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:44 smithi162 ceph-mon[32106]: pgmap v1156: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:01:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:44 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:44.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:44 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:44.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:44 smithi042 ceph-mon[29361]: pgmap v1156: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:01:44.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:44 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:44.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:44 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:44 smithi042 ceph-mon[38309]: pgmap v1156: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:01:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:44 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:01:44.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:44 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:46.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:46 smithi162 ceph-mon[32106]: pgmap v1157: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 915 B/s rd, 0 op/s 2024-09-21T18:01:46.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:46 smithi042 ceph-mon[29361]: pgmap v1157: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 915 B/s rd, 0 op/s 2024-09-21T18:01:46.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:46 smithi042 ceph-mon[38309]: pgmap v1157: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 915 B/s rd, 0 op/s 2024-09-21T18:01:48.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:48 smithi162 ceph-mon[32106]: pgmap v1158: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:01:48.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:48 smithi042 ceph-mon[29361]: pgmap v1158: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:01:48.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:48 smithi042 ceph-mon[38309]: pgmap v1158: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:01:49.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:01:49 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:01:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:50 smithi162 ceph-mon[32106]: pgmap v1159: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:01:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:50 smithi042 ceph-mon[29361]: pgmap v1159: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:01:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:01:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:50 smithi042 ceph-mon[38309]: pgmap v1159: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:01:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:52 smithi162 ceph-mon[32106]: pgmap v1160: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:01:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:52 smithi042 ceph-mon[29361]: pgmap v1160: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:01:52.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:52 smithi042 ceph-mon[38309]: pgmap v1160: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:01:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:01:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:01:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:01:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:54 smithi162 ceph-mon[32106]: pgmap v1161: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:01:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:54 smithi042 ceph-mon[29361]: pgmap v1161: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:01:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:54 smithi042 ceph-mon[38309]: pgmap v1161: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:01:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:56 smithi162 ceph-mon[32106]: pgmap v1162: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:01:56.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:56 smithi042 ceph-mon[29361]: pgmap v1162: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:01:56.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:56 smithi042 ceph-mon[38309]: pgmap v1162: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:01:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:58 smithi162 ceph-mon[32106]: pgmap v1163: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:01:58.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:01:58 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:58 smithi042 ceph-mon[29361]: pgmap v1163: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:01:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:01:58 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:58 smithi042 ceph-mon[38309]: pgmap v1163: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:01:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:01:58 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:01:59.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:01:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:02:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:00.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:00 smithi162 ceph-mon[32106]: pgmap v1164: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:00 smithi042 ceph-mon[29361]: pgmap v1164: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:00 smithi042 ceph-mon[38309]: pgmap v1164: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:02.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:02 smithi162 ceph-mon[32106]: pgmap v1165: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:02.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:02 smithi042 ceph-mon[29361]: pgmap v1165: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:02.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:02 smithi042 ceph-mon[38309]: pgmap v1165: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:03.098 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=141349 2024-09-21T18:02:03.098 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool set-quota 277077be-0cb2-4630-9bef-40c97902f85f max_objects 100 2024-09-21T18:02:03.098 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put onemore /etc/passwd 2024-09-21T18:02:03.196 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.193+0000 7fa71635d640 1 -- 172.21.15.42:0/3329515779 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa710104d50 msgr2=0x7fa71010e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:03.196 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.193+0000 7fa71635d640 1 --2- 172.21.15.42:0/3329515779 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa710104d50 0x7fa71010e750 secure :-1 s=READY pgs=2989 cs=0 l=1 rev1=1 crypto rx=0x7fa708009ca0 tx=0x7fa70802a8c0 comp rx=0 tx=0).stop 2024-09-21T18:02:03.196 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.193+0000 7fa71635d640 1 -- 172.21.15.42:0/3329515779 shutdown_connections 2024-09-21T18:02:03.196 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.193+0000 7fa71635d640 1 --2- 172.21.15.42:0/3329515779 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa710104d50 0x7fa71010e750 unknown :-1 s=CLOSED pgs=2989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:03.196 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.193+0000 7fa71635d640 1 --2- 172.21.15.42:0/3329515779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7101043b0 0x7fa710104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:03.196 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.193+0000 7fa71635d640 1 --2- 172.21.15.42:0/3329515779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa710101f90 0x7fa710102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:03.196 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.193+0000 7fa71635d640 1 -- 172.21.15.42:0/3329515779 >> 172.21.15.42:0/3329515779 conn(0x7fa7100776a0 msgr2=0x7fa710077ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:03.196 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.193+0000 7fa71635d640 1 -- 172.21.15.42:0/3329515779 shutdown_connections 2024-09-21T18:02:03.197 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.193+0000 7fa71635d640 1 -- 172.21.15.42:0/3329515779 wait complete. 2024-09-21T18:02:03.197 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.193+0000 7fa71635d640 1 Processor -- start 2024-09-21T18:02:03.197 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa71635d640 1 -- start start 2024-09-21T18:02:03.199 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa71635d640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa710101f90 0x7fa710199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:03.199 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa71635d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7101043b0 0x7fa710199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:03.199 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa71635d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa710104d50 0x7fa71019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:03.199 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa71635d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa710111370 con 0x7fa710104d50 2024-09-21T18:02:03.199 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa71635d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101111f0 con 0x7fa7101043b0 2024-09-21T18:02:03.199 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa71635d640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fa7101114f0 con 0x7fa710101f90 2024-09-21T18:02:03.199 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa7148fa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa710104d50 0x7fa71019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:03.199 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa70ffff640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa710101f90 0x7fa710199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:03.199 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa7148fa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa710104d50 0x7fa71019a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55286/0 (socket says 172.21.15.42:55286) 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa7148fa640 1 -- 172.21.15.42:0/882852257 learned_addr learned my addr 172.21.15.42:0/882852257 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa70f7fe640 1 --2- 172.21.15.42:0/882852257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7101043b0 0x7fa710199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa70ffff640 1 -- 172.21.15.42:0/882852257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7101043b0 msgr2=0x7fa710199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa70ffff640 1 --2- 172.21.15.42:0/882852257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7101043b0 0x7fa710199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa70ffff640 1 -- 172.21.15.42:0/882852257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa710104d50 msgr2=0x7fa71019a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa70ffff640 1 --2- 172.21.15.42:0/882852257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa710104d50 0x7fa71019a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.194+0000 7fa70ffff640 1 -- 172.21.15.42:0/882852257 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7101a4a80 con 0x7fa710101f90 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.195+0000 7fa70ffff640 1 --2- 172.21.15.42:0/882852257 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa710101f90 0x7fa710199680 secure :-1 s=READY pgs=2990 cs=0 l=1 rev1=1 crypto rx=0x7fa700005fd0 tx=0x7fa70000dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.195+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700009c30 con 0x7fa710101f90 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.195+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fa7000044b0 con 0x7fa710101f90 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.195+0000 7fa71635d640 1 -- 172.21.15.42:0/882852257 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7101a4d70 con 0x7fa710101f90 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.195+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700003d60 con 0x7fa710101f90 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.195+0000 7fa71635d640 1 -- 172.21.15.42:0/882852257 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7101a52c0 con 0x7fa710101f90 2024-09-21T18:02:03.200 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.196+0000 7fa71635d640 1 -- 172.21.15.42:0/882852257 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa710102370 con 0x7fa710101f90 2024-09-21T18:02:03.201 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.197+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7fa700004000 con 0x7fa710101f90 2024-09-21T18:02:03.201 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.197+0000 7fa70d7fa640 1 --2- 172.21.15.42:0/882852257 >> v2:172.21.15.42:6800/36970769 conn(0x7fa6f807b110 0x7fa6f807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:03.201 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.197+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(742..742 src has 1..742) ==== 7814+0+0 (secure 0 0 0) 0x7fa70009e4a0 con 0x7fa710101f90 2024-09-21T18:02:03.201 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.197+0000 7fa70f7fe640 1 --2- 172.21.15.42:0/882852257 >> v2:172.21.15.42:6800/36970769 conn(0x7fa6f807b110 0x7fa6f807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:03.201 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.197+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=743}) -- 0x7fa6f8086660 con 0x7fa710101f90 2024-09-21T18:02:03.201 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.198+0000 7fa70f7fe640 1 --2- 172.21.15.42:0/882852257 >> v2:172.21.15.42:6800/36970769 conn(0x7fa6f807b110 0x7fa6f807d5d0 secure :-1 s=READY pgs=3875 cs=0 l=1 rev1=1 crypto rx=0x7fa7040095f0 tx=0x7fa704005f90 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:03.204 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.202+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fa700017020 con 0x7fa710101f90 2024-09-21T18:02:03.396 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.393+0000 7fa71635d640 1 -- 172.21.15.42:0/882852257 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} v 0) -- 0x7fa7101a5590 con 0x7fa710101f90 2024-09-21T18:02:03.564 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.561+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 <== mon.2 v2:172.21.15.42:3301/0 7 ==== osd_map(743..743 src has 1..743) ==== 628+0+0 (secure 0 0 0) 0x7fa7000d5810 con 0x7fa710101f90 2024-09-21T18:02:03.564 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.561+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=744}) -- 0x7fa6f80871d0 con 0x7fa710101f90 2024-09-21T18:02:03.566 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.564+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 <== mon.2 v2:172.21.15.42:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 277077be-0cb2-4630-9bef-40c97902f85f v743) ==== 225+0+0 (secure 0 0 0) 0x7fa700069420 con 0x7fa710101f90 2024-09-21T18:02:03.680 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:03.678+0000 7fa71635d640 1 -- 172.21.15.42:0/882852257 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} v 0) -- 0x7fa710063730 con 0x7fa710101f90 2024-09-21T18:02:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:03 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/882852257' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:03 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:03.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:03 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/882852257' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:03.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:03 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:03.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:03 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/882852257' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:03.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:03 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:02:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:02:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:02:04.308 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.305+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 <== mon.2 v2:172.21.15.42:3301/0 9 ==== osd_map(744..744 src has 1..744) ==== 628+0+0 (secure 0 0 0) 0x7fa70009c2a0 con 0x7fa710101f90 2024-09-21T18:02:04.308 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.305+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=745}) -- 0x7fa6f8087790 con 0x7fa710101f90 2024-09-21T18:02:04.314 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.311+0000 7fa70d7fa640 1 -- 172.21.15.42:0/882852257 <== mon.2 v2:172.21.15.42:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 277077be-0cb2-4630-9bef-40c97902f85f v744) ==== 225+0+0 (secure 0 0 0) 0x7fa70006e2d0 con 0x7fa710101f90 2024-09-21T18:02:04.314 INFO:tasks.workunit.client.0.smithi042.stderr:set-quota max_objects = 100 for pool 277077be-0cb2-4630-9bef-40c97902f85f 2024-09-21T18:02:04.318 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 -- 172.21.15.42:0/882852257 >> v2:172.21.15.42:6800/36970769 conn(0x7fa6f807b110 msgr2=0x7fa6f807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:04.318 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 --2- 172.21.15.42:0/882852257 >> v2:172.21.15.42:6800/36970769 conn(0x7fa6f807b110 0x7fa6f807d5d0 secure :-1 s=READY pgs=3875 cs=0 l=1 rev1=1 crypto rx=0x7fa7040095f0 tx=0x7fa704005f90 comp rx=0 tx=0).stop 2024-09-21T18:02:04.318 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 -- 172.21.15.42:0/882852257 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa710101f90 msgr2=0x7fa710199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:04.319 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 --2- 172.21.15.42:0/882852257 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa710101f90 0x7fa710199680 secure :-1 s=READY pgs=2990 cs=0 l=1 rev1=1 crypto rx=0x7fa700005fd0 tx=0x7fa70000dde0 comp rx=0 tx=0).stop 2024-09-21T18:02:04.319 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 -- 172.21.15.42:0/882852257 shutdown_connections 2024-09-21T18:02:04.319 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 --2- 172.21.15.42:0/882852257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa710104d50 0x7fa71019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:04.319 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 --2- 172.21.15.42:0/882852257 >> v2:172.21.15.42:6800/36970769 conn(0x7fa6f807b110 0x7fa6f807d5d0 unknown :-1 s=CLOSED pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:04.319 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 --2- 172.21.15.42:0/882852257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7101043b0 0x7fa710199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:04.319 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 --2- 172.21.15.42:0/882852257 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa710101f90 0x7fa710199680 unknown :-1 s=CLOSED pgs=2990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:04.319 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 -- 172.21.15.42:0/882852257 >> 172.21.15.42:0/882852257 conn(0x7fa7100776a0 msgr2=0x7fa710105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:04.319 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 -- 172.21.15.42:0/882852257 shutdown_connections 2024-09-21T18:02:04.319 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.316+0000 7fa71635d640 1 -- 172.21.15.42:0/882852257 wait complete. 2024-09-21T18:02:04.331 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 141349 2024-09-21T18:02:04.331 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 0 -ne 0 ']' 2024-09-21T18:02:04.331 INFO:tasks.workunit.client.0.smithi042.stderr:+ true 2024-09-21T18:02:04.331 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put twomore /etc/passwd 2024-09-21T18:02:04.371 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool set-quota 277077be-0cb2-4630-9bef-40c97902f85f max_bytes 100 2024-09-21T18:02:04.460 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.457+0000 7f3ba5016640 1 -- 172.21.15.42:0/2215120650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0108fe0 msgr2=0x7f3ba010f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:04.460 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.457+0000 7f3ba5016640 1 --2- 172.21.15.42:0/2215120650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0108fe0 0x7f3ba010f8b0 secure :-1 s=READY pgs=2909 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009900 tx=0x7f3b9802a480 comp rx=0 tx=0).stop 2024-09-21T18:02:04.460 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.457+0000 7f3ba5016640 1 -- 172.21.15.42:0/2215120650 shutdown_connections 2024-09-21T18:02:04.460 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.457+0000 7f3ba5016640 1 --2- 172.21.15.42:0/2215120650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0108fe0 0x7f3ba010f8b0 unknown :-1 s=CLOSED pgs=2909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:04.460 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.457+0000 7f3ba5016640 1 --2- 172.21.15.42:0/2215120650 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ba0102030 0x7f3ba0108800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:04.460 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.457+0000 7f3ba5016640 1 --2- 172.21.15.42:0/2215120650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ba0101710 0x7f3ba0101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:04.460 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.457+0000 7f3ba5016640 1 -- 172.21.15.42:0/2215120650 >> 172.21.15.42:0/2215120650 conn(0x7f3ba0076de0 msgr2=0x7f3ba00771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:04.461 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.457+0000 7f3ba5016640 1 -- 172.21.15.42:0/2215120650 shutdown_connections 2024-09-21T18:02:04.461 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.457+0000 7f3ba5016640 1 -- 172.21.15.42:0/2215120650 wait complete. 2024-09-21T18:02:04.463 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.458+0000 7f3ba5016640 1 Processor -- start 2024-09-21T18:02:04.463 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.458+0000 7f3ba5016640 1 -- start start 2024-09-21T18:02:04.463 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.458+0000 7f3ba5016640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0101710 0x7f3ba0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:04.463 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.458+0000 7f3ba5016640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ba0102030 0x7f3ba0198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:04.463 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.458+0000 7f3ba5016640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ba0108fe0 0x7f3ba019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:04.463 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.458+0000 7f3ba5016640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01123f0 con 0x7f3ba0101710 2024-09-21T18:02:04.463 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3ba5016640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba0112270 con 0x7f3ba0102030 2024-09-21T18:02:04.463 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3ba5016640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba0112570 con 0x7f3ba0108fe0 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0101710 0x7f3ba0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0101710 0x7f3ba0198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55340/0 (socket says 172.21.15.42:55340) 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9ed9d640 1 -- 172.21.15.42:0/4054595615 learned_addr learned my addr 172.21.15.42:0/4054595615 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9f59e640 1 --2- 172.21.15.42:0/4054595615 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ba0108fe0 0x7f3ba019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9e59c640 1 --2- 172.21.15.42:0/4054595615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ba0102030 0x7f3ba0198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9ed9d640 1 -- 172.21.15.42:0/4054595615 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ba0108fe0 msgr2=0x7f3ba019e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9ed9d640 1 --2- 172.21.15.42:0/4054595615 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ba0108fe0 0x7f3ba019e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9ed9d640 1 -- 172.21.15.42:0/4054595615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ba0102030 msgr2=0x7f3ba0198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9ed9d640 1 --2- 172.21.15.42:0/4054595615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ba0102030 0x7f3ba0198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9ed9d640 1 -- 172.21.15.42:0/4054595615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba019ea10 con 0x7f3ba0101710 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9e59c640 1 --2- 172.21.15.42:0/4054595615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ba0102030 0x7f3ba0198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T18:02:04.464 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b9ed9d640 1 --2- 172.21.15.42:0/4054595615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0101710 0x7f3ba0198970 secure :-1 s=READY pgs=2910 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000eab0 tx=0x7f3b9000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:04.465 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b87fff640 1 -- 172.21.15.42:0/4054595615 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9000ce40 con 0x7f3ba0101710 2024-09-21T18:02:04.465 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3ba5016640 1 -- 172.21.15.42:0/4054595615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba019ed00 con 0x7f3ba0101710 2024-09-21T18:02:04.465 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b87fff640 1 -- 172.21.15.42:0/4054595615 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f3b900118f0 con 0x7f3ba0101710 2024-09-21T18:02:04.465 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3b87fff640 1 -- 172.21.15.42:0/4054595615 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b900108f0 con 0x7f3ba0101710 2024-09-21T18:02:04.465 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.459+0000 7f3ba5016640 1 -- 172.21.15.42:0/4054595615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba01a55a0 con 0x7f3ba0101710 2024-09-21T18:02:04.465 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.460+0000 7f3ba5016640 1 -- 172.21.15.42:0/4054595615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba0101af0 con 0x7f3ba0101710 2024-09-21T18:02:04.466 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.461+0000 7f3b87fff640 1 -- 172.21.15.42:0/4054595615 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f3b90011aa0 con 0x7f3ba0101710 2024-09-21T18:02:04.466 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.461+0000 7f3b87fff640 1 --2- 172.21.15.42:0/4054595615 >> v2:172.21.15.42:6800/36970769 conn(0x7f3b8807b110 0x7f3b8807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:04.466 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.462+0000 7f3b87fff640 1 -- 172.21.15.42:0/4054595615 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(744..744 src has 1..744) ==== 7814+0+0 (secure 0 0 0) 0x7f3b9009f040 con 0x7f3ba0101710 2024-09-21T18:02:04.466 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.462+0000 7f3b9e59c640 1 --2- 172.21.15.42:0/4054595615 >> v2:172.21.15.42:6800/36970769 conn(0x7f3b8807b110 0x7f3b8807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:04.466 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.462+0000 7f3b9e59c640 1 --2- 172.21.15.42:0/4054595615 >> v2:172.21.15.42:6800/36970769 conn(0x7f3b8807b110 0x7f3b8807d5d0 secure :-1 s=READY pgs=3877 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00ffb90 tx=0x7f3b94005f90 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:04.468 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.466+0000 7f3b87fff640 1 -- 172.21.15.42:0/4054595615 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f3b90016030 con 0x7f3ba0101710 2024-09-21T18:02:04.658 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:04.656+0000 7f3ba5016640 1 -- 172.21.15.42:0/4054595615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"} v 0) -- 0x7f3ba0199a90 con 0x7f3ba0101710 2024-09-21T18:02:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:04 smithi162 ceph-mon[32106]: pgmap v1166: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"}]': finished 2024-09-21T18:02:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:04 smithi162 ceph-mon[32106]: osdmap e743: 8 total, 8 up, 8 in 2024-09-21T18:02:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:04 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/882852257' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:04.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:04 smithi162 ceph-mon[32106]: pool '277077be-0cb2-4630-9bef-40c97902f85f' no longer out of quota; removing NO_QUOTA flag 2024-09-21T18:02:04.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:04 smithi162 ceph-mon[32106]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T18:02:04.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:04 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"}]': finished 2024-09-21T18:02:04.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:04 smithi162 ceph-mon[32106]: osdmap e744: 8 total, 8 up, 8 in 2024-09-21T18:02:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[29361]: pgmap v1166: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"}]': finished 2024-09-21T18:02:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[29361]: osdmap e743: 8 total, 8 up, 8 in 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/882852257' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[29361]: pool '277077be-0cb2-4630-9bef-40c97902f85f' no longer out of quota; removing NO_QUOTA flag 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[29361]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"}]': finished 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[29361]: osdmap e744: 8 total, 8 up, 8 in 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[38309]: pgmap v1166: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"}]': finished 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[38309]: osdmap e743: 8 total, 8 up, 8 in 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/882852257' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T18:02:04.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[38309]: pool '277077be-0cb2-4630-9bef-40c97902f85f' no longer out of quota; removing NO_QUOTA flag 2024-09-21T18:02:04.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[38309]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T18:02:04.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "100"}]': finished 2024-09-21T18:02:04.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:04 smithi042 ceph-mon[38309]: osdmap e744: 8 total, 8 up, 8 in 2024-09-21T18:02:05.569 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:05.567+0000 7f3b87fff640 1 -- 172.21.15.42:0/4054595615 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 277077be-0cb2-4630-9bef-40c97902f85f v745) ==== 221+0+0 (secure 0 0 0) 0x7f3b90069f20 con 0x7f3ba0101710 2024-09-21T18:02:05.689 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:05.687+0000 7f3ba5016640 1 -- 172.21.15.42:0/4054595615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"} v 0) -- 0x7f3ba01099b0 con 0x7f3ba0101710 2024-09-21T18:02:05.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:05 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T18:02:05.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:05 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T18:02:05.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:05 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T18:02:06.571 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.568+0000 7f3b87fff640 1 -- 172.21.15.42:0/4054595615 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 277077be-0cb2-4630-9bef-40c97902f85f v746) ==== 221+0+0 (secure 0 0 0) 0x7f3b9006edd0 con 0x7f3ba0101710 2024-09-21T18:02:06.571 INFO:tasks.workunit.client.0.smithi042.stderr:set-quota max_bytes = 100 for pool 277077be-0cb2-4630-9bef-40c97902f85f 2024-09-21T18:02:06.576 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 -- 172.21.15.42:0/4054595615 >> v2:172.21.15.42:6800/36970769 conn(0x7f3b8807b110 msgr2=0x7f3b8807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:06.576 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 --2- 172.21.15.42:0/4054595615 >> v2:172.21.15.42:6800/36970769 conn(0x7f3b8807b110 0x7f3b8807d5d0 secure :-1 s=READY pgs=3877 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00ffb90 tx=0x7f3b94005f90 comp rx=0 tx=0).stop 2024-09-21T18:02:06.577 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 -- 172.21.15.42:0/4054595615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0101710 msgr2=0x7f3ba0198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:06.577 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 --2- 172.21.15.42:0/4054595615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0101710 0x7f3ba0198970 secure :-1 s=READY pgs=2910 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000eab0 tx=0x7f3b9000ef70 comp rx=0 tx=0).stop 2024-09-21T18:02:06.577 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 -- 172.21.15.42:0/4054595615 shutdown_connections 2024-09-21T18:02:06.577 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 --2- 172.21.15.42:0/4054595615 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ba0108fe0 0x7f3ba019e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:06.577 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 --2- 172.21.15.42:0/4054595615 >> v2:172.21.15.42:6800/36970769 conn(0x7f3b8807b110 0x7f3b8807d5d0 unknown :-1 s=CLOSED pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:06.577 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 --2- 172.21.15.42:0/4054595615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ba0102030 0x7f3ba0198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:06.577 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 --2- 172.21.15.42:0/4054595615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0101710 0x7f3ba0198970 secure :-1 s=CLOSED pgs=2910 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000eab0 tx=0x7f3b9000ef70 comp rx=0 tx=0).stop 2024-09-21T18:02:06.577 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 -- 172.21.15.42:0/4054595615 >> 172.21.15.42:0/4054595615 conn(0x7f3ba0076de0 msgr2=0x7f3ba0106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:06.577 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 -- 172.21.15.42:0/4054595615 shutdown_connections 2024-09-21T18:02:06.577 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:06.573+0000 7f3ba5016640 1 -- 172.21.15.42:0/4054595615 wait complete. 2024-09-21T18:02:06.589 INFO:tasks.workunit.client.0.smithi042.stderr:+ sleep 30 2024-09-21T18:02:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:06 smithi042 ceph-mon[29361]: pgmap v1169: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T18:02:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:06 smithi042 ceph-mon[29361]: osdmap e745: 8 total, 8 up, 8 in 2024-09-21T18:02:06.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:06 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T18:02:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:06 smithi042 ceph-mon[38309]: pgmap v1169: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T18:02:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:06 smithi042 ceph-mon[38309]: osdmap e745: 8 total, 8 up, 8 in 2024-09-21T18:02:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:06 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T18:02:07.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:06 smithi162 ceph-mon[32106]: pgmap v1169: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:07.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T18:02:07.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:06 smithi162 ceph-mon[32106]: osdmap e745: 8 total, 8 up, 8 in 2024-09-21T18:02:07.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:06 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T18:02:07.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:07 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T18:02:07.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:07 smithi042 ceph-mon[29361]: osdmap e746: 8 total, 8 up, 8 in 2024-09-21T18:02:07.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:07 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T18:02:07.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:07 smithi042 ceph-mon[38309]: osdmap e746: 8 total, 8 up, 8 in 2024-09-21T18:02:08.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:07 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4054595615' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T18:02:08.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:07 smithi162 ceph-mon[32106]: osdmap e746: 8 total, 8 up, 8 in 2024-09-21T18:02:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:08 smithi042 ceph-mon[29361]: pgmap v1172: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:02:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:08 smithi042 ceph-mon[38309]: pgmap v1172: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:02:09.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:08 smithi162 ceph-mon[32106]: pgmap v1172: 176 pgs: 176 active+clean; 708 KiB data, 789 MiB used, 714 GiB / 715 GiB avail 2024-09-21T18:02:09.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:02:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:02:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:09 smithi162 ceph-mon[32106]: pool '277077be-0cb2-4630-9bef-40c97902f85f' is full (reached quota's max_bytes: 100 B) 2024-09-21T18:02:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:09 smithi162 ceph-mon[32106]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T18:02:09.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:09 smithi162 ceph-mon[32106]: osdmap e747: 8 total, 8 up, 8 in 2024-09-21T18:02:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:09 smithi042 ceph-mon[29361]: pool '277077be-0cb2-4630-9bef-40c97902f85f' is full (reached quota's max_bytes: 100 B) 2024-09-21T18:02:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:09 smithi042 ceph-mon[29361]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T18:02:09.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:09 smithi042 ceph-mon[29361]: osdmap e747: 8 total, 8 up, 8 in 2024-09-21T18:02:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:09 smithi042 ceph-mon[38309]: pool '277077be-0cb2-4630-9bef-40c97902f85f' is full (reached quota's max_bytes: 100 B) 2024-09-21T18:02:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:09 smithi042 ceph-mon[38309]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T18:02:09.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:09 smithi042 ceph-mon[38309]: osdmap e747: 8 total, 8 up, 8 in 2024-09-21T18:02:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:10 smithi042 ceph-mon[29361]: pgmap v1174: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 987 B/s rd, 5.0 KiB/s wr, 1 op/s 2024-09-21T18:02:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:10 smithi042 ceph-mon[38309]: pgmap v1174: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 987 B/s rd, 5.0 KiB/s wr, 1 op/s 2024-09-21T18:02:11.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:11.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:10 smithi162 ceph-mon[32106]: pgmap v1174: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 987 B/s rd, 5.0 KiB/s wr, 1 op/s 2024-09-21T18:02:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:12 smithi042 ceph-mon[29361]: pgmap v1175: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-21T18:02:12.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:12 smithi042 ceph-mon[38309]: pgmap v1175: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-21T18:02:13.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:12 smithi162 ceph-mon[32106]: pgmap v1175: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-21T18:02:13.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:13 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:02:13.881 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:13 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:02:14.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:13 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:02:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:02:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:02:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:02:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:14 smithi042 ceph-mon[29361]: pgmap v1176: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.3 KiB/s wr, 1 op/s 2024-09-21T18:02:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:14 smithi042 ceph-mon[38309]: pgmap v1176: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.3 KiB/s wr, 1 op/s 2024-09-21T18:02:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:14 smithi162 ceph-mon[32106]: pgmap v1176: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.3 KiB/s wr, 1 op/s 2024-09-21T18:02:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:16 smithi042 ceph-mon[29361]: pgmap v1177: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2024-09-21T18:02:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:16 smithi042 ceph-mon[38309]: pgmap v1177: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2024-09-21T18:02:17.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:16 smithi162 ceph-mon[32106]: pgmap v1177: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2024-09-21T18:02:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:18 smithi042 ceph-mon[29361]: pgmap v1178: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.6 KiB/s wr, 1 op/s 2024-09-21T18:02:18.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:18 smithi042 ceph-mon[38309]: pgmap v1178: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.6 KiB/s wr, 1 op/s 2024-09-21T18:02:19.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:18 smithi162 ceph-mon[32106]: pgmap v1178: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.6 KiB/s wr, 1 op/s 2024-09-21T18:02:19.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:02:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:02:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:20 smithi042 ceph-mon[29361]: pgmap v1179: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1005 B/s rd, 0 op/s 2024-09-21T18:02:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:20 smithi042 ceph-mon[38309]: pgmap v1179: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1005 B/s rd, 0 op/s 2024-09-21T18:02:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:20 smithi162 ceph-mon[32106]: pgmap v1179: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1005 B/s rd, 0 op/s 2024-09-21T18:02:22.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:22 smithi042 ceph-mon[29361]: pgmap v1180: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:22.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:22 smithi042 ceph-mon[38309]: pgmap v1180: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:22 smithi162 ceph-mon[32106]: pgmap v1180: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:02:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:02:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:02:24.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:24 smithi042 ceph-mon[29361]: pgmap v1181: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:24 smithi042 ceph-mon[38309]: pgmap v1181: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:24 smithi162 ceph-mon[32106]: pgmap v1181: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:26.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:26 smithi162 ceph-mon[32106]: pgmap v1182: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:26 smithi042 ceph-mon[29361]: pgmap v1182: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:26.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:26 smithi042 ceph-mon[38309]: pgmap v1182: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:02:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:27.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:02:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:02:27.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:02:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:27.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:02:27.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:02:27.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:27 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:27 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:02:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:27 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:27 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:27 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:02:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:27 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:02:28.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:27 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:28 smithi042 ceph-mon[29361]: pgmap v1183: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:02:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:28 smithi042 ceph-mon[38309]: pgmap v1183: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:02:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:28 smithi162 ceph-mon[32106]: pgmap v1183: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:02:29.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:02:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:02:30.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:30.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:30 smithi042 ceph-mon[29361]: pgmap v1184: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:30 smithi042 ceph-mon[38309]: pgmap v1184: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:31.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:30 smithi162 ceph-mon[32106]: pgmap v1184: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:32.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:32 smithi042 ceph-mon[29361]: pgmap v1185: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:32.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:32 smithi042 ceph-mon[38309]: pgmap v1185: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:32 smithi162 ceph-mon[32106]: pgmap v1185: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:34.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:02:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:02:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:02:34.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:34 smithi042 ceph-mon[29361]: pgmap v1186: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:34.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:34 smithi042 ceph-mon[38309]: pgmap v1186: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:34 smithi162 ceph-mon[32106]: pgmap v1186: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:36.591 INFO:tasks.workunit.client.0.smithi042.stderr:+ pid=141520 2024-09-21T18:02:36.591 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool set-quota 277077be-0cb2-4630-9bef-40c97902f85f max_bytes 0 2024-09-21T18:02:36.592 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put two /etc/passwd 2024-09-21T18:02:36.694 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.691+0000 7f888a7f3640 1 -- 172.21.15.42:0/2472151512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88841086d0 msgr2=0x7f8884108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:36.694 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.691+0000 7f888a7f3640 1 --2- 172.21.15.42:0/2472151512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88841086d0 0x7f8884108b10 secure :-1 s=READY pgs=2914 cs=0 l=1 rev1=1 crypto rx=0x7f8878009900 tx=0x7f887802a410 comp rx=0 tx=0).stop 2024-09-21T18:02:36.694 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.691+0000 7f888a7f3640 1 -- 172.21.15.42:0/2472151512 shutdown_connections 2024-09-21T18:02:36.694 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.691+0000 7f888a7f3640 1 --2- 172.21.15.42:0/2472151512 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8884109050 0x7f888410f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:36.694 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.691+0000 7f888a7f3640 1 --2- 172.21.15.42:0/2472151512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88841086d0 0x7f8884108b10 unknown :-1 s=CLOSED pgs=2914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:36.694 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.691+0000 7f888a7f3640 1 --2- 172.21.15.42:0/2472151512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888406a540 0x7f888406a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:36.694 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.691+0000 7f888a7f3640 1 -- 172.21.15.42:0/2472151512 >> 172.21.15.42:0/2472151512 conn(0x7f88840776a0 msgr2=0x7f8884077ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:36.694 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.691+0000 7f888a7f3640 1 -- 172.21.15.42:0/2472151512 shutdown_connections 2024-09-21T18:02:36.695 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.691+0000 7f888a7f3640 1 -- 172.21.15.42:0/2472151512 wait complete. 2024-09-21T18:02:36.696 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.692+0000 7f888a7f3640 1 Processor -- start 2024-09-21T18:02:36.696 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.692+0000 7f888a7f3640 1 -- start start 2024-09-21T18:02:36.696 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.692+0000 7f888a7f3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f888406a540 0x7f8884198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:36.696 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.692+0000 7f888a7f3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88841086d0 0x7f8884198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.692+0000 7f888a7f3640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8884109050 0x7f888419e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.692+0000 7f888a7f3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8884112420 con 0x7f888406a540 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.692+0000 7f888a7f3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88841122a0 con 0x7f88841086d0 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.692+0000 7f888a7f3640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f88841125a0 con 0x7f8884109050 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.692+0000 7f8883fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f888406a540 0x7f8884198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f8888d90640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8884109050 0x7f888419e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f8883fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f888406a540 0x7f8884198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:32944/0 (socket says 172.21.15.42:32944) 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f8888d90640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8884109050 0x7f888419e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:59490/0 (socket says 172.21.15.42:59490) 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f8883fff640 1 -- 172.21.15.42:0/394375344 learned_addr learned my addr 172.21.15.42:0/394375344 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f88837fe640 1 --2- 172.21.15.42:0/394375344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88841086d0 0x7f8884198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f8883fff640 1 -- 172.21.15.42:0/394375344 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8884109050 msgr2=0x7f888419e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f8883fff640 1 --2- 172.21.15.42:0/394375344 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8884109050 0x7f888419e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f8883fff640 1 -- 172.21.15.42:0/394375344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88841086d0 msgr2=0x7f8884198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:36.697 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f8883fff640 1 --2- 172.21.15.42:0/394375344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88841086d0 0x7f8884198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:36.698 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f8883fff640 1 -- 172.21.15.42:0/394375344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888419e9c0 con 0x7f888406a540 2024-09-21T18:02:36.698 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f8888d90640 1 --2- 172.21.15.42:0/394375344 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8884109050 0x7f888419e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T18:02:36.698 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f8883fff640 1 --2- 172.21.15.42:0/394375344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f888406a540 0x7f8884198920 secure :-1 s=READY pgs=2915 cs=0 l=1 rev1=1 crypto rx=0x7f887400d950 tx=0x7f887400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:36.698 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874017030 con 0x7f888406a540 2024-09-21T18:02:36.698 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f8874004020 con 0x7f888406a540 2024-09-21T18:02:36.698 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88740055a0 con 0x7f888406a540 2024-09-21T18:02:36.698 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f888a7f3640 1 -- 172.21.15.42:0/394375344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888419ecb0 con 0x7f888406a540 2024-09-21T18:02:36.698 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.693+0000 7f888a7f3640 1 -- 172.21.15.42:0/394375344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88841a5370 con 0x7f888406a540 2024-09-21T18:02:36.699 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.694+0000 7f888a7f3640 1 -- 172.21.15.42:0/394375344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f888406a920 con 0x7f888406a540 2024-09-21T18:02:36.699 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.695+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f8874009a30 con 0x7f888406a540 2024-09-21T18:02:36.699 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.696+0000 7f88817fa640 1 --2- 172.21.15.42:0/394375344 >> v2:172.21.15.42:6800/36970769 conn(0x7f886c07b110 0x7f886c07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:36.699 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.696+0000 7f88837fe640 1 --2- 172.21.15.42:0/394375344 >> v2:172.21.15.42:6800/36970769 conn(0x7f886c07b110 0x7f886c07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:36.699 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.696+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(747..747 src has 1..747) ==== 7814+0+0 (secure 0 0 0) 0x7f887409e360 con 0x7f888406a540 2024-09-21T18:02:36.699 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.696+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=748}) -- 0x7f886c086660 con 0x7f888406a540 2024-09-21T18:02:36.699 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.696+0000 7f88837fe640 1 --2- 172.21.15.42:0/394375344 >> v2:172.21.15.42:6800/36970769 conn(0x7f886c07b110 0x7f886c07d5d0 secure :-1 s=READY pgs=3879 cs=0 l=1 rev1=1 crypto rx=0x7f8878031440 tx=0x7f8878005b50 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:36.702 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.700+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f88740692e0 con 0x7f888406a540 2024-09-21T18:02:36.894 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:36.891+0000 7f888a7f3640 1 -- 172.21.15.42:0/394375344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} v 0) -- 0x7f8884199a40 con 0x7f888406a540 2024-09-21T18:02:36.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:36 smithi042 ceph-mon[29361]: pgmap v1187: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:36.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:36 smithi042 ceph-mon[38309]: pgmap v1187: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:36 smithi162 ceph-mon[32106]: pgmap v1187: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:37.636 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:37.634+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f v748) ==== 217+0+0 (secure 0 0 0) 0x7f887406e190 con 0x7f888406a540 2024-09-21T18:02:37.637 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:37.634+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 <== mon.0 v2:172.21.15.42:3300/0 8 ==== osd_map(748..748 src has 1..748) ==== 628+0+0 (secure 0 0 0) 0x7f88740d5810 con 0x7f888406a540 2024-09-21T18:02:37.637 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:37.634+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=749}) -- 0x7f886c0875c0 con 0x7f888406a540 2024-09-21T18:02:37.761 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:37.758+0000 7f888a7f3640 1 -- 172.21.15.42:0/394375344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} v 0) -- 0x7f888410ae30 con 0x7f888406a540 2024-09-21T18:02:37.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:37 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:02:37.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:37 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:02:38.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:37 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:02:38.642 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.640+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 <== mon.0 v2:172.21.15.42:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f v749) ==== 217+0+0 (secure 0 0 0) 0x7f8874009d20 con 0x7f888406a540 2024-09-21T18:02:38.643 INFO:tasks.workunit.client.0.smithi042.stderr:set-quota max_bytes = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f 2024-09-21T18:02:38.643 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.640+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 <== mon.0 v2:172.21.15.42:3300/0 10 ==== osd_map(749..749 src has 1..749) ==== 628+0+0 (secure 0 0 0) 0x7f887409c160 con 0x7f888406a540 2024-09-21T18:02:38.643 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.640+0000 7f88817fa640 1 -- 172.21.15.42:0/394375344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=750}) -- 0x7f886c087880 con 0x7f888406a540 2024-09-21T18:02:38.647 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.644+0000 7f888a7f3640 1 -- 172.21.15.42:0/394375344 >> v2:172.21.15.42:6800/36970769 conn(0x7f886c07b110 msgr2=0x7f886c07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:38.647 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.644+0000 7f888a7f3640 1 --2- 172.21.15.42:0/394375344 >> v2:172.21.15.42:6800/36970769 conn(0x7f886c07b110 0x7f886c07d5d0 secure :-1 s=READY pgs=3879 cs=0 l=1 rev1=1 crypto rx=0x7f8878031440 tx=0x7f8878005b50 comp rx=0 tx=0).stop 2024-09-21T18:02:38.647 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.644+0000 7f888a7f3640 1 -- 172.21.15.42:0/394375344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f888406a540 msgr2=0x7f8884198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:38.647 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.644+0000 7f888a7f3640 1 --2- 172.21.15.42:0/394375344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f888406a540 0x7f8884198920 secure :-1 s=READY pgs=2915 cs=0 l=1 rev1=1 crypto rx=0x7f887400d950 tx=0x7f887400de10 comp rx=0 tx=0).stop 2024-09-21T18:02:38.647 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.645+0000 7f888a7f3640 1 -- 172.21.15.42:0/394375344 shutdown_connections 2024-09-21T18:02:38.647 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.645+0000 7f888a7f3640 1 --2- 172.21.15.42:0/394375344 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8884109050 0x7f888419e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:38.648 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.645+0000 7f888a7f3640 1 --2- 172.21.15.42:0/394375344 >> v2:172.21.15.42:6800/36970769 conn(0x7f886c07b110 0x7f886c07d5d0 unknown :-1 s=CLOSED pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:38.648 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.645+0000 7f888a7f3640 1 --2- 172.21.15.42:0/394375344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88841086d0 0x7f8884198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:38.648 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.645+0000 7f888a7f3640 1 --2- 172.21.15.42:0/394375344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f888406a540 0x7f8884198920 unknown :-1 s=CLOSED pgs=2915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:38.648 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.645+0000 7f888a7f3640 1 -- 172.21.15.42:0/394375344 >> 172.21.15.42:0/394375344 conn(0x7f88840776a0 msgr2=0x7f8884104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:38.648 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.645+0000 7f888a7f3640 1 -- 172.21.15.42:0/394375344 shutdown_connections 2024-09-21T18:02:38.648 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.645+0000 7f888a7f3640 1 -- 172.21.15.42:0/394375344 wait complete. 2024-09-21T18:02:38.661 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool set-quota 277077be-0cb2-4630-9bef-40c97902f85f max_objects 0 2024-09-21T18:02:38.752 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.749+0000 7f5f7975d640 1 -- 172.21.15.42:0/3619139941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f741075f0 msgr2=0x7f5f74107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:38.752 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.749+0000 7f5f7975d640 1 --2- 172.21.15.42:0/3619139941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f741075f0 0x7f5f74107a30 secure :-1 s=READY pgs=2916 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009900 tx=0x7f5f6802a410 comp rx=0 tx=0).stop 2024-09-21T18:02:38.752 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.749+0000 7f5f7975d640 1 -- 172.21.15.42:0/3619139941 shutdown_connections 2024-09-21T18:02:38.752 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.749+0000 7f5f7975d640 1 --2- 172.21.15.42:0/3619139941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f74107f70 0x7f5f7410e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:38.752 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.749+0000 7f5f7975d640 1 --2- 172.21.15.42:0/3619139941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f741075f0 0x7f5f74107a30 unknown :-1 s=CLOSED pgs=2916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:38.752 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.749+0000 7f5f7975d640 1 --2- 172.21.15.42:0/3619139941 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f74101bf0 0x7f5f74101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:38.753 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.749+0000 7f5f7975d640 1 -- 172.21.15.42:0/3619139941 >> 172.21.15.42:0/3619139941 conn(0x7f5f740fd630 msgr2=0x7f5f740ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:38.753 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.749+0000 7f5f7975d640 1 -- 172.21.15.42:0/3619139941 shutdown_connections 2024-09-21T18:02:38.753 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.749+0000 7f5f7975d640 1 -- 172.21.15.42:0/3619139941 wait complete. 2024-09-21T18:02:38.753 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f7975d640 1 Processor -- start 2024-09-21T18:02:38.754 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f7975d640 1 -- start start 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f7975d640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f74101bf0 0x7f5f740fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f7975d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f741075f0 0x7f5f740fe070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f7975d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f74107f70 0x7f5f740fe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f7975d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5f741112d0 con 0x7f5f74107f70 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f7975d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f74111150 con 0x7f5f741075f0 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f7975d640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f5f74111450 con 0x7f5f74101bf0 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f72ffd640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f74101bf0 0x7f5f740fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f72ffd640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f74101bf0 0x7f5f740fdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:59506/0 (socket says 172.21.15.42:59506) 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f72ffd640 1 -- 172.21.15.42:0/259748198 learned_addr learned my addr 172.21.15.42:0/259748198 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.750+0000 7f5f737fe640 1 --2- 172.21.15.42:0/259748198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f74107f70 0x7f5f740fe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f727fc640 1 --2- 172.21.15.42:0/259748198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f741075f0 0x7f5f740fe070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f72ffd640 1 -- 172.21.15.42:0/259748198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f741075f0 msgr2=0x7f5f740fe070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f72ffd640 1 --2- 172.21.15.42:0/259748198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f741075f0 0x7f5f740fe070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:38.755 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f72ffd640 1 -- 172.21.15.42:0/259748198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f74107f70 msgr2=0x7f5f740fe5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:38.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f72ffd640 1 --2- 172.21.15.42:0/259748198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f74107f70 0x7f5f740fe5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:38.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f72ffd640 1 -- 172.21.15.42:0/259748198 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f741a6dc0 con 0x7f5f74101bf0 2024-09-21T18:02:38.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f727fc640 1 --2- 172.21.15.42:0/259748198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f741075f0 0x7f5f740fe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T18:02:38.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f72ffd640 1 --2- 172.21.15.42:0/259748198 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f74101bf0 0x7f5f740fdb30 secure :-1 s=READY pgs=2994 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400ea60 tx=0x7f5f6400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:38.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6400cde0 con 0x7f5f74101bf0 2024-09-21T18:02:38.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5f640035f0 con 0x7f5f74101bf0 2024-09-21T18:02:38.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f7975d640 1 -- 172.21.15.42:0/259748198 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f741a70b0 con 0x7f5f74101bf0 2024-09-21T18:02:38.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f640044a0 con 0x7f5f74101bf0 2024-09-21T18:02:38.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.751+0000 7f5f7975d640 1 -- 172.21.15.42:0/259748198 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f741a75d0 con 0x7f5f74101bf0 2024-09-21T18:02:38.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.752+0000 7f5f7975d640 1 -- 172.21.15.42:0/259748198 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f74101fd0 con 0x7f5f74101bf0 2024-09-21T18:02:38.757 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.753+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f5f64004000 con 0x7f5f74101bf0 2024-09-21T18:02:38.757 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.754+0000 7f5f5bfff640 1 --2- 172.21.15.42:0/259748198 >> v2:172.21.15.42:6800/36970769 conn(0x7f5f5c07b110 0x7f5f5c07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:38.757 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.754+0000 7f5f727fc640 1 --2- 172.21.15.42:0/259748198 >> v2:172.21.15.42:6800/36970769 conn(0x7f5f5c07b110 0x7f5f5c07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:38.757 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.754+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(749..749 src has 1..749) ==== 7814+0+0 (secure 0 0 0) 0x7f5f6409ee10 con 0x7f5f74101bf0 2024-09-21T18:02:38.757 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.754+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=750}) -- 0x7f5f5c0866c0 con 0x7f5f74101bf0 2024-09-21T18:02:38.757 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.754+0000 7f5f727fc640 1 --2- 172.21.15.42:0/259748198 >> v2:172.21.15.42:6800/36970769 conn(0x7f5f5c07b110 0x7f5f5c07d5d0 secure :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 crypto rx=0x7f5f68031440 tx=0x7f5f68005a20 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:38.760 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.758+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f5f640a2030 con 0x7f5f74101bf0 2024-09-21T18:02:38.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:38 smithi042 ceph-mon[29361]: pgmap v1188: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:38.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:02:38.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:38 smithi042 ceph-mon[29361]: osdmap e748: 8 total, 8 up, 8 in 2024-09-21T18:02:38.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:38 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:02:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:38 smithi042 ceph-mon[38309]: pgmap v1188: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:02:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:38 smithi042 ceph-mon[38309]: osdmap e748: 8 total, 8 up, 8 in 2024-09-21T18:02:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:38 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:02:38.951 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:38.948+0000 7f5f7975d640 1 -- 172.21.15.42:0/259748198 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} v 0) -- 0x7f5f741a7890 con 0x7f5f74101bf0 2024-09-21T18:02:39.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:38 smithi162 ceph-mon[32106]: pgmap v1188: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:39.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:02:39.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:38 smithi162 ceph-mon[32106]: osdmap e748: 8 total, 8 up, 8 in 2024-09-21T18:02:39.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:38 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:02:39.316 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:39.314+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 <== mon.2 v2:172.21.15.42:3301/0 7 ==== osd_map(750..750 src has 1..750) ==== 628+0+0 (secure 0 0 0) 0x7f5f6409cb70 con 0x7f5f74101bf0 2024-09-21T18:02:39.316 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:39.314+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=751}) -- 0x7f5f5c087230 con 0x7f5f74101bf0 2024-09-21T18:02:39.320 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:39.318+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 <== mon.2 v2:172.21.15.42:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f v750) ==== 221+0+0 (secure 0 0 0) 0x7f5f64069cf0 con 0x7f5f74101bf0 2024-09-21T18:02:39.436 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:39.433+0000 7f5f7975d640 1 -- 172.21.15.42:0/259748198 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} v 0) -- 0x7f5f741a7cf0 con 0x7f5f74101bf0 2024-09-21T18:02:39.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:02:39 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:02:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:02:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:39 smithi162 ceph-mon[32106]: osdmap e749: 8 total, 8 up, 8 in 2024-09-21T18:02:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/259748198' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:39.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:39.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:39 smithi162 ceph-mon[32106]: pool '277077be-0cb2-4630-9bef-40c97902f85f' no longer out of quota; removing NO_QUOTA flag 2024-09-21T18:02:39.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:39 smithi162 ceph-mon[32106]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T18:02:39.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:02:39.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:39 smithi162 ceph-mon[32106]: osdmap e750: 8 total, 8 up, 8 in 2024-09-21T18:02:39.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:39 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/259748198' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:39.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:39 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:39.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:02:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[38309]: osdmap e749: 8 total, 8 up, 8 in 2024-09-21T18:02:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/259748198' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[38309]: pool '277077be-0cb2-4630-9bef-40c97902f85f' no longer out of quota; removing NO_QUOTA flag 2024-09-21T18:02:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[38309]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T18:02:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:02:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[38309]: osdmap e750: 8 total, 8 up, 8 in 2024-09-21T18:02:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/259748198' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:39.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:39.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/394375344' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:02:39.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[29361]: osdmap e749: 8 total, 8 up, 8 in 2024-09-21T18:02:39.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/259748198' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:39.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:39.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[29361]: pool '277077be-0cb2-4630-9bef-40c97902f85f' no longer out of quota; removing NO_QUOTA flag 2024-09-21T18:02:39.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[29361]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T18:02:39.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:02:39.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[29361]: osdmap e750: 8 total, 8 up, 8 in 2024-09-21T18:02:39.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/259748198' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:39.916 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:39 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:02:40.321 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.318+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 <== mon.2 v2:172.21.15.42:3301/0 9 ==== osd_map(751..751 src has 1..751) ==== 628+0+0 (secure 0 0 0) 0x7f5f64061480 con 0x7f5f74101bf0 2024-09-21T18:02:40.324 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.322+0000 7f5f5bfff640 1 -- 172.21.15.42:0/259748198 <== mon.2 v2:172.21.15.42:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f v751) ==== 221+0+0 (secure 0 0 0) 0x7f5f6406eba0 con 0x7f5f74101bf0 2024-09-21T18:02:40.325 INFO:tasks.workunit.client.0.smithi042.stderr:set-quota max_objects = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f 2024-09-21T18:02:40.329 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.326+0000 7f5f7975d640 1 -- 172.21.15.42:0/259748198 >> v2:172.21.15.42:6800/36970769 conn(0x7f5f5c07b110 msgr2=0x7f5f5c07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:40.329 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.326+0000 7f5f7975d640 1 --2- 172.21.15.42:0/259748198 >> v2:172.21.15.42:6800/36970769 conn(0x7f5f5c07b110 0x7f5f5c07d5d0 secure :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 crypto rx=0x7f5f68031440 tx=0x7f5f68005a20 comp rx=0 tx=0).stop 2024-09-21T18:02:40.329 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.326+0000 7f5f7975d640 1 -- 172.21.15.42:0/259748198 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f74101bf0 msgr2=0x7f5f740fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:40.329 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.326+0000 7f5f7975d640 1 --2- 172.21.15.42:0/259748198 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f74101bf0 0x7f5f740fdb30 secure :-1 s=READY pgs=2994 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400ea60 tx=0x7f5f6400ef20 comp rx=0 tx=0).stop 2024-09-21T18:02:40.329 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.327+0000 7f5f7975d640 1 -- 172.21.15.42:0/259748198 shutdown_connections 2024-09-21T18:02:40.329 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.327+0000 7f5f7975d640 1 --2- 172.21.15.42:0/259748198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f74107f70 0x7f5f740fe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:40.330 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.327+0000 7f5f7975d640 1 --2- 172.21.15.42:0/259748198 >> v2:172.21.15.42:6800/36970769 conn(0x7f5f5c07b110 0x7f5f5c07d5d0 unknown :-1 s=CLOSED pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:40.330 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.327+0000 7f5f7975d640 1 --2- 172.21.15.42:0/259748198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f741075f0 0x7f5f740fe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:40.330 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.327+0000 7f5f7975d640 1 --2- 172.21.15.42:0/259748198 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f74101bf0 0x7f5f740fdb30 unknown :-1 s=CLOSED pgs=2994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:40.330 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.327+0000 7f5f7975d640 1 -- 172.21.15.42:0/259748198 >> 172.21.15.42:0/259748198 conn(0x7f5f740fd630 msgr2=0x7f5f74100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:40.330 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.327+0000 7f5f7975d640 1 -- 172.21.15.42:0/259748198 shutdown_connections 2024-09-21T18:02:40.330 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.327+0000 7f5f7975d640 1 -- 172.21.15.42:0/259748198 wait complete. 2024-09-21T18:02:40.340 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait 141520 2024-09-21T18:02:40.340 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 0 -ne 0 ']' 2024-09-21T18:02:40.341 INFO:tasks.workunit.client.0.smithi042.stderr:+ true 2024-09-21T18:02:40.341 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put three /etc/passwd 2024-09-21T18:02:40.381 INFO:tasks.workunit.client.0.smithi042.stderr:++ uuidgen 2024-09-21T18:02:40.382 INFO:tasks.workunit.client.0.smithi042.stderr:+ pp=e3e943c5-f73c-42c4-bca2-88d8a4b98f11 2024-09-21T18:02:40.382 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool create e3e943c5-f73c-42c4-bca2-88d8a4b98f11 12 2024-09-21T18:02:40.469 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.466+0000 7f2c4152b640 1 -- 172.21.15.42:0/3860969214 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c3c10d050 msgr2=0x7f2c3c10f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:40.469 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.466+0000 7f2c4152b640 1 --2- 172.21.15.42:0/3860969214 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c3c10d050 0x7f2c3c10f4d0 secure :-1 s=READY pgs=2996 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009ca0 tx=0x7f2c2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T18:02:40.469 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.466+0000 7f2c4152b640 1 -- 172.21.15.42:0/3860969214 shutdown_connections 2024-09-21T18:02:40.470 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.466+0000 7f2c4152b640 1 --2- 172.21.15.42:0/3860969214 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c3c10d050 0x7f2c3c10f4d0 unknown :-1 s=CLOSED pgs=2996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:40.470 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.466+0000 7f2c4152b640 1 --2- 172.21.15.42:0/3860969214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c3c104520 0x7f2c3c10ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:40.470 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.466+0000 7f2c4152b640 1 --2- 172.21.15.42:0/3860969214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3c103c00 0x7f2c3c103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:40.470 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.466+0000 7f2c4152b640 1 -- 172.21.15.42:0/3860969214 >> 172.21.15.42:0/3860969214 conn(0x7f2c3c0fd630 msgr2=0x7f2c3c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:40.470 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.466+0000 7f2c4152b640 1 -- 172.21.15.42:0/3860969214 shutdown_connections 2024-09-21T18:02:40.470 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.466+0000 7f2c4152b640 1 -- 172.21.15.42:0/3860969214 wait complete. 2024-09-21T18:02:40.470 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.467+0000 7f2c4152b640 1 Processor -- start 2024-09-21T18:02:40.470 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.467+0000 7f2c4152b640 1 -- start start 2024-09-21T18:02:40.472 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.467+0000 7f2c4152b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c3c103c00 0x7f2c3c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:40.472 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.467+0000 7f2c4152b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3c104520 0x7f2c3c198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:40.472 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.467+0000 7f2c4152b640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c3c10d050 0x7f2c3c19e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:40.472 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.467+0000 7f2c4152b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c1123f0 con 0x7f2c3c104520 2024-09-21T18:02:40.472 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.467+0000 7f2c4152b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c112270 con 0x7f2c3c103c00 2024-09-21T18:02:40.472 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.467+0000 7f2c4152b640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3c112570 con 0x7f2c3c10d050 2024-09-21T18:02:40.472 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3c104520 0x7f2c3c198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:40.472 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3b7fe640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c3c10d050 0x7f2c3c19e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:40.472 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3c104520 0x7f2c3c198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:32994/0 (socket says 172.21.15.42:32994) 2024-09-21T18:02:40.472 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3a7fc640 1 -- 172.21.15.42:0/3999280981 learned_addr learned my addr 172.21.15.42:0/3999280981 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:02:40.472 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3affd640 1 --2- 172.21.15.42:0/3999280981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c3c103c00 0x7f2c3c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3a7fc640 1 -- 172.21.15.42:0/3999280981 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c3c10d050 msgr2=0x7f2c3c19e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3a7fc640 1 --2- 172.21.15.42:0/3999280981 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c3c10d050 0x7f2c3c19e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3a7fc640 1 -- 172.21.15.42:0/3999280981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c3c103c00 msgr2=0x7f2c3c198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3a7fc640 1 --2- 172.21.15.42:0/3999280981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c3c103c00 0x7f2c3c198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3a7fc640 1 -- 172.21.15.42:0/3999280981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3c19e9a0 con 0x7f2c3c104520 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3b7fe640 1 --2- 172.21.15.42:0/3999280981 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c3c10d050 0x7f2c3c19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c3a7fc640 1 --2- 172.21.15.42:0/3999280981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3c104520 0x7f2c3c198e40 secure :-1 s=READY pgs=2919 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400e9c0 tx=0x7f2c2400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c33fff640 1 -- 172.21.15.42:0/3999280981 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400ccc0 con 0x7f2c3c104520 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c33fff640 1 -- 172.21.15.42:0/3999280981 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2c240044b0 con 0x7f2c3c104520 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c4152b640 1 -- 172.21.15.42:0/3999280981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3c19ec90 con 0x7f2c3c104520 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c33fff640 1 -- 172.21.15.42:0/3999280981 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24003e10 con 0x7f2c3c104520 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.468+0000 7f2c4152b640 1 -- 172.21.15.42:0/3999280981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3c1a5350 con 0x7f2c3c104520 2024-09-21T18:02:40.473 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.469+0000 7f2c4152b640 1 -- 172.21.15.42:0/3999280981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c3c103fe0 con 0x7f2c3c104520 2024-09-21T18:02:40.474 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.470+0000 7f2c33fff640 1 -- 172.21.15.42:0/3999280981 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f2c24004000 con 0x7f2c3c104520 2024-09-21T18:02:40.474 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.470+0000 7f2c33fff640 1 --2- 172.21.15.42:0/3999280981 >> v2:172.21.15.42:6800/36970769 conn(0x7f2c2807b110 0x7f2c2807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:40.474 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.471+0000 7f2c33fff640 1 -- 172.21.15.42:0/3999280981 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(751..751 src has 1..751) ==== 7814+0+0 (secure 0 0 0) 0x7f2c2409ed00 con 0x7f2c3c104520 2024-09-21T18:02:40.474 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.471+0000 7f2c3affd640 1 --2- 172.21.15.42:0/3999280981 >> v2:172.21.15.42:6800/36970769 conn(0x7f2c2807b110 0x7f2c2807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:40.474 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.471+0000 7f2c3affd640 1 --2- 172.21.15.42:0/3999280981 >> v2:172.21.15.42:6800/36970769 conn(0x7f2c2807b110 0x7f2c2807d5d0 secure :-1 s=READY pgs=3882 cs=0 l=1 rev1=1 crypto rx=0x7f2c340095f0 tx=0x7f2c34005f90 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:40.477 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.475+0000 7f2c33fff640 1 -- 172.21.15.42:0/3999280981 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f2c24069c80 con 0x7f2c3c104520 2024-09-21T18:02:40.671 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:40.669+0000 7f2c4152b640 1 -- 172.21.15.42:0/3999280981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12} v 0) -- 0x7f2c3c107790 con 0x7f2c3c104520 2024-09-21T18:02:40.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:40.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:40 smithi042 ceph-mon[29361]: pgmap v1192: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:40 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:02:40.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:40 smithi042 ceph-mon[29361]: osdmap e751: 8 total, 8 up, 8 in 2024-09-21T18:02:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:40 smithi042 ceph-mon[38309]: pgmap v1192: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:40 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:02:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:40 smithi042 ceph-mon[38309]: osdmap e751: 8 total, 8 up, 8 in 2024-09-21T18:02:41.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:41.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:40 smithi162 ceph-mon[32106]: pgmap v1192: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:41.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:40 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:02:41.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:40 smithi162 ceph-mon[32106]: osdmap e751: 8 total, 8 up, 8 in 2024-09-21T18:02:41.652 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.649+0000 7f2c33fff640 1 -- 172.21.15.42:0/3999280981 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12}]=0 pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' created v752) ==== 176+0+0 (secure 0 0 0) 0x7f2c2406eb30 con 0x7f2c3c104520 2024-09-21T18:02:41.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.775+0000 7f2c4152b640 1 -- 172.21.15.42:0/3999280981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12} v 0) -- 0x7f2c3c107200 con 0x7f2c3c104520 2024-09-21T18:02:41.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.775+0000 7f2c33fff640 1 -- 172.21.15.42:0/3999280981 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12}]=0 pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' already exists v752) ==== 183+0+0 (secure 0 0 0) 0x7f2c2409cb00 con 0x7f2c3c104520 2024-09-21T18:02:41.777 INFO:tasks.workunit.client.0.smithi042.stderr:pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' already exists 2024-09-21T18:02:41.782 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 -- 172.21.15.42:0/3999280981 >> v2:172.21.15.42:6800/36970769 conn(0x7f2c2807b110 msgr2=0x7f2c2807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:41.782 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 --2- 172.21.15.42:0/3999280981 >> v2:172.21.15.42:6800/36970769 conn(0x7f2c2807b110 0x7f2c2807d5d0 secure :-1 s=READY pgs=3882 cs=0 l=1 rev1=1 crypto rx=0x7f2c340095f0 tx=0x7f2c34005f90 comp rx=0 tx=0).stop 2024-09-21T18:02:41.782 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 -- 172.21.15.42:0/3999280981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3c104520 msgr2=0x7f2c3c198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:41.782 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 --2- 172.21.15.42:0/3999280981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3c104520 0x7f2c3c198e40 secure :-1 s=READY pgs=2919 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400e9c0 tx=0x7f2c2400ee80 comp rx=0 tx=0).stop 2024-09-21T18:02:41.782 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 -- 172.21.15.42:0/3999280981 shutdown_connections 2024-09-21T18:02:41.783 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 --2- 172.21.15.42:0/3999280981 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c3c10d050 0x7f2c3c19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:41.783 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 --2- 172.21.15.42:0/3999280981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3c104520 0x7f2c3c198e40 unknown :-1 s=CLOSED pgs=2919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:41.783 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 --2- 172.21.15.42:0/3999280981 >> v2:172.21.15.42:6800/36970769 conn(0x7f2c2807b110 0x7f2c2807d5d0 unknown :-1 s=CLOSED pgs=3882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:41.783 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 --2- 172.21.15.42:0/3999280981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c3c103c00 0x7f2c3c198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:41.783 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 -- 172.21.15.42:0/3999280981 >> 172.21.15.42:0/3999280981 conn(0x7f2c3c0fd630 msgr2=0x7f2c3c104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:41.783 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 -- 172.21.15.42:0/3999280981 shutdown_connections 2024-09-21T18:02:41.783 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.778+0000 7f2c4152b640 1 -- 172.21.15.42:0/3999280981 wait complete. 2024-09-21T18:02:41.789 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool application enable e3e943c5-f73c-42c4-bca2-88d8a4b98f11 rados 2024-09-21T18:02:41.875 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.872+0000 7ff1026b0640 1 -- 172.21.15.42:0/3590455244 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0fc109080 msgr2=0x7ff0fc10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:41.875 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.872+0000 7ff1026b0640 1 --2- 172.21.15.42:0/3590455244 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0fc109080 0x7ff0fc10f880 secure :-1 s=READY pgs=2997 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009ca0 tx=0x7ff0f402a8c0 comp rx=0 tx=0).stop 2024-09-21T18:02:41.875 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.872+0000 7ff1026b0640 1 -- 172.21.15.42:0/3590455244 shutdown_connections 2024-09-21T18:02:41.876 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.872+0000 7ff1026b0640 1 --2- 172.21.15.42:0/3590455244 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0fc109080 0x7ff0fc10f880 unknown :-1 s=CLOSED pgs=2997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:41.876 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.872+0000 7ff1026b0640 1 --2- 172.21.15.42:0/3590455244 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0fc108700 0x7ff0fc108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:41.876 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.872+0000 7ff1026b0640 1 --2- 172.21.15.42:0/3590455244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0fc102d00 0x7ff0fc1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:41.876 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.872+0000 7ff1026b0640 1 -- 172.21.15.42:0/3590455244 >> 172.21.15.42:0/3590455244 conn(0x7ff0fc0fe740 msgr2=0x7ff0fc100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:41.876 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.872+0000 7ff1026b0640 1 -- 172.21.15.42:0/3590455244 shutdown_connections 2024-09-21T18:02:41.876 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.872+0000 7ff1026b0640 1 -- 172.21.15.42:0/3590455244 wait complete. 2024-09-21T18:02:41.876 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.873+0000 7ff1026b0640 1 Processor -- start 2024-09-21T18:02:41.876 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.873+0000 7ff1026b0640 1 -- start start 2024-09-21T18:02:41.878 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.873+0000 7ff1026b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0fc102d00 0x7ff0fc198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:41.878 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.873+0000 7ff1026b0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0fc108700 0x7ff0fc198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:41.878 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.873+0000 7ff1026b0640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0fc109080 0x7ff0fc19e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:41.878 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.873+0000 7ff1026b0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc1124a0 con 0x7ff0fc108700 2024-09-21T18:02:41.878 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.873+0000 7ff1026b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc112320 con 0x7ff0fc102d00 2024-09-21T18:02:41.878 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.873+0000 7ff1026b0640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7ff0fc112620 con 0x7ff0fc109080 2024-09-21T18:02:41.878 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0fc108700 0x7ff0fc198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:41.878 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff100c4d640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0fc109080 0x7ff0fc19e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0fc108700 0x7ff0fc198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59688/0 (socket says 172.21.15.42:59688) 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0fb7fe640 1 -- 172.21.15.42:0/435189023 learned_addr learned my addr 172.21.15.42:0/435189023 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff100c4d640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0fc109080 0x7ff0fc19e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:48288/0 (socket says 172.21.15.42:48288) 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0fbfff640 1 --2- 172.21.15.42:0/435189023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0fc102d00 0x7ff0fc198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0fb7fe640 1 -- 172.21.15.42:0/435189023 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0fc109080 msgr2=0x7ff0fc19e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0fb7fe640 1 --2- 172.21.15.42:0/435189023 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0fc109080 0x7ff0fc19e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0fb7fe640 1 -- 172.21.15.42:0/435189023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0fc102d00 msgr2=0x7ff0fc198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0fb7fe640 1 --2- 172.21.15.42:0/435189023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0fc102d00 0x7ff0fc198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0fb7fe640 1 -- 172.21.15.42:0/435189023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0fc19e9a0 con 0x7ff0fc108700 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff100c4d640 1 --2- 172.21.15.42:0/435189023 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0fc109080 0x7ff0fc19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0fb7fe640 1 --2- 172.21.15.42:0/435189023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0fc108700 0x7ff0fc198e40 secure :-1 s=READY pgs=2920 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000ea60 tx=0x7ff0f000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0f97fa640 1 -- 172.21.15.42:0/435189023 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000cde0 con 0x7ff0fc108700 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff1026b0640 1 -- 172.21.15.42:0/435189023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0fc19ec90 con 0x7ff0fc108700 2024-09-21T18:02:41.879 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0f97fa640 1 -- 172.21.15.42:0/435189023 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff0f00035f0 con 0x7ff0fc108700 2024-09-21T18:02:41.880 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff0f97fa640 1 -- 172.21.15.42:0/435189023 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f00044a0 con 0x7ff0fc108700 2024-09-21T18:02:41.880 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.874+0000 7ff1026b0640 1 -- 172.21.15.42:0/435189023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0fc1a5530 con 0x7ff0fc108700 2024-09-21T18:02:41.880 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.875+0000 7ff1026b0640 1 -- 172.21.15.42:0/435189023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0fc1030e0 con 0x7ff0fc108700 2024-09-21T18:02:41.880 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.876+0000 7ff0f97fa640 1 -- 172.21.15.42:0/435189023 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7ff0f0004000 con 0x7ff0fc108700 2024-09-21T18:02:41.881 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.877+0000 7ff0f97fa640 1 --2- 172.21.15.42:0/435189023 >> v2:172.21.15.42:6800/36970769 conn(0x7ff0e407b110 0x7ff0e407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:41.881 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.877+0000 7ff0f97fa640 1 -- 172.21.15.42:0/435189023 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(752..752 src has 1..752) ==== 8189+0+0 (secure 0 0 0) 0x7ff0f009eef0 con 0x7ff0fc108700 2024-09-21T18:02:41.881 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.877+0000 7ff0fbfff640 1 --2- 172.21.15.42:0/435189023 >> v2:172.21.15.42:6800/36970769 conn(0x7ff0e407b110 0x7ff0e407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:41.881 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.877+0000 7ff0fbfff640 1 --2- 172.21.15.42:0/435189023 >> v2:172.21.15.42:6800/36970769 conn(0x7ff0e407b110 0x7ff0e407d5d0 secure :-1 s=READY pgs=3883 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec005d00 tx=0x7ff0ec005c50 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:41.884 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:41.881+0000 7ff0f97fa640 1 -- 172.21.15.42:0/435189023 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7ff0f0069cb0 con 0x7ff0fc108700 2024-09-21T18:02:41.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:41 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3999280981' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12} : dispatch 2024-09-21T18:02:41.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:41 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3999280981' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12} : dispatch 2024-09-21T18:02:42.073 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:42.070+0000 7ff1026b0640 1 -- 172.21.15.42:0/435189023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"} v 0) -- 0x7ff0fc1a5700 con 0x7ff0fc108700 2024-09-21T18:02:42.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:41 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3999280981' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12} : dispatch 2024-09-21T18:02:42.653 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:42.651+0000 7ff0f97fa640 1 -- 172.21.15.42:0/435189023 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"}]=0 enabled application 'rados' on pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' v753) ==== 213+0+0 (secure 0 0 0) 0x7ff0f006eb60 con 0x7ff0fc108700 2024-09-21T18:02:42.775 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:42.772+0000 7ff1026b0640 1 -- 172.21.15.42:0/435189023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"} v 0) -- 0x7ff0fc1a5950 con 0x7ff0fc108700 2024-09-21T18:02:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:42 smithi042 ceph-mon[29361]: pgmap v1194: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3999280981' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12}]': finished 2024-09-21T18:02:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:42 smithi042 ceph-mon[29361]: osdmap e752: 8 total, 8 up, 8 in 2024-09-21T18:02:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3999280981' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12} : dispatch 2024-09-21T18:02:42.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:42 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"} : dispatch 2024-09-21T18:02:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:42 smithi042 ceph-mon[38309]: pgmap v1194: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3999280981' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12}]': finished 2024-09-21T18:02:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:42 smithi042 ceph-mon[38309]: osdmap e752: 8 total, 8 up, 8 in 2024-09-21T18:02:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3999280981' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12} : dispatch 2024-09-21T18:02:42.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:42 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"} : dispatch 2024-09-21T18:02:43.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:42 smithi162 ceph-mon[32106]: pgmap v1194: 176 pgs: 176 active+clean; 733 KiB data, 789 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:02:43.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3999280981' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12}]': finished 2024-09-21T18:02:43.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:42 smithi162 ceph-mon[32106]: osdmap e752: 8 total, 8 up, 8 in 2024-09-21T18:02:43.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3999280981' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pg_num": 12} : dispatch 2024-09-21T18:02:43.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:42 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"} : dispatch 2024-09-21T18:02:43.666 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.663+0000 7ff0f97fa640 1 -- 172.21.15.42:0/435189023 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"}]=0 enabled application 'rados' on pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' v754) ==== 213+0+0 (secure 0 0 0) 0x7ff0f009cb00 con 0x7ff0fc108700 2024-09-21T18:02:43.666 INFO:tasks.workunit.client.0.smithi042.stderr:enabled application 'rados' on pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' 2024-09-21T18:02:43.670 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.667+0000 7ff1026b0640 1 -- 172.21.15.42:0/435189023 >> v2:172.21.15.42:6800/36970769 conn(0x7ff0e407b110 msgr2=0x7ff0e407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:43.671 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.667+0000 7ff1026b0640 1 --2- 172.21.15.42:0/435189023 >> v2:172.21.15.42:6800/36970769 conn(0x7ff0e407b110 0x7ff0e407d5d0 secure :-1 s=READY pgs=3883 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec005d00 tx=0x7ff0ec005c50 comp rx=0 tx=0).stop 2024-09-21T18:02:43.671 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.667+0000 7ff1026b0640 1 -- 172.21.15.42:0/435189023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0fc108700 msgr2=0x7ff0fc198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:43.671 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.667+0000 7ff1026b0640 1 --2- 172.21.15.42:0/435189023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0fc108700 0x7ff0fc198e40 secure :-1 s=READY pgs=2920 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000ea60 tx=0x7ff0f000ef20 comp rx=0 tx=0).stop 2024-09-21T18:02:43.671 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.668+0000 7ff1026b0640 1 -- 172.21.15.42:0/435189023 shutdown_connections 2024-09-21T18:02:43.671 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.668+0000 7ff1026b0640 1 --2- 172.21.15.42:0/435189023 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0fc109080 0x7ff0fc19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:43.671 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.668+0000 7ff1026b0640 1 --2- 172.21.15.42:0/435189023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0fc108700 0x7ff0fc198e40 unknown :-1 s=CLOSED pgs=2920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:43.671 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.668+0000 7ff1026b0640 1 --2- 172.21.15.42:0/435189023 >> v2:172.21.15.42:6800/36970769 conn(0x7ff0e407b110 0x7ff0e407d5d0 unknown :-1 s=CLOSED pgs=3883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:43.671 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.668+0000 7ff1026b0640 1 --2- 172.21.15.42:0/435189023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0fc102d00 0x7ff0fc198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:43.672 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.668+0000 7ff1026b0640 1 -- 172.21.15.42:0/435189023 >> 172.21.15.42:0/435189023 conn(0x7ff0fc0fe740 msgr2=0x7ff0fc100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:43.672 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.668+0000 7ff1026b0640 1 -- 172.21.15.42:0/435189023 shutdown_connections 2024-09-21T18:02:43.672 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.668+0000 7ff1026b0640 1 -- 172.21.15.42:0/435189023 wait complete. 2024-09-21T18:02:43.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool set-quota e3e943c5-f73c-42c4-bca2-88d8a4b98f11 max_objects 10 2024-09-21T18:02:43.775 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.770+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1030723190 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6c41075f0 msgr2=0x7ff6c4107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:43.775 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.770+0000 7ff6cc32b640 1 --2- 172.21.15.42:0/1030723190 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6c41075f0 0x7ff6c4107a30 secure :-1 s=READY pgs=2998 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009900 tx=0x7ff6b402a410 comp rx=0 tx=0).stop 2024-09-21T18:02:43.775 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.770+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1030723190 shutdown_connections 2024-09-21T18:02:43.775 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.770+0000 7ff6cc32b640 1 --2- 172.21.15.42:0/1030723190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4107f70 0x7ff6c410e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:43.775 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.770+0000 7ff6cc32b640 1 --2- 172.21.15.42:0/1030723190 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6c41075f0 0x7ff6c4107a30 unknown :-1 s=CLOSED pgs=2998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:43.775 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.770+0000 7ff6cc32b640 1 --2- 172.21.15.42:0/1030723190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6c4101bf0 0x7ff6c4101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:43.775 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.770+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1030723190 >> 172.21.15.42:0/1030723190 conn(0x7ff6c40fd630 msgr2=0x7ff6c40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:43.775 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.770+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1030723190 shutdown_connections 2024-09-21T18:02:43.775 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.770+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1030723190 wait complete. 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6cc32b640 1 Processor -- start 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6cc32b640 1 -- start start 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6cc32b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4101bf0 0x7ff6c410f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6cc32b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6c41075f0 0x7ff6c410f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6cc32b640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6c4107f70 0x7ff6c410fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6cc32b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c4112440 con 0x7ff6c4101bf0 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6cc32b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c41122c0 con 0x7ff6c41075f0 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6cc32b640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7ff6c41125c0 con 0x7ff6c4107f70 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6ca0c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4101bf0 0x7ff6c410f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6ca0c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4101bf0 0x7ff6c410f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59698/0 (socket says 172.21.15.42:59698) 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6ca0c7640 1 -- 172.21.15.42:0/1588628133 learned_addr learned my addr 172.21.15.42:0/1588628133 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.771+0000 7ff6ca8c8640 1 --2- 172.21.15.42:0/1588628133 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6c4107f70 0x7ff6c410fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6c98c6640 1 --2- 172.21.15.42:0/1588628133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6c41075f0 0x7ff6c410f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:43.776 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6ca0c7640 1 -- 172.21.15.42:0/1588628133 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6c4107f70 msgr2=0x7ff6c410fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6ca0c7640 1 --2- 172.21.15.42:0/1588628133 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6c4107f70 0x7ff6c410fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6ca0c7640 1 -- 172.21.15.42:0/1588628133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6c41075f0 msgr2=0x7ff6c410f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6ca0c7640 1 --2- 172.21.15.42:0/1588628133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6c41075f0 0x7ff6c410f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6ca0c7640 1 -- 172.21.15.42:0/1588628133 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c41a6d70 con 0x7ff6c4101bf0 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6ca8c8640 1 --2- 172.21.15.42:0/1588628133 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6c4107f70 0x7ff6c410fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6c98c6640 1 --2- 172.21.15.42:0/1588628133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6c41075f0 0x7ff6c410f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6ca0c7640 1 --2- 172.21.15.42:0/1588628133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4101bf0 0x7ff6c410f280 secure :-1 s=READY pgs=2921 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000d770 tx=0x7ff6c000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6bb7fe640 1 -- 172.21.15.42:0/1588628133 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0017070 con 0x7ff6c4101bf0 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1588628133 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c41a7060 con 0x7ff6c4101bf0 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6bb7fe640 1 -- 172.21.15.42:0/1588628133 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff6c0009820 con 0x7ff6c4101bf0 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6bb7fe640 1 -- 172.21.15.42:0/1588628133 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0004bb0 con 0x7ff6c4101bf0 2024-09-21T18:02:43.777 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.772+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1588628133 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c41a7530 con 0x7ff6c4101bf0 2024-09-21T18:02:43.778 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.773+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1588628133 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c4101fd0 con 0x7ff6c4101bf0 2024-09-21T18:02:43.778 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.774+0000 7ff6bb7fe640 1 -- 172.21.15.42:0/1588628133 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7ff6c0005220 con 0x7ff6c4101bf0 2024-09-21T18:02:43.778 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.775+0000 7ff6bb7fe640 1 --2- 172.21.15.42:0/1588628133 >> v2:172.21.15.42:6800/36970769 conn(0x7ff6b007b110 0x7ff6b007d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:02:43.778 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.775+0000 7ff6bb7fe640 1 -- 172.21.15.42:0/1588628133 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(754..754 src has 1..754) ==== 8202+0+0 (secure 0 0 0) 0x7ff6c009e5d0 con 0x7ff6c4101bf0 2024-09-21T18:02:43.778 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.775+0000 7ff6c98c6640 1 --2- 172.21.15.42:0/1588628133 >> v2:172.21.15.42:6800/36970769 conn(0x7ff6b007b110 0x7ff6b007d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:02:43.779 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.775+0000 7ff6c98c6640 1 --2- 172.21.15.42:0/1588628133 >> v2:172.21.15.42:6800/36970769 conn(0x7ff6b007b110 0x7ff6b007d5d0 secure :-1 s=READY pgs=3884 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4031440 tx=0x7ff6b4005a20 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:02:43.781 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.779+0000 7ff6bb7fe640 1 -- 172.21.15.42:0/1588628133 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7ff6c0069320 con 0x7ff6c4101bf0 2024-09-21T18:02:43.975 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:43.972+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1588628133 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"} v 0) -- 0x7ff6c4109d50 con 0x7ff6c4101bf0 2024-09-21T18:02:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"}]': finished 2024-09-21T18:02:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:43 smithi162 ceph-mon[32106]: osdmap e753: 8 total, 8 up, 8 in 2024-09-21T18:02:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:43 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"} : dispatch 2024-09-21T18:02:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:02:44.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"}]': finished 2024-09-21T18:02:44.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:43 smithi042 ceph-mon[29361]: osdmap e753: 8 total, 8 up, 8 in 2024-09-21T18:02:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:43 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"} : dispatch 2024-09-21T18:02:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:44.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:02:44.165 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:02:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:02:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:02:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"}]': finished 2024-09-21T18:02:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:43 smithi042 ceph-mon[38309]: osdmap e753: 8 total, 8 up, 8 in 2024-09-21T18:02:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:43 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"} : dispatch 2024-09-21T18:02:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:02:44.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:02:44.667 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:44.665+0000 7ff6bb7fe640 1 -- 172.21.15.42:0/1588628133 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool e3e943c5-f73c-42c4-bca2-88d8a4b98f11 v755) ==== 223+0+0 (secure 0 0 0) 0x7ff6c006e1d0 con 0x7ff6c4101bf0 2024-09-21T18:02:44.791 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:44.788+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1588628133 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"} v 0) -- 0x7ff6c4109960 con 0x7ff6c4101bf0 2024-09-21T18:02:45.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:44 smithi162 ceph-mon[32106]: pgmap v1197: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.2 KiB/s wr, 1 op/s 2024-09-21T18:02:45.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"}]': finished 2024-09-21T18:02:45.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:44 smithi162 ceph-mon[32106]: osdmap e754: 8 total, 8 up, 8 in 2024-09-21T18:02:45.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:44 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:02:45.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:44 smithi042 ceph-mon[29361]: pgmap v1197: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.2 KiB/s wr, 1 op/s 2024-09-21T18:02:45.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"}]': finished 2024-09-21T18:02:45.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:44 smithi042 ceph-mon[29361]: osdmap e754: 8 total, 8 up, 8 in 2024-09-21T18:02:45.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:44 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:02:45.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:44 smithi042 ceph-mon[38309]: pgmap v1197: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.2 KiB/s wr, 1 op/s 2024-09-21T18:02:45.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/435189023' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "app": "rados"}]': finished 2024-09-21T18:02:45.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:44 smithi042 ceph-mon[38309]: osdmap e754: 8 total, 8 up, 8 in 2024-09-21T18:02:45.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:44 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:02:45.679 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.677+0000 7ff6bb7fe640 1 -- 172.21.15.42:0/1588628133 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool e3e943c5-f73c-42c4-bca2-88d8a4b98f11 v756) ==== 223+0+0 (secure 0 0 0) 0x7ff6c0005510 con 0x7ff6c4101bf0 2024-09-21T18:02:45.680 INFO:tasks.workunit.client.0.smithi042.stderr:set-quota max_objects = 10 for pool e3e943c5-f73c-42c4-bca2-88d8a4b98f11 2024-09-21T18:02:45.684 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1588628133 >> v2:172.21.15.42:6800/36970769 conn(0x7ff6b007b110 msgr2=0x7ff6b007d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:45.684 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 --2- 172.21.15.42:0/1588628133 >> v2:172.21.15.42:6800/36970769 conn(0x7ff6b007b110 0x7ff6b007d5d0 secure :-1 s=READY pgs=3884 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4031440 tx=0x7ff6b4005a20 comp rx=0 tx=0).stop 2024-09-21T18:02:45.684 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1588628133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4101bf0 msgr2=0x7ff6c410f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:02:45.684 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 --2- 172.21.15.42:0/1588628133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4101bf0 0x7ff6c410f280 secure :-1 s=READY pgs=2921 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000d770 tx=0x7ff6c000db70 comp rx=0 tx=0).stop 2024-09-21T18:02:45.684 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1588628133 shutdown_connections 2024-09-21T18:02:45.684 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 --2- 172.21.15.42:0/1588628133 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6c4107f70 0x7ff6c410fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:45.685 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 --2- 172.21.15.42:0/1588628133 >> v2:172.21.15.42:6800/36970769 conn(0x7ff6b007b110 0x7ff6b007d5d0 unknown :-1 s=CLOSED pgs=3884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:45.685 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 --2- 172.21.15.42:0/1588628133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6c41075f0 0x7ff6c410f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:45.685 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 --2- 172.21.15.42:0/1588628133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4101bf0 0x7ff6c410f280 unknown :-1 s=CLOSED pgs=2921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:02:45.685 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1588628133 >> 172.21.15.42:0/1588628133 conn(0x7ff6c40fd630 msgr2=0x7ff6c40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:02:45.685 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1588628133 shutdown_connections 2024-09-21T18:02:45.685 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:02:45.682+0000 7ff6cc32b640 1 -- 172.21.15.42:0/1588628133 wait complete. 2024-09-21T18:02:45.696 INFO:tasks.workunit.client.0.smithi042.stderr:+ sleep 30 2024-09-21T18:02:46.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:02:46.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:45 smithi162 ceph-mon[32106]: osdmap e755: 8 total, 8 up, 8 in 2024-09-21T18:02:46.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:45 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:02:46.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:45 smithi162 ceph-mon[32106]: pgmap v1200: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.5 KiB/s wr, 1 op/s 2024-09-21T18:02:46.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:02:46.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:45 smithi042 ceph-mon[29361]: osdmap e755: 8 total, 8 up, 8 in 2024-09-21T18:02:46.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:45 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:02:46.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:45 smithi042 ceph-mon[29361]: pgmap v1200: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.5 KiB/s wr, 1 op/s 2024-09-21T18:02:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:02:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:45 smithi042 ceph-mon[38309]: osdmap e755: 8 total, 8 up, 8 in 2024-09-21T18:02:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:45 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T18:02:46.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:45 smithi042 ceph-mon[38309]: pgmap v1200: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.5 KiB/s wr, 1 op/s 2024-09-21T18:02:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:02:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:46 smithi162 ceph-mon[32106]: osdmap e756: 8 total, 8 up, 8 in 2024-09-21T18:02:47.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:02:47.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:46 smithi042 ceph-mon[29361]: osdmap e756: 8 total, 8 up, 8 in 2024-09-21T18:02:47.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/1588628133' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "field": "max_objects", "val": "10"}]': finished 2024-09-21T18:02:47.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:46 smithi042 ceph-mon[38309]: osdmap e756: 8 total, 8 up, 8 in 2024-09-21T18:02:48.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:47 smithi162 ceph-mon[32106]: pgmap v1202: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 5.4 KiB/s wr, 1 op/s 2024-09-21T18:02:48.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:47 smithi042 ceph-mon[29361]: pgmap v1202: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 5.4 KiB/s wr, 1 op/s 2024-09-21T18:02:48.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:47 smithi042 ceph-mon[38309]: pgmap v1202: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 5.4 KiB/s wr, 1 op/s 2024-09-21T18:02:49.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:02:49 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:02:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:50 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:50.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:50 smithi162 ceph-mon[32106]: pgmap v1203: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:50 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:50.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:50 smithi042 ceph-mon[29361]: pgmap v1203: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:50 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:02:50.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:50 smithi042 ceph-mon[38309]: pgmap v1203: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:02:52.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:52 smithi162 ceph-mon[32106]: pgmap v1204: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 652 B/s rd, 0 op/s 2024-09-21T18:02:52.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:52 smithi042 ceph-mon[29361]: pgmap v1204: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 652 B/s rd, 0 op/s 2024-09-21T18:02:52.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:52 smithi042 ceph-mon[38309]: pgmap v1204: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 652 B/s rd, 0 op/s 2024-09-21T18:02:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:02:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:02:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:02:54.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:54 smithi162 ceph-mon[32106]: pgmap v1205: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T18:02:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:54 smithi042 ceph-mon[29361]: pgmap v1205: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T18:02:54.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:54 smithi042 ceph-mon[38309]: pgmap v1205: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T18:02:56.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:56 smithi162 ceph-mon[32106]: pgmap v1206: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:02:56.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:56 smithi042 ceph-mon[29361]: pgmap v1206: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:02:56.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:56 smithi042 ceph-mon[38309]: pgmap v1206: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:02:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:58 smithi042 ceph-mon[29361]: pgmap v1207: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 865 B/s rd, 0 op/s 2024-09-21T18:02:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:58 smithi042 ceph-mon[38309]: pgmap v1207: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 865 B/s rd, 0 op/s 2024-09-21T18:02:59.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:58 smithi162 ceph-mon[32106]: pgmap v1207: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 865 B/s rd, 0 op/s 2024-09-21T18:02:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:02:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:02:59.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:02:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:02:59.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:02:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:02:59.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:02:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:00 smithi042 ceph-mon[29361]: pgmap v1208: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:00 smithi042 ceph-mon[38309]: pgmap v1208: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:01.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:01.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:00 smithi162 ceph-mon[32106]: pgmap v1208: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:02.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:02 smithi042 ceph-mon[29361]: pgmap v1209: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:02.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:02 smithi042 ceph-mon[38309]: pgmap v1209: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:03.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:02 smithi162 ceph-mon[32106]: pgmap v1209: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:03:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:03:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:03:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:04 smithi042 ceph-mon[29361]: pgmap v1210: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:04.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:04 smithi042 ceph-mon[38309]: pgmap v1210: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:05.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:04 smithi162 ceph-mon[32106]: pgmap v1210: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:06 smithi042 ceph-mon[29361]: pgmap v1211: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:06.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:06 smithi042 ceph-mon[38309]: pgmap v1211: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:07.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:06 smithi162 ceph-mon[32106]: pgmap v1211: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:08.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:08 smithi042 ceph-mon[29361]: pgmap v1212: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:08.918 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:08 smithi042 ceph-mon[38309]: pgmap v1212: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:09.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:08 smithi162 ceph-mon[32106]: pgmap v1212: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:09.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:03:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:03:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:10 smithi042 ceph-mon[29361]: pgmap v1213: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:10.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:10 smithi042 ceph-mon[38309]: pgmap v1213: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:11.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:10 smithi162 ceph-mon[32106]: pgmap v1213: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:11.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:12 smithi042 ceph-mon[29361]: pgmap v1214: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:12 smithi042 ceph-mon[38309]: pgmap v1214: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:13.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:12 smithi162 ceph-mon[32106]: pgmap v1214: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:03:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:03:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:03:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:14 smithi042 ceph-mon[29361]: pgmap v1215: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:14 smithi042 ceph-mon[38309]: pgmap v1215: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:14 smithi162 ceph-mon[32106]: pgmap v1215: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:15.698 INFO:tasks.workunit.client.0.smithi042.stderr:++ seq 1 10 2024-09-21T18:03:15.698 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:03:15.699 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p e3e943c5-f73c-42c4-bca2-88d8a4b98f11 put obj1 /etc/passwd 2024-09-21T18:03:15.742 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:03:15.742 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p e3e943c5-f73c-42c4-bca2-88d8a4b98f11 put obj2 /etc/passwd 2024-09-21T18:03:15.782 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:03:15.782 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p e3e943c5-f73c-42c4-bca2-88d8a4b98f11 put obj3 /etc/passwd 2024-09-21T18:03:15.821 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:03:15.821 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p e3e943c5-f73c-42c4-bca2-88d8a4b98f11 put obj4 /etc/passwd 2024-09-21T18:03:15.858 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:03:15.858 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p e3e943c5-f73c-42c4-bca2-88d8a4b98f11 put obj5 /etc/passwd 2024-09-21T18:03:15.895 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:03:15.895 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p e3e943c5-f73c-42c4-bca2-88d8a4b98f11 put obj6 /etc/passwd 2024-09-21T18:03:15.932 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:03:15.932 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p e3e943c5-f73c-42c4-bca2-88d8a4b98f11 put obj7 /etc/passwd 2024-09-21T18:03:15.968 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:03:15.968 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p e3e943c5-f73c-42c4-bca2-88d8a4b98f11 put obj8 /etc/passwd 2024-09-21T18:03:16.005 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:03:16.005 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p e3e943c5-f73c-42c4-bca2-88d8a4b98f11 put obj9 /etc/passwd 2024-09-21T18:03:16.042 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 10` 2024-09-21T18:03:16.043 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p e3e943c5-f73c-42c4-bca2-88d8a4b98f11 put obj10 /etc/passwd 2024-09-21T18:03:16.079 INFO:tasks.workunit.client.0.smithi042.stderr:+ sleep 30 2024-09-21T18:03:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:16 smithi042 ceph-mon[29361]: pgmap v1216: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:16.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:16 smithi042 ceph-mon[38309]: pgmap v1216: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:17.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:16 smithi162 ceph-mon[32106]: pgmap v1216: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:18 smithi042 ceph-mon[29361]: pgmap v1217: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:18 smithi042 ceph-mon[38309]: pgmap v1217: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:18 smithi162 ceph-mon[32106]: pgmap v1217: 188 pgs: 188 active+clean; 759 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:19.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:03:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:03:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:20 smithi042 ceph-mon[29361]: pgmap v1218: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-21T18:03:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:20 smithi042 ceph-mon[38309]: pgmap v1218: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-21T18:03:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:20 smithi162 ceph-mon[32106]: pgmap v1218: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-21T18:03:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:22.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:22 smithi042 ceph-mon[29361]: pgmap v1219: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-21T18:03:22.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:22 smithi042 ceph-mon[38309]: pgmap v1219: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-21T18:03:23.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:22 smithi162 ceph-mon[32106]: pgmap v1219: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-21T18:03:24.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:03:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:03:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:03:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:24 smithi042 ceph-mon[29361]: pgmap v1220: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-21T18:03:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:24 smithi042 ceph-mon[29361]: pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' is full (reached quota's max_objects: 10) 2024-09-21T18:03:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:24 smithi042 ceph-mon[29361]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T18:03:24.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:24 smithi042 ceph-mon[29361]: osdmap e757: 8 total, 8 up, 8 in 2024-09-21T18:03:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:24 smithi042 ceph-mon[38309]: pgmap v1220: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-21T18:03:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:24 smithi042 ceph-mon[38309]: pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' is full (reached quota's max_objects: 10) 2024-09-21T18:03:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:24 smithi042 ceph-mon[38309]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T18:03:24.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:24 smithi042 ceph-mon[38309]: osdmap e757: 8 total, 8 up, 8 in 2024-09-21T18:03:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:24 smithi162 ceph-mon[32106]: pgmap v1220: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-21T18:03:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:24 smithi162 ceph-mon[32106]: pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' is full (reached quota's max_objects: 10) 2024-09-21T18:03:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:24 smithi162 ceph-mon[32106]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T18:03:25.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:24 smithi162 ceph-mon[32106]: osdmap e757: 8 total, 8 up, 8 in 2024-09-21T18:03:26.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:26 smithi162 ceph-mon[32106]: pgmap v1222: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T18:03:26.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:26 smithi042 ceph-mon[29361]: pgmap v1222: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T18:03:26.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:26 smithi042 ceph-mon[38309]: pgmap v1222: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T18:03:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:28 smithi042 ceph-mon[29361]: pgmap v1223: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T18:03:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:03:28.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:03:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:03:28.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:28 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:03:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:28 smithi042 ceph-mon[38309]: pgmap v1223: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T18:03:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:03:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:03:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:03:28.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:28 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:03:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:28 smithi162 ceph-mon[32106]: pgmap v1223: 188 pgs: 188 active+clean; 884 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T18:03:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T18:03:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T18:03:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T18:03:29.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:28 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:03:29.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:03:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:03:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:29 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:03:29.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:29 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:29 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:03:29.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:29 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:29 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' 2024-09-21T18:03:29.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:29 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:30.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:30 smithi042 ceph-mon[29361]: pgmap v1224: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:30.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:30 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:30 smithi042 ceph-mon[38309]: pgmap v1224: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:30.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:30 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:30 smithi162 ceph-mon[32106]: pgmap v1224: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:31.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:30 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:32.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:32 smithi042 ceph-mon[29361]: pgmap v1225: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:32.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:32 smithi042 ceph-mon[38309]: pgmap v1225: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:33.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:32 smithi162 ceph-mon[32106]: pgmap v1225: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:34.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:03:33 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:03:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:03:34.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:34 smithi042 ceph-mon[29361]: pgmap v1226: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:34.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:34 smithi042 ceph-mon[38309]: pgmap v1226: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:35.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:34 smithi162 ceph-mon[32106]: pgmap v1226: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:36.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:36 smithi042 ceph-mon[29361]: pgmap v1227: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 914 B/s rd, 0 op/s 2024-09-21T18:03:36.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:36 smithi042 ceph-mon[38309]: pgmap v1227: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 914 B/s rd, 0 op/s 2024-09-21T18:03:37.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:36 smithi162 ceph-mon[32106]: pgmap v1227: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 914 B/s rd, 0 op/s 2024-09-21T18:03:38.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:38 smithi042 ceph-mon[29361]: pgmap v1228: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:38.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:38 smithi042 ceph-mon[38309]: pgmap v1228: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:39.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:38 smithi162 ceph-mon[32106]: pgmap v1228: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:39.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:03:39 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:03:40.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:40 smithi042 ceph-mon[29361]: pgmap v1229: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:40.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:40 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:40 smithi042 ceph-mon[38309]: pgmap v1229: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:40.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:40 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:41.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:40 smithi162 ceph-mon[32106]: pgmap v1229: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:41.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:40 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:42.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:42 smithi042 ceph-mon[29361]: pgmap v1230: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:42.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:42 smithi042 ceph-mon[38309]: pgmap v1230: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:43.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:42 smithi162 ceph-mon[32106]: pgmap v1230: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:03:43.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:43 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:43.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:43 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:43.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:03:43 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:03:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:03:44.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:43 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:45.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:44 smithi162 ceph-mon[32106]: pgmap v1231: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:45.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:44 smithi042 ceph-mon[29361]: pgmap v1231: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:45.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:44 smithi042 ceph-mon[38309]: pgmap v1231: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:03:46.080 INFO:tasks.workunit.client.0.smithi042.stderr:+ rados -p 277077be-0cb2-4630-9bef-40c97902f85f put threemore /etc/passwd 2024-09-21T18:03:46.124 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool set-quota 277077be-0cb2-4630-9bef-40c97902f85f max_bytes 0 2024-09-21T18:03:46.215 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.212+0000 7f7878dbb640 1 -- 172.21.15.42:0/3612868811 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7874104520 msgr2=0x7f787410ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:03:46.215 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.212+0000 7f7878dbb640 1 --2- 172.21.15.42:0/3612868811 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7874104520 0x7f787410ca00 secure :-1 s=READY pgs=3014 cs=0 l=1 rev1=1 crypto rx=0x7f7868009900 tx=0x7f786802a410 comp rx=0 tx=0).stop 2024-09-21T18:03:46.215 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.212+0000 7f7878dbb640 1 -- 172.21.15.42:0/3612868811 shutdown_connections 2024-09-21T18:03:46.215 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.212+0000 7f7878dbb640 1 --2- 172.21.15.42:0/3612868811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787410d050 0x7f787410f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:46.215 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.212+0000 7f7878dbb640 1 --2- 172.21.15.42:0/3612868811 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7874104520 0x7f787410ca00 unknown :-1 s=CLOSED pgs=3014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:46.215 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.212+0000 7f7878dbb640 1 --2- 172.21.15.42:0/3612868811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7874103c00 0x7f7874103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:46.216 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.212+0000 7f7878dbb640 1 -- 172.21.15.42:0/3612868811 >> 172.21.15.42:0/3612868811 conn(0x7f78740fd630 msgr2=0x7f78740ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:03:46.216 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.212+0000 7f7878dbb640 1 -- 172.21.15.42:0/3612868811 shutdown_connections 2024-09-21T18:03:46.216 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.212+0000 7f7878dbb640 1 -- 172.21.15.42:0/3612868811 wait complete. 2024-09-21T18:03:46.218 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.213+0000 7f7878dbb640 1 Processor -- start 2024-09-21T18:03:46.218 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.213+0000 7f7878dbb640 1 -- start start 2024-09-21T18:03:46.218 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.213+0000 7f7878dbb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7874103c00 0x7f7874198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:03:46.218 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.213+0000 7f7878dbb640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7874104520 0x7f7874198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:03:46.218 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f7878dbb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787410d050 0x7f787419e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:03:46.218 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f7878dbb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78741123f0 con 0x7f7874103c00 2024-09-21T18:03:46.218 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f7878dbb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7874112270 con 0x7f787410d050 2024-09-21T18:03:46.218 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f7878dbb640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f7874112570 con 0x7f7874104520 2024-09-21T18:03:46.218 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f787259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7874103c00 0x7f7874198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:03:46.218 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f7871d9b640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7874104520 0x7f7874198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:03:46.218 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f787259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7874103c00 0x7f7874198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47552/0 (socket says 172.21.15.42:47552) 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f787259c640 1 -- 172.21.15.42:0/4164398216 learned_addr learned my addr 172.21.15.42:0/4164398216 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f7871d9b640 1 --2- 172.21.15.42:0/4164398216 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7874104520 0x7f7874198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:57318/0 (socket says 172.21.15.42:57318) 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f7872d9d640 1 --2- 172.21.15.42:0/4164398216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787410d050 0x7f787419e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f787259c640 1 -- 172.21.15.42:0/4164398216 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7874104520 msgr2=0x7f7874198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f787259c640 1 --2- 172.21.15.42:0/4164398216 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7874104520 0x7f7874198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f787259c640 1 -- 172.21.15.42:0/4164398216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787410d050 msgr2=0x7f787419e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f787259c640 1 --2- 172.21.15.42:0/4164398216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787410d050 0x7f787419e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f787259c640 1 -- 172.21.15.42:0/4164398216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787419ea00 con 0x7f7874103c00 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f7871d9b640 1 --2- 172.21.15.42:0/4164398216 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7874104520 0x7f7874198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f787259c640 1 --2- 172.21.15.42:0/4164398216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7874103c00 0x7f7874198960 secure :-1 s=READY pgs=2940 cs=0 l=1 rev1=1 crypto rx=0x7f786400ea60 tx=0x7f786400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786400cde0 con 0x7f7874103c00 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f7878dbb640 1 -- 172.21.15.42:0/4164398216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787419ecf0 con 0x7f7874103c00 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f78640035f0 con 0x7f7874103c00 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78640044a0 con 0x7f7874103c00 2024-09-21T18:03:46.219 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.214+0000 7f7878dbb640 1 -- 172.21.15.42:0/4164398216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78741a5590 con 0x7f7874103c00 2024-09-21T18:03:46.220 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.215+0000 7f7878dbb640 1 -- 172.21.15.42:0/4164398216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7874103fe0 con 0x7f7874103c00 2024-09-21T18:03:46.220 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.216+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f7864004000 con 0x7f7874103c00 2024-09-21T18:03:46.220 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.217+0000 7f78637fe640 1 --2- 172.21.15.42:0/4164398216 >> v2:172.21.15.42:6800/36970769 conn(0x7f785c07b110 0x7f785c07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:03:46.220 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.217+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(757..757 src has 1..757) ==== 8202+0+0 (secure 0 0 0) 0x7f786409ee70 con 0x7f7874103c00 2024-09-21T18:03:46.221 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.217+0000 7f7871d9b640 1 --2- 172.21.15.42:0/4164398216 >> v2:172.21.15.42:6800/36970769 conn(0x7f785c07b110 0x7f785c07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:03:46.221 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.217+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=758}) -- 0x7f785c086e80 con 0x7f7874103c00 2024-09-21T18:03:46.221 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.217+0000 7f7871d9b640 1 --2- 172.21.15.42:0/4164398216 >> v2:172.21.15.42:6800/36970769 conn(0x7f785c07b110 0x7f785c07d5d0 secure :-1 s=READY pgs=3896 cs=0 l=1 rev1=1 crypto rx=0x7f7868000c00 tx=0x7f78680318f0 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:03:46.224 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.221+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f7864069c20 con 0x7f7874103c00 2024-09-21T18:03:46.417 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.415+0000 7f7878dbb640 1 -- 172.21.15.42:0/4164398216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} v 0) -- 0x7f7874107750 con 0x7f7874103c00 2024-09-21T18:03:46.668 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.666+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f v758) ==== 217+0+0 (secure 0 0 0) 0x7f786406ead0 con 0x7f7874103c00 2024-09-21T18:03:46.668 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.666+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 <== mon.0 v2:172.21.15.42:3300/0 8 ==== osd_map(758..758 src has 1..758) ==== 628+0+0 (secure 0 0 0) 0x7f786409ca70 con 0x7f7874103c00 2024-09-21T18:03:46.668 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.666+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=759}) -- 0x7f785c087e20 con 0x7f7874103c00 2024-09-21T18:03:46.787 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:46.785+0000 7f7878dbb640 1 -- 172.21.15.42:0/4164398216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} v 0) -- 0x7f787402e920 con 0x7f7874103c00 2024-09-21T18:03:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:46 smithi162 ceph-mon[32106]: pgmap v1232: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:47.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:46 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:03:47.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:46 smithi042 ceph-mon[29361]: pgmap v1232: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:47.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:46 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:03:47.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:46 smithi042 ceph-mon[38309]: pgmap v1232: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:03:47.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:46 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:03:47.683 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.680+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 <== mon.0 v2:172.21.15.42:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f v759) ==== 217+0+0 (secure 0 0 0) 0x7f786406c0c0 con 0x7f7874103c00 2024-09-21T18:03:47.683 INFO:tasks.workunit.client.0.smithi042.stderr:set-quota max_bytes = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f 2024-09-21T18:03:47.683 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.681+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 <== mon.0 v2:172.21.15.42:3300/0 10 ==== osd_map(759..759 src has 1..759) ==== 628+0+0 (secure 0 0 0) 0x7f7864063ec0 con 0x7f7874103c00 2024-09-21T18:03:47.684 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.681+0000 7f78637fe640 1 -- 172.21.15.42:0/4164398216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=760}) -- 0x7f785c087ff0 con 0x7f7874103c00 2024-09-21T18:03:47.688 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.686+0000 7f7878dbb640 1 -- 172.21.15.42:0/4164398216 >> v2:172.21.15.42:6800/36970769 conn(0x7f785c07b110 msgr2=0x7f785c07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:03:47.688 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.686+0000 7f7878dbb640 1 --2- 172.21.15.42:0/4164398216 >> v2:172.21.15.42:6800/36970769 conn(0x7f785c07b110 0x7f785c07d5d0 secure :-1 s=READY pgs=3896 cs=0 l=1 rev1=1 crypto rx=0x7f7868000c00 tx=0x7f78680318f0 comp rx=0 tx=0).stop 2024-09-21T18:03:47.688 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.686+0000 7f7878dbb640 1 -- 172.21.15.42:0/4164398216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7874103c00 msgr2=0x7f7874198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:03:47.689 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.686+0000 7f7878dbb640 1 --2- 172.21.15.42:0/4164398216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7874103c00 0x7f7874198960 secure :-1 s=READY pgs=2940 cs=0 l=1 rev1=1 crypto rx=0x7f786400ea60 tx=0x7f786400ef20 comp rx=0 tx=0).stop 2024-09-21T18:03:47.689 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.686+0000 7f7878dbb640 1 -- 172.21.15.42:0/4164398216 shutdown_connections 2024-09-21T18:03:47.689 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.686+0000 7f7878dbb640 1 --2- 172.21.15.42:0/4164398216 >> v2:172.21.15.42:6800/36970769 conn(0x7f785c07b110 0x7f785c07d5d0 secure :-1 s=CLOSED pgs=3896 cs=0 l=1 rev1=1 crypto rx=0x7f7868000c00 tx=0x7f78680318f0 comp rx=0 tx=0).stop 2024-09-21T18:03:47.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.686+0000 7f7878dbb640 1 --2- 172.21.15.42:0/4164398216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787410d050 0x7f787419e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:47.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.686+0000 7f7878dbb640 1 --2- 172.21.15.42:0/4164398216 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7874104520 0x7f7874198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:47.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.686+0000 7f7878dbb640 1 --2- 172.21.15.42:0/4164398216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7874103c00 0x7f7874198960 unknown :-1 s=CLOSED pgs=2940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:47.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.686+0000 7f7878dbb640 1 -- 172.21.15.42:0/4164398216 >> 172.21.15.42:0/4164398216 conn(0x7f78740fd630 msgr2=0x7f7874104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:03:47.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.687+0000 7f7878dbb640 1 -- 172.21.15.42:0/4164398216 shutdown_connections 2024-09-21T18:03:47.690 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.687+0000 7f7878dbb640 1 -- 172.21.15.42:0/4164398216 wait complete. 2024-09-21T18:03:47.702 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool set-quota 277077be-0cb2-4630-9bef-40c97902f85f max_objects 0 2024-09-21T18:03:47.796 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.790+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/92890921 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2a841086f0 msgr2=0x7f2a84108b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:03:47.796 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.790+0000 7f2a8b1bb640 1 --2- 172.21.15.42:0/92890921 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2a841086f0 0x7f2a84108b30 secure :-1 s=READY pgs=3015 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009900 tx=0x7f2a7802a3f0 comp rx=0 tx=0).stop 2024-09-21T18:03:47.796 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.790+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/92890921 shutdown_connections 2024-09-21T18:03:47.796 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.790+0000 7f2a8b1bb640 1 --2- 172.21.15.42:0/92890921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a84109070 0x7f2a8410f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:47.796 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.790+0000 7f2a8b1bb640 1 --2- 172.21.15.42:0/92890921 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2a841086f0 0x7f2a84108b30 unknown :-1 s=CLOSED pgs=3015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:47.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.790+0000 7f2a8b1bb640 1 --2- 172.21.15.42:0/92890921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a84102cf0 0x7f2a841030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:47.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.790+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/92890921 >> 172.21.15.42:0/92890921 conn(0x7f2a840fe750 msgr2=0x7f2a84100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:03:47.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.790+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/92890921 shutdown_connections 2024-09-21T18:03:47.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.790+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/92890921 wait complete. 2024-09-21T18:03:47.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a8b1bb640 1 Processor -- start 2024-09-21T18:03:47.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a8b1bb640 1 -- start start 2024-09-21T18:03:47.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a8b1bb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a84102cf0 0x7f2a840754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:03:47.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a8b1bb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a841086f0 0x7f2a840759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:03:47.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a8b1bb640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2a84109070 0x7f2a84075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:03:47.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a8b1bb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2a84112490 con 0x7f2a84102cf0 2024-09-21T18:03:47.797 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a8b1bb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a84112310 con 0x7f2a841086f0 2024-09-21T18:03:47.798 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a8b1bb640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f2a84112610 con 0x7f2a84109070 2024-09-21T18:03:47.798 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a88f57640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a84102cf0 0x7f2a840754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:03:47.798 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a89758640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2a84109070 0x7f2a84075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:03:47.798 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a88f57640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a84102cf0 0x7f2a840754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47564/0 (socket says 172.21.15.42:47564) 2024-09-21T18:03:47.798 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a88f57640 1 -- 172.21.15.42:0/3726195863 learned_addr learned my addr 172.21.15.42:0/3726195863 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:03:47.798 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a83fff640 1 --2- 172.21.15.42:0/3726195863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a841086f0 0x7f2a840759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:03:47.798 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a89758640 1 -- 172.21.15.42:0/3726195863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a841086f0 msgr2=0x7f2a840759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:03:47.798 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a89758640 1 --2- 172.21.15.42:0/3726195863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a841086f0 0x7f2a840759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:47.798 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a89758640 1 -- 172.21.15.42:0/3726195863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a84102cf0 msgr2=0x7f2a840754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:03:47.798 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a89758640 1 --2- 172.21.15.42:0/3726195863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a84102cf0 0x7f2a840754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:47.798 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a89758640 1 -- 172.21.15.42:0/3726195863 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a841a6cc0 con 0x7f2a84109070 2024-09-21T18:03:47.799 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.791+0000 7f2a88f57640 1 --2- 172.21.15.42:0/3726195863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a84102cf0 0x7f2a840754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T18:03:47.799 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.792+0000 7f2a89758640 1 --2- 172.21.15.42:0/3726195863 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2a84109070 0x7f2a84075f20 secure :-1 s=READY pgs=3016 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00e970 tx=0x7f2a7c00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:03:47.799 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.792+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00ccc0 con 0x7f2a84109070 2024-09-21T18:03:47.799 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.792+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2a7c0035f0 con 0x7f2a84109070 2024-09-21T18:03:47.799 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.792+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/3726195863 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a841a6fb0 con 0x7f2a84109070 2024-09-21T18:03:47.799 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.792+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00ce60 con 0x7f2a84109070 2024-09-21T18:03:47.799 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.792+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/3726195863 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a841a7410 con 0x7f2a84109070 2024-09-21T18:03:47.799 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.793+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/3726195863 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a841030d0 con 0x7f2a84109070 2024-09-21T18:03:47.800 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.794+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f2a7c004020 con 0x7f2a84109070 2024-09-21T18:03:47.800 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.794+0000 7f2a81ffb640 1 --2- 172.21.15.42:0/3726195863 >> v2:172.21.15.42:6800/36970769 conn(0x7f2a6c07b110 0x7f2a6c07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:03:47.801 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.794+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(759..759 src has 1..759) ==== 8202+0+0 (secure 0 0 0) 0x7f2a7c09ed60 con 0x7f2a84109070 2024-09-21T18:03:47.801 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.794+0000 7f2a88f57640 1 --2- 172.21.15.42:0/3726195863 >> v2:172.21.15.42:6800/36970769 conn(0x7f2a6c07b110 0x7f2a6c07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:03:47.801 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.794+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=760}) -- 0x7f2a6c086e00 con 0x7f2a84109070 2024-09-21T18:03:47.801 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.795+0000 7f2a88f57640 1 --2- 172.21.15.42:0/3726195863 >> v2:172.21.15.42:6800/36970769 conn(0x7f2a6c07b110 0x7f2a6c07d5d0 secure :-1 s=READY pgs=3897 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400f710 tx=0x7f2a74007670 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:03:47.801 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.799+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f2a7c069b10 con 0x7f2a84109070 2024-09-21T18:03:47.995 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:47.993+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/3726195863 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} v 0) -- 0x7f2a841a7760 con 0x7f2a84109070 2024-09-21T18:03:48.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:03:48.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:47 smithi162 ceph-mon[32106]: osdmap e758: 8 total, 8 up, 8 in 2024-09-21T18:03:48.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:47 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:03:48.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:47 smithi162 ceph-mon[32106]: pgmap v1234: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:48.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:03:48.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:47 smithi042 ceph-mon[29361]: osdmap e758: 8 total, 8 up, 8 in 2024-09-21T18:03:48.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:47 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:03:48.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:47 smithi042 ceph-mon[29361]: pgmap v1234: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:48.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:03:48.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:47 smithi042 ceph-mon[38309]: osdmap e758: 8 total, 8 up, 8 in 2024-09-21T18:03:48.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:47 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T18:03:48.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:47 smithi042 ceph-mon[38309]: pgmap v1234: 188 pgs: 188 active+clean; 884 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:03:48.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:48.684+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 <== mon.2 v2:172.21.15.42:3301/0 7 ==== osd_map(760..760 src has 1..760) ==== 628+0+0 (secure 0 0 0) 0x7f2a7c06ce00 con 0x7f2a84109070 2024-09-21T18:03:48.686 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:48.684+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=761}) -- 0x7f2a6c0879b0 con 0x7f2a84109070 2024-09-21T18:03:48.689 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:48.686+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 <== mon.2 v2:172.21.15.42:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f v760) ==== 221+0+0 (secure 0 0 0) 0x7f2a7c06e9c0 con 0x7f2a84109070 2024-09-21T18:03:48.805 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:48.803+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/3726195863 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} v 0) -- 0x7f2a841a79b0 con 0x7f2a84109070 2024-09-21T18:03:49.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:03:49.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:48 smithi162 ceph-mon[32106]: osdmap e759: 8 total, 8 up, 8 in 2024-09-21T18:03:49.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:48 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3726195863' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:49.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:48 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:49.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:03:49.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:48 smithi042 ceph-mon[38309]: osdmap e759: 8 total, 8 up, 8 in 2024-09-21T18:03:49.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:48 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3726195863' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:49.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:48 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:49.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4164398216' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T18:03:49.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:48 smithi042 ceph-mon[29361]: osdmap e759: 8 total, 8 up, 8 in 2024-09-21T18:03:49.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:48 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3726195863' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:49.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:48 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:49.699 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.697+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 <== mon.2 v2:172.21.15.42:3301/0 9 ==== osd_map(761..761 src has 1..761) ==== 628+0+0 (secure 0 0 0) 0x7f2a7c09c960 con 0x7f2a84109070 2024-09-21T18:03:49.700 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.697+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=762}) -- 0x7f2a6c087ff0 con 0x7f2a84109070 2024-09-21T18:03:49.704 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.702+0000 7f2a81ffb640 1 -- 172.21.15.42:0/3726195863 <== mon.2 v2:172.21.15.42:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f v761) ==== 221+0+0 (secure 0 0 0) 0x7f2a7c0612a0 con 0x7f2a84109070 2024-09-21T18:03:49.704 INFO:tasks.workunit.client.0.smithi042.stderr:set-quota max_objects = 0 for pool 277077be-0cb2-4630-9bef-40c97902f85f 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/3726195863 >> v2:172.21.15.42:6800/36970769 conn(0x7f2a6c07b110 msgr2=0x7f2a6c07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 --2- 172.21.15.42:0/3726195863 >> v2:172.21.15.42:6800/36970769 conn(0x7f2a6c07b110 0x7f2a6c07d5d0 secure :-1 s=READY pgs=3897 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400f710 tx=0x7f2a74007670 comp rx=0 tx=0).stop 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/3726195863 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2a84109070 msgr2=0x7f2a84075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 --2- 172.21.15.42:0/3726195863 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2a84109070 0x7f2a84075f20 secure :-1 s=READY pgs=3016 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00e970 tx=0x7f2a7c00ee30 comp rx=0 tx=0).stop 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/3726195863 shutdown_connections 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 --2- 172.21.15.42:0/3726195863 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2a84109070 0x7f2a84075f20 unknown :-1 s=CLOSED pgs=3016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 --2- 172.21.15.42:0/3726195863 >> v2:172.21.15.42:6800/36970769 conn(0x7f2a6c07b110 0x7f2a6c07d5d0 unknown :-1 s=CLOSED pgs=3897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 --2- 172.21.15.42:0/3726195863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a841086f0 0x7f2a840759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 --2- 172.21.15.42:0/3726195863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a84102cf0 0x7f2a840754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/3726195863 >> 172.21.15.42:0/3726195863 conn(0x7f2a840fe750 msgr2=0x7f2a8406a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/3726195863 shutdown_connections 2024-09-21T18:03:49.709 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:03:49.706+0000 7f2a8b1bb640 1 -- 172.21.15.42:0/3726195863 wait complete. 2024-09-21T18:03:49.720 INFO:tasks.workunit.client.0.smithi042.stderr:+ sleep 30 2024-09-21T18:03:49.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:03:49 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:03:49.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:03:49.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:49 smithi162 ceph-mon[32106]: osdmap e760: 8 total, 8 up, 8 in 2024-09-21T18:03:49.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:49 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/3726195863' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:49.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:49 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:49.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:49 smithi162 ceph-mon[32106]: pgmap v1237: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-09-21T18:03:49.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:49 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:50.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:03:50.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[38309]: osdmap e760: 8 total, 8 up, 8 in 2024-09-21T18:03:50.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/3726195863' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[38309]: pgmap v1237: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-09-21T18:03:50.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:03:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[29361]: osdmap e760: 8 total, 8 up, 8 in 2024-09-21T18:03:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/3726195863' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T18:03:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[29361]: pgmap v1237: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-09-21T18:03:50.165 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:49 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:03:51.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:50 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:03:51.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:50 smithi162 ceph-mon[32106]: osdmap e761: 8 total, 8 up, 8 in 2024-09-21T18:03:51.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:50 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:03:51.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:50 smithi042 ceph-mon[29361]: osdmap e761: 8 total, 8 up, 8 in 2024-09-21T18:03:51.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:50 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "field": "max_objects", "val": "0"}]': finished 2024-09-21T18:03:51.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:50 smithi042 ceph-mon[38309]: osdmap e761: 8 total, 8 up, 8 in 2024-09-21T18:03:52.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:51 smithi162 ceph-mon[32106]: pgmap v1239: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-09-21T18:03:52.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:51 smithi042 ceph-mon[29361]: pgmap v1239: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-09-21T18:03:52.165 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:51 smithi042 ceph-mon[38309]: pgmap v1239: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-09-21T18:03:54.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:03:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:03:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:03:54.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:54 smithi042 ceph-mon[29361]: pgmap v1240: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T18:03:54.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:54 smithi042 ceph-mon[38309]: pgmap v1240: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T18:03:55.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:54 smithi162 ceph-mon[32106]: pgmap v1240: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T18:03:56.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:56 smithi162 ceph-mon[32106]: pgmap v1241: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T18:03:56.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:56 smithi042 ceph-mon[29361]: pgmap v1241: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T18:03:56.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:56 smithi042 ceph-mon[38309]: pgmap v1241: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T18:03:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:58 smithi042 ceph-mon[29361]: pgmap v1242: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 578 B/s rd, 0 op/s 2024-09-21T18:03:58.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:58 smithi042 ceph-mon[38309]: pgmap v1242: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 578 B/s rd, 0 op/s 2024-09-21T18:03:59.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:58 smithi162 ceph-mon[32106]: pgmap v1242: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 578 B/s rd, 0 op/s 2024-09-21T18:03:59.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:03:59 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:59.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:03:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:03:59.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:03:59 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:03:59.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:03:59 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:04:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:00 smithi042 ceph-mon[29361]: pgmap v1243: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:04:00.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:00 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:04:00.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:00 smithi042 ceph-mon[38309]: pgmap v1243: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:04:00.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:00 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:04:01.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:00 smithi162 ceph-mon[32106]: pgmap v1243: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:04:01.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:00 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:04:02.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:02 smithi042 ceph-mon[29361]: pgmap v1244: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 865 B/s rd, 0 op/s 2024-09-21T18:04:02.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:02 smithi042 ceph-mon[38309]: pgmap v1244: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 865 B/s rd, 0 op/s 2024-09-21T18:04:03.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:02 smithi162 ceph-mon[32106]: pgmap v1244: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 865 B/s rd, 0 op/s 2024-09-21T18:04:04.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:03 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:04:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:04:04.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:04 smithi042 ceph-mon[29361]: pgmap v1245: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:04.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:04 smithi042 ceph-mon[38309]: pgmap v1245: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:05.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:04 smithi162 ceph-mon[32106]: pgmap v1245: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:06.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:06 smithi042 ceph-mon[29361]: pgmap v1246: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:06.914 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:06 smithi042 ceph-mon[38309]: pgmap v1246: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:07.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:06 smithi162 ceph-mon[32106]: pgmap v1246: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:08.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:08 smithi042 ceph-mon[29361]: pgmap v1247: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:08.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:08 smithi042 ceph-mon[38309]: pgmap v1247: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:09.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:08 smithi162 ceph-mon[32106]: pgmap v1247: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:09.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:04:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:04:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:10 smithi042 ceph-mon[29361]: pgmap v1248: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:10.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:10 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:04:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:10 smithi042 ceph-mon[38309]: pgmap v1248: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:10.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:10 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:04:11.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:10 smithi162 ceph-mon[32106]: pgmap v1248: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:11.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:10 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:04:12.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:12 smithi042 ceph-mon[29361]: pgmap v1249: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:04:12.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:12 smithi042 ceph-mon[38309]: pgmap v1249: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:04:13.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:12 smithi162 ceph-mon[32106]: pgmap v1249: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T18:04:14.164 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:13 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:04:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:04:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:14 smithi042 ceph-mon[29361]: pgmap v1250: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:14.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:14 smithi042 ceph-mon[29361]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:04:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:14 smithi042 ceph-mon[38309]: pgmap v1250: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:14.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:14 smithi042 ceph-mon[38309]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:04:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:14 smithi162 ceph-mon[32106]: pgmap v1250: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:15.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:14 smithi162 ceph-mon[32106]: from='mgr.14598 172.21.15.42:0/4080771969' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T18:04:16.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:16 smithi042 ceph-mon[29361]: pgmap v1251: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:16.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:16 smithi042 ceph-mon[38309]: pgmap v1251: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:17.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:16 smithi162 ceph-mon[32106]: pgmap v1251: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:18.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:18 smithi042 ceph-mon[29361]: pgmap v1252: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:18.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:18 smithi042 ceph-mon[38309]: pgmap v1252: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:19.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:18 smithi162 ceph-mon[32106]: pgmap v1252: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T18:04:19.722 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool delete 277077be-0cb2-4630-9bef-40c97902f85f 277077be-0cb2-4630-9bef-40c97902f85f --yes-i-really-really-mean-it 2024-09-21T18:04:19.818 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.815+0000 7f7d502a9640 1 -- 172.21.15.42:0/485736130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d48104520 msgr2=0x7f7d4810ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:04:19.818 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.815+0000 7f7d502a9640 1 --2- 172.21.15.42:0/485736130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d48104520 0x7f7d4810ca00 secure :-1 s=READY pgs=2941 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009900 tx=0x7f7d3802a410 comp rx=0 tx=0).stop 2024-09-21T18:04:19.819 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 -- 172.21.15.42:0/485736130 shutdown_connections 2024-09-21T18:04:19.819 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 --2- 172.21.15.42:0/485736130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4810d050 0x7f7d4810f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:19.819 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 --2- 172.21.15.42:0/485736130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d48104520 0x7f7d4810ca00 unknown :-1 s=CLOSED pgs=2941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:19.819 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 --2- 172.21.15.42:0/485736130 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7d48103c00 0x7f7d48103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:19.819 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 -- 172.21.15.42:0/485736130 >> 172.21.15.42:0/485736130 conn(0x7f7d480fd630 msgr2=0x7f7d480ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:04:19.819 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 -- 172.21.15.42:0/485736130 shutdown_connections 2024-09-21T18:04:19.819 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 -- 172.21.15.42:0/485736130 wait complete. 2024-09-21T18:04:19.819 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 Processor -- start 2024-09-21T18:04:19.819 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 -- start start 2024-09-21T18:04:19.821 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d48103c00 0x7f7d48198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:04:19.821 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d48104520 0x7f7d48198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:04:19.821 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7d4810d050 0x7f7d4819e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:04:19.821 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d481123f0 con 0x7f7d48104520 2024-09-21T18:04:19.821 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d48112270 con 0x7f7d48103c00 2024-09-21T18:04:19.821 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.816+0000 7f7d502a9640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7f7d48112570 con 0x7f7d4810d050 2024-09-21T18:04:19.821 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4e846640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7d4810d050 0x7f7d4819e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:04:19.821 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4d844640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d48104520 0x7f7d48198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4e846640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7d4810d050 0x7f7d4819e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:55308/0 (socket says 172.21.15.42:55308) 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4d844640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d48104520 0x7f7d48198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57622/0 (socket says 172.21.15.42:57622) 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4e846640 1 -- 172.21.15.42:0/499057880 learned_addr learned my addr 172.21.15.42:0/499057880 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4e045640 1 --2- 172.21.15.42:0/499057880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d48103c00 0x7f7d48198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4e846640 1 -- 172.21.15.42:0/499057880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d48103c00 msgr2=0x7f7d48198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4e846640 1 --2- 172.21.15.42:0/499057880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d48103c00 0x7f7d48198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4e846640 1 -- 172.21.15.42:0/499057880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d48104520 msgr2=0x7f7d48198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4e846640 1 --2- 172.21.15.42:0/499057880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d48104520 0x7f7d48198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4e846640 1 -- 172.21.15.42:0/499057880 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4819e9d0 con 0x7f7d4810d050 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4d844640 1 --2- 172.21.15.42:0/499057880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d48104520 0x7f7d48198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d4e846640 1 --2- 172.21.15.42:0/499057880 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7d4810d050 0x7f7d4819e200 secure :-1 s=READY pgs=3017 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000eaa0 tx=0x7f7d4000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d3f7fe640 1 -- 172.21.15.42:0/499057880 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000cdb0 con 0x7f7d4810d050 2024-09-21T18:04:19.822 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d502a9640 1 -- 172.21.15.42:0/499057880 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4819ecc0 con 0x7f7d4810d050 2024-09-21T18:04:19.823 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d3f7fe640 1 -- 172.21.15.42:0/499057880 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7d40005020 con 0x7f7d4810d050 2024-09-21T18:04:19.823 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d3f7fe640 1 -- 172.21.15.42:0/499057880 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d400116d0 con 0x7f7d4810d050 2024-09-21T18:04:19.823 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.817+0000 7f7d502a9640 1 -- 172.21.15.42:0/499057880 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d481a5380 con 0x7f7d4810d050 2024-09-21T18:04:19.823 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.819+0000 7f7d502a9640 1 -- 172.21.15.42:0/499057880 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d48103fe0 con 0x7f7d4810d050 2024-09-21T18:04:19.823 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.819+0000 7f7d3f7fe640 1 -- 172.21.15.42:0/499057880 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7f7d40004a40 con 0x7f7d4810d050 2024-09-21T18:04:19.824 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.820+0000 7f7d3f7fe640 1 --2- 172.21.15.42:0/499057880 >> v2:172.21.15.42:6800/36970769 conn(0x7f7d3407b110 0x7f7d3407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:04:19.824 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.820+0000 7f7d3f7fe640 1 -- 172.21.15.42:0/499057880 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(761..761 src has 1..761) ==== 8202+0+0 (secure 0 0 0) 0x7f7d4009ed30 con 0x7f7d4810d050 2024-09-21T18:04:19.824 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.820+0000 7f7d4e045640 1 --2- 172.21.15.42:0/499057880 >> v2:172.21.15.42:6800/36970769 conn(0x7f7d3407b110 0x7f7d3407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:04:19.824 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.820+0000 7f7d3f7fe640 1 -- 172.21.15.42:0/499057880 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=762}) -- 0x7f7d34086e80 con 0x7f7d4810d050 2024-09-21T18:04:19.824 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.820+0000 7f7d4e045640 1 --2- 172.21.15.42:0/499057880 >> v2:172.21.15.42:6800/36970769 conn(0x7f7d3407b110 0x7f7d3407d5d0 secure :-1 s=READY pgs=3898 cs=0 l=1 rev1=1 crypto rx=0x7f7d440095f0 tx=0x7f7d44005f90 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:04:19.827 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:19.824+0000 7f7d3f7fe640 1 -- 172.21.15.42:0/499057880 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7f7d40016030 con 0x7f7d4810d050 2024-09-21T18:04:20.018 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.015+0000 7f7d502a9640 1 -- 172.21.15.42:0/499057880 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7d48108040 con 0x7f7d4810d050 2024-09-21T18:04:20.075 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:04:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug there is no tcmu-runner data available 2024-09-21T18:04:20.632 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.630+0000 7f7d3f7fe640 1 -- 172.21.15.42:0/499057880 <== mon.2 v2:172.21.15.42:3301/0 7 ==== osd_map(762..762 src has 1..762) ==== 296+0+0 (secure 0 0 0) 0x7f7d4009c930 con 0x7f7d4810d050 2024-09-21T18:04:20.633 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.630+0000 7f7d3f7fe640 1 -- 172.21.15.42:0/499057880 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=763}) -- 0x7f7d34087750 con 0x7f7d4810d050 2024-09-21T18:04:20.636 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.634+0000 7f7d3f7fe640 1 -- 172.21.15.42:0/499057880 <== mon.2 v2:172.21.15.42:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true}]=0 pool '277077be-0cb2-4630-9bef-40c97902f85f' removed v762) ==== 248+0+0 (secure 0 0 0) 0x7f7d40069ae0 con 0x7f7d4810d050 2024-09-21T18:04:20.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.753+0000 7f7d502a9640 1 -- 172.21.15.42:0/499057880 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7d4802e5c0 con 0x7f7d4810d050 2024-09-21T18:04:20.756 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.754+0000 7f7d3f7fe640 1 -- 172.21.15.42:0/499057880 <== mon.2 v2:172.21.15.42:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true}]=0 pool '277077be-0cb2-4630-9bef-40c97902f85f' does not exist v762) ==== 255+0+0 (secure 0 0 0) 0x7f7d4006e990 con 0x7f7d4810d050 2024-09-21T18:04:20.757 INFO:tasks.workunit.client.0.smithi042.stderr:pool '277077be-0cb2-4630-9bef-40c97902f85f' does not exist 2024-09-21T18:04:20.759 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.756+0000 7f7d502a9640 1 -- 172.21.15.42:0/499057880 >> v2:172.21.15.42:6800/36970769 conn(0x7f7d3407b110 msgr2=0x7f7d3407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:04:20.759 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.756+0000 7f7d502a9640 1 --2- 172.21.15.42:0/499057880 >> v2:172.21.15.42:6800/36970769 conn(0x7f7d3407b110 0x7f7d3407d5d0 secure :-1 s=READY pgs=3898 cs=0 l=1 rev1=1 crypto rx=0x7f7d440095f0 tx=0x7f7d44005f90 comp rx=0 tx=0).stop 2024-09-21T18:04:20.759 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.756+0000 7f7d502a9640 1 -- 172.21.15.42:0/499057880 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7d4810d050 msgr2=0x7f7d4819e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:04:20.759 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.756+0000 7f7d502a9640 1 --2- 172.21.15.42:0/499057880 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7d4810d050 0x7f7d4819e200 secure :-1 s=READY pgs=3017 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000eaa0 tx=0x7f7d4000ef60 comp rx=0 tx=0).stop 2024-09-21T18:04:20.759 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.756+0000 7f7d502a9640 1 -- 172.21.15.42:0/499057880 shutdown_connections 2024-09-21T18:04:20.759 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.756+0000 7f7d502a9640 1 --2- 172.21.15.42:0/499057880 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7d4810d050 0x7f7d4819e200 unknown :-1 s=CLOSED pgs=3017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:20.759 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.756+0000 7f7d502a9640 1 --2- 172.21.15.42:0/499057880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d48104520 0x7f7d48198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:20.759 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.756+0000 7f7d502a9640 1 --2- 172.21.15.42:0/499057880 >> v2:172.21.15.42:6800/36970769 conn(0x7f7d3407b110 0x7f7d3407d5d0 unknown :-1 s=CLOSED pgs=3898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:20.760 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.756+0000 7f7d502a9640 1 --2- 172.21.15.42:0/499057880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d48103c00 0x7f7d48198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:20.760 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.756+0000 7f7d502a9640 1 -- 172.21.15.42:0/499057880 >> 172.21.15.42:0/499057880 conn(0x7f7d480fd630 msgr2=0x7f7d480fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:04:20.760 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.757+0000 7f7d502a9640 1 -- 172.21.15.42:0/499057880 shutdown_connections 2024-09-21T18:04:20.760 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.757+0000 7f7d502a9640 1 -- 172.21.15.42:0/499057880 wait complete. 2024-09-21T18:04:20.768 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd pool delete e3e943c5-f73c-42c4-bca2-88d8a4b98f11 e3e943c5-f73c-42c4-bca2-88d8a4b98f11 --yes-i-really-really-mean-it 2024-09-21T18:04:20.859 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.852+0000 7fdc4a616640 1 -- 172.21.15.42:0/2696947420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc44109070 msgr2=0x7fdc4410f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:04:20.860 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.852+0000 7fdc4a616640 1 --2- 172.21.15.42:0/2696947420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc44109070 0x7fdc4410f870 secure :-1 s=READY pgs=3018 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009ca0 tx=0x7fdc3c02a8c0 comp rx=0 tx=0).stop 2024-09-21T18:04:20.860 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.853+0000 7fdc4a616640 1 -- 172.21.15.42:0/2696947420 shutdown_connections 2024-09-21T18:04:20.860 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.853+0000 7fdc4a616640 1 --2- 172.21.15.42:0/2696947420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc44109070 0x7fdc4410f870 unknown :-1 s=CLOSED pgs=3018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:20.860 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.853+0000 7fdc4a616640 1 --2- 172.21.15.42:0/2696947420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc441086f0 0x7fdc44108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:20.860 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.853+0000 7fdc4a616640 1 --2- 172.21.15.42:0/2696947420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc44102cf0 0x7fdc441030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:20.860 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.853+0000 7fdc4a616640 1 -- 172.21.15.42:0/2696947420 >> 172.21.15.42:0/2696947420 conn(0x7fdc440fe750 msgr2=0x7fdc44100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:04:20.860 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.853+0000 7fdc4a616640 1 -- 172.21.15.42:0/2696947420 shutdown_connections 2024-09-21T18:04:20.860 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.853+0000 7fdc4a616640 1 -- 172.21.15.42:0/2696947420 wait complete. 2024-09-21T18:04:20.861 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.853+0000 7fdc4a616640 1 Processor -- start 2024-09-21T18:04:20.861 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.853+0000 7fdc4a616640 1 -- start start 2024-09-21T18:04:20.861 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc4a616640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc44102cf0 0x7fdc44198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:04:20.861 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc4a616640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc441086f0 0x7fdc44198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:04:20.861 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc4a616640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc44109070 0x7fdc4419e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:04:20.861 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc4a616640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdc44112440 con 0x7fdc441086f0 2024-09-21T18:04:20.861 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc4a616640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc441122c0 con 0x7fdc44102cf0 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc4a616640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 -- 0x7fdc441125c0 con 0x7fdc44109070 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc48bb3640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc44109070 0x7fdc4419e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc437fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc441086f0 0x7fdc44198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc48bb3640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc44109070 0x7fdc4419e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:55316/0 (socket says 172.21.15.42:55316) 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc48bb3640 1 -- 172.21.15.42:0/4172402557 learned_addr learned my addr 172.21.15.42:0/4172402557 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc43fff640 1 --2- 172.21.15.42:0/4172402557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc44102cf0 0x7fdc44198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc437fe640 1 -- 172.21.15.42:0/4172402557 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc44109070 msgr2=0x7fdc4419e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc437fe640 1 --2- 172.21.15.42:0/4172402557 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc44109070 0x7fdc4419e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc437fe640 1 -- 172.21.15.42:0/4172402557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc44102cf0 msgr2=0x7fdc44198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc437fe640 1 --2- 172.21.15.42:0/4172402557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc44102cf0 0x7fdc44198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc437fe640 1 -- 172.21.15.42:0/4172402557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4419e9e0 con 0x7fdc441086f0 2024-09-21T18:04:20.862 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc48bb3640 1 --2- 172.21.15.42:0/4172402557 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc44109070 0x7fdc4419e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T18:04:20.863 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc437fe640 1 --2- 172.21.15.42:0/4172402557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc441086f0 0x7fdc44198e80 secure :-1 s=READY pgs=2942 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800e9f0 tx=0x7fdc3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:04:20.863 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc417fa640 1 -- 172.21.15.42:0/4172402557 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3800cd80 con 0x7fdc441086f0 2024-09-21T18:04:20.863 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc417fa640 1 -- 172.21.15.42:0/4172402557 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fdc380035f0 con 0x7fdc441086f0 2024-09-21T18:04:20.863 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc4a616640 1 -- 172.21.15.42:0/4172402557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4419ecd0 con 0x7fdc441086f0 2024-09-21T18:04:20.863 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc417fa640 1 -- 172.21.15.42:0/4172402557 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc380044a0 con 0x7fdc441086f0 2024-09-21T18:04:20.863 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.854+0000 7fdc4a616640 1 -- 172.21.15.42:0/4172402557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc441a5390 con 0x7fdc441086f0 2024-09-21T18:04:20.863 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.855+0000 7fdc4a616640 1 -- 172.21.15.42:0/4172402557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc441030d0 con 0x7fdc441086f0 2024-09-21T18:04:20.863 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.856+0000 7fdc417fa640 1 -- 172.21.15.42:0/4172402557 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 103255+0+0 (secure 0 0 0) 0x7fdc38004000 con 0x7fdc441086f0 2024-09-21T18:04:20.864 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.857+0000 7fdc417fa640 1 --2- 172.21.15.42:0/4172402557 >> v2:172.21.15.42:6800/36970769 conn(0x7fdc2c07b110 0x7fdc2c07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T18:04:20.864 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.857+0000 7fdc43fff640 1 --2- 172.21.15.42:0/4172402557 >> v2:172.21.15.42:6800/36970769 conn(0x7fdc2c07b110 0x7fdc2c07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T18:04:20.864 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.857+0000 7fdc417fa640 1 -- 172.21.15.42:0/4172402557 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(762..762 src has 1..762) ==== 7814+0+0 (secure 0 0 0) 0x7fdc3809eca0 con 0x7fdc441086f0 2024-09-21T18:04:20.864 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.857+0000 7fdc417fa640 1 -- 172.21.15.42:0/4172402557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=763}) -- 0x7fdc2c086660 con 0x7fdc441086f0 2024-09-21T18:04:20.864 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.857+0000 7fdc43fff640 1 --2- 172.21.15.42:0/4172402557 >> v2:172.21.15.42:6800/36970769 conn(0x7fdc2c07b110 0x7fdc2c07d5d0 secure :-1 s=READY pgs=3899 cs=0 l=1 rev1=1 crypto rx=0x7fdc34005fd0 tx=0x7fdc34005850 comp rx=0 tx=0).ready entity=mgr.14598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T18:04:20.864 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:20.861+0000 7fdc417fa640 1 -- 172.21.15.42:0/4172402557 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198650 (secure 0 0 0) 0x7fdc38069c20 con 0x7fdc441086f0 2024-09-21T18:04:20.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:20 smithi042 ceph-mon[29361]: pgmap v1253: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:20 smithi042 ceph-mon[29361]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:04:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:20 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/499057880' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:20.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:20 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:20 smithi042 ceph-mon[38309]: pgmap v1253: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:20.915 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:20 smithi042 ceph-mon[38309]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:04:20.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:20 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/499057880' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:20.916 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:20 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:21.053 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.051+0000 7fdc4a616640 1 -- 172.21.15.42:0/4172402557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdc4410ae50 con 0x7fdc441086f0 2024-09-21T18:04:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:20 smithi162 ceph-mon[32106]: pgmap v1253: 188 pgs: 188 active+clean; 897 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T18:04:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:20 smithi162 ceph-mon[32106]: from='client.24448 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T18:04:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:20 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/499057880' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:21.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:20 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:21.637 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.635+0000 7fdc417fa640 1 -- 172.21.15.42:0/4172402557 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true}]=0 pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' removed v763) ==== 248+0+0 (secure 0 0 0) 0x7fdc3806ead0 con 0x7fdc441086f0 2024-09-21T18:04:21.638 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.635+0000 7fdc417fa640 1 -- 172.21.15.42:0/4172402557 <== mon.0 v2:172.21.15.42:3300/0 8 ==== osd_map(763..763 src has 1..763) ==== 296+0+0 (secure 0 0 0) 0x7fdc3809caa0 con 0x7fdc441086f0 2024-09-21T18:04:21.638 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.635+0000 7fdc417fa640 1 -- 172.21.15.42:0/4172402557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=764}) -- 0x7fdc2c0872e0 con 0x7fdc441086f0 2024-09-21T18:04:21.764 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.762+0000 7fdc4a616640 1 -- 172.21.15.42:0/4172402557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdc4410aa90 con 0x7fdc441086f0 2024-09-21T18:04:21.765 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.762+0000 7fdc417fa640 1 -- 172.21.15.42:0/4172402557 <== mon.0 v2:172.21.15.42:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true}]=0 pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' does not exist v763) ==== 255+0+0 (secure 0 0 0) 0x7fdc3806c0b0 con 0x7fdc441086f0 2024-09-21T18:04:21.765 INFO:tasks.workunit.client.0.smithi042.stderr:pool 'e3e943c5-f73c-42c4-bca2-88d8a4b98f11' does not exist 2024-09-21T18:04:21.767 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 -- 172.21.15.42:0/4172402557 >> v2:172.21.15.42:6800/36970769 conn(0x7fdc2c07b110 msgr2=0x7fdc2c07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:04:21.767 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 --2- 172.21.15.42:0/4172402557 >> v2:172.21.15.42:6800/36970769 conn(0x7fdc2c07b110 0x7fdc2c07d5d0 secure :-1 s=READY pgs=3899 cs=0 l=1 rev1=1 crypto rx=0x7fdc34005fd0 tx=0x7fdc34005850 comp rx=0 tx=0).stop 2024-09-21T18:04:21.768 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 -- 172.21.15.42:0/4172402557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc441086f0 msgr2=0x7fdc44198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T18:04:21.768 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 --2- 172.21.15.42:0/4172402557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc441086f0 0x7fdc44198e80 secure :-1 s=READY pgs=2942 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800e9f0 tx=0x7fdc3800eeb0 comp rx=0 tx=0).stop 2024-09-21T18:04:21.768 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 -- 172.21.15.42:0/4172402557 shutdown_connections 2024-09-21T18:04:21.768 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 --2- 172.21.15.42:0/4172402557 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc44109070 0x7fdc4419e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:21.768 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 --2- 172.21.15.42:0/4172402557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc441086f0 0x7fdc44198e80 unknown :-1 s=CLOSED pgs=2942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:21.768 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 --2- 172.21.15.42:0/4172402557 >> v2:172.21.15.42:6800/36970769 conn(0x7fdc2c07b110 0x7fdc2c07d5d0 unknown :-1 s=CLOSED pgs=3899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:21.768 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 --2- 172.21.15.42:0/4172402557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc44102cf0 0x7fdc44198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T18:04:21.768 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 -- 172.21.15.42:0/4172402557 >> 172.21.15.42:0/4172402557 conn(0x7fdc440fe750 msgr2=0x7fdc44100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T18:04:21.768 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 -- 172.21.15.42:0/4172402557 shutdown_connections 2024-09-21T18:04:21.768 INFO:tasks.workunit.client.0.smithi042.stderr:2024-09-21T18:04:21.765+0000 7fdc4a616640 1 -- 172.21.15.42:0/4172402557 wait complete. 2024-09-21T18:04:21.777 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo OK 2024-09-21T18:04:21.777 INFO:tasks.workunit.client.0.smithi042.stdout:OK 2024-09-21T18:04:21.778 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T18:04:21.778 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T18:04:21.846 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-09-21T18:04:21.846 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T18:04:21.909 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T18:04:21.909 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:21 smithi042 ceph-mon[29361]: osdmap e762: 8 total, 8 up, 8 in 2024-09-21T18:04:21.909 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/499057880' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:21.909 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:21 smithi042 ceph-mon[29361]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:21.909 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:21 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4172402557' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:21.910 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T18:04:21.910 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:21 smithi042 ceph-mon[38309]: osdmap e762: 8 total, 8 up, 8 in 2024-09-21T18:04:21.910 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/499057880' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:21.910 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:21 smithi042 ceph-mon[38309]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:21.910 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:21 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4172402557' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T18:04:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:21 smithi162 ceph-mon[32106]: osdmap e762: 8 total, 8 up, 8 in 2024-09-21T18:04:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/499057880' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:21 smithi162 ceph-mon[32106]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "277077be-0cb2-4630-9bef-40c97902f85f", "pool2": "277077be-0cb2-4630-9bef-40c97902f85f", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:22.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:21 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4172402557' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:22.182 DEBUG:teuthology.parallel:result is None 2024-09-21T18:04:22.182 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T18:04:22.248 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T18:04:22.248 DEBUG:teuthology.orchestra.run.smithi042:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-21T18:04:22.307 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T18:04:22.308 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T18:04:22.320 INFO:tasks.cephadm:Teardown begin 2024-09-21T18:04:22.320 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T18:04:22.373 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T18:04:22.406 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T18:04:22.406 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T18:04:22.429 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T18:04:22.465 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T18:04:22.465 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T18:04:22.465 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.a 2024-09-21T18:04:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:22 smithi162 ceph-mon[32106]: pgmap v1255: 176 pgs: 176 active+clean; 708 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:04:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:22 smithi162 ceph-mon[32106]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T18:04:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4172402557' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T18:04:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:22 smithi162 ceph-mon[32106]: osdmap e763: 8 total, 8 up, 8 in 2024-09-21T18:04:22.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:22 smithi162 ceph-mon[32106]: from='client.? 172.21.15.42:0/4172402557' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:22.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:22 smithi042 systemd[1]: Stopping Ceph mon.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:04:22.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-mon[29361]: pgmap v1255: 176 pgs: 176 active+clean; 708 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:04:22.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-mon[29361]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T18:04:22.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4172402557' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T18:04:22.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-mon[29361]: osdmap e763: 8 total, 8 up, 8 in 2024-09-21T18:04:22.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-mon[29361]: from='client.? 172.21.15.42:0/4172402557' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:22.839 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-mon[38309]: pgmap v1255: 176 pgs: 176 active+clean; 708 KiB data, 791 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T18:04:22.840 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-mon[38309]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T18:04:22.840 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4172402557' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T18:04:22.840 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-mon[38309]: osdmap e763: 8 total, 8 up, 8 in 2024-09-21T18:04:22.840 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-mon[38309]: from='client.? 172.21.15.42:0/4172402557' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "pool2": "e3e943c5-f73c-42c4-bca2-88d8a4b98f11", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T18:04:23.114 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a[29357]: 2024-09-21T18:04:22.836+0000 7fb407283640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:04:23.114 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a[29357]: 2024-09-21T18:04:22.836+0000 7fb407283640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T18:04:23.114 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:22 smithi042 podman[142225]: 2024-09-21 18:04:22.867762007 +0000 UTC m=+0.207943188 container died 0c8039e706c8d8a9a09afa9b1fb3fe3daf9e33d5aebc0783dc3a13bfff862202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T18:04:23.115 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:22] ENGINE Bus STOPPING 2024-09-21T18:04:23.115 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:22] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T18:04:23.115 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:22] ENGINE Bus STOPPED 2024-09-21T18:04:23.115 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:22 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:22] ENGINE Bus STARTING 2024-09-21T18:04:23.115 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:23] ENGINE Serving on http://:::9283 2024-09-21T18:04:23.115 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:23] ENGINE Bus STARTED 2024-09-21T18:04:23.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:23 smithi042 podman[142225]: 2024-09-21 18:04:23.312331803 +0000 UTC m=+0.652513023 container cleanup 0c8039e706c8d8a9a09afa9b1fb3fe3daf9e33d5aebc0783dc3a13bfff862202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T18:04:23.414 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 21 18:04:23 smithi042 bash[142225]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-a 2024-09-21T18:04:23.801 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.a.service' 2024-09-21T18:04:23.840 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:04:23.840 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T18:04:23.841 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-09-21T18:04:23.841 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.c 2024-09-21T18:04:23.902 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:23 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: ::ffff:172.21.15.162 - - [21/Sep/2024:18:04:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T18:04:24.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:23 smithi042 systemd[1]: Stopping Ceph mon.c for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:04:24.579 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-c[38305]: 2024-09-21T18:04:24.321+0000 7f8aa20dd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:04:24.579 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-c[38305]: 2024-09-21T18:04:24.321+0000 7f8aa20dd640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T18:04:24.580 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:24] ENGINE Bus STOPPING 2024-09-21T18:04:24.580 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:24] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T18:04:24.580 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:24] ENGINE Bus STOPPED 2024-09-21T18:04:24.580 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:24] ENGINE Bus STARTING 2024-09-21T18:04:24.580 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:24] ENGINE Serving on http://:::9283 2024-09-21T18:04:24.580 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:24 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: [21/Sep/2024:18:04:24] ENGINE Bus STARTED 2024-09-21T18:04:24.896 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:24 smithi042 podman[142357]: 2024-09-21 18:04:24.577880443 +0000 UTC m=+0.508919465 container died 84035f58ffc0def0efa1ea9d31cab7ce0fc38fc0a2a617c0f9df4742b8152dac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T18:04:25.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:24 smithi042 podman[142357]: 2024-09-21 18:04:24.984913272 +0000 UTC m=+0.915952295 container cleanup 84035f58ffc0def0efa1ea9d31cab7ce0fc38fc0a2a617c0f9df4742b8152dac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T18:04:25.164 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:24 smithi042 bash[142357]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-c 2024-09-21T18:04:25.577 INFO:journalctl@ceph.mon.c.smithi042.stdout:Sep 21 18:04:25 smithi042 podman[142381]: 2024-09-21 18:04:25.319915765 +0000 UTC m=+0.738901643 container remove 84035f58ffc0def0efa1ea9d31cab7ce0fc38fc0a2a617c0f9df4742b8152dac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-c, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, maintainer=Guillaume Abrioux ) 2024-09-21T18:04:25.581 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.c.service' 2024-09-21T18:04:25.658 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:04:25.658 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-09-21T18:04:25.658 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-09-21T18:04:25.659 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.b 2024-09-21T18:04:25.955 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:25 smithi162 systemd[1]: Stopping Ceph mon.b for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:04:26.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:25 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-b[32101]: 2024-09-21T18:04:25.952+0000 7fa394063640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:04:26.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:25 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-b[32101]: 2024-09-21T18:04:25.952+0000 7fa394063640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T18:04:26.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:26 smithi162 podman[63910]: 2024-09-21 18:04:26.116635862 +0000 UTC m=+0.265781880 container died 164dd68bdec770e414328513b7dc172b6f4286a6dbbef5b9bd894e926f9f7045 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T18:04:26.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:26 smithi162 podman[63910]: 2024-09-21 18:04:26.52808598 +0000 UTC m=+0.677231991 container cleanup 164dd68bdec770e414328513b7dc172b6f4286a6dbbef5b9bd894e926f9f7045 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T18:04:26.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 18:04:26 smithi162 bash[63910]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mon-b 2024-09-21T18:04:26.912 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mon.b.service' 2024-09-21T18:04:26.954 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:04:26.954 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-09-21T18:04:26.954 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T18:04:26.955 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mgr.y 2024-09-21T18:04:27.291 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:27 smithi042 systemd[1]: Stopping Ceph mgr.y for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:04:27.589 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:27 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: 2024-09-21T18:04:27.288+0000 7f2e6052a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:04:27.589 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:27 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y[29589]: 2024-09-21T18:04:27.288+0000 7f2e6052a640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T18:04:27.589 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:27 smithi042 podman[142494]: 2024-09-21 18:04:27.320788041 +0000 UTC m=+0.163030864 container died 8ebd75c0e6a1ce286b8c1c204e9e4df4a29a7c37911ae0eba4fa1f9831690aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T18:04:27.914 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:27 smithi042 podman[142494]: 2024-09-21 18:04:27.815675843 +0000 UTC m=+0.657918664 container cleanup 8ebd75c0e6a1ce286b8c1c204e9e4df4a29a7c37911ae0eba4fa1f9831690aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0ecbb435437226bc091a0c2d4549ba25bf724efe, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T18:04:27.915 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 18:04:27 smithi042 bash[142494]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-y 2024-09-21T18:04:28.215 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mgr.y.service' 2024-09-21T18:04:28.253 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:04:28.253 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T18:04:28.253 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T18:04:28.254 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mgr.x 2024-09-21T18:04:28.575 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 18:04:28 smithi162 systemd[1]: Stopping Ceph mgr.x for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:04:28.994 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 18:04:28 smithi162 podman[64034]: 2024-09-21 18:04:28.731012366 +0000 UTC m=+0.278155201 container died ae207f0f42531984e946c51fb910d73a69694864043bf49d1898a52ce74f1413 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T18:04:29.325 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 18:04:29 smithi162 podman[64034]: 2024-09-21 18:04:29.074867869 +0000 UTC m=+0.622010699 container cleanup ae207f0f42531984e946c51fb910d73a69694864043bf49d1898a52ce74f1413 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x, GIT_CLEAN=True, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T18:04:29.325 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 18:04:29 smithi162 bash[64034]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-mgr-x 2024-09-21T18:04:29.463 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@mgr.x.service' 2024-09-21T18:04:29.498 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:04:29.498 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T18:04:29.498 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T18:04:29.499 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.0 2024-09-21T18:04:29.914 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:29 smithi042 systemd[1]: Stopping Ceph osd.0 for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:04:30.414 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:29 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0[41623]: 2024-09-21T18:04:29.929+0000 7f436eef1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:04:30.414 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:29 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0[41623]: 2024-09-21T18:04:29.929+0000 7f436eef1640 -1 osd.0 763 *** Got signal Terminated *** 2024-09-21T18:04:30.414 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:29 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0[41623]: 2024-09-21T18:04:29.929+0000 7f436eef1640 -1 osd.0 763 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T18:04:35.575 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:35 smithi042 podman[142625]: 2024-09-21 18:04:35.297796108 +0000 UTC m=+5.602362407 container died a7bc1e3518472e504e9d8ff8f20d7636fdab5d562d00d2526fe8bff99be658bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T18:04:35.914 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:35 smithi042 podman[142625]: 2024-09-21 18:04:35.663734466 +0000 UTC m=+5.968300769 container cleanup a7bc1e3518472e504e9d8ff8f20d7636fdab5d562d00d2526fe8bff99be658bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T18:04:35.915 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:35 smithi042 bash[142625]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0 2024-09-21T18:04:36.414 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:36 smithi042 podman[142640]: 2024-09-21 18:04:36.048293066 +0000 UTC m=+0.740343552 container remove a7bc1e3518472e504e9d8ff8f20d7636fdab5d562d00d2526fe8bff99be658bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T18:04:36.712 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:36 smithi042 podman[142729]: 2024-09-21 18:04:36.350758922 +0000 UTC m=+0.016327542 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5 2024-09-21T18:04:36.712 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:36 smithi042 podman[142729]: 2024-09-21 18:04:36.477576959 +0000 UTC m=+0.143145604 container create e4d152816f1818bb8ac5667e6c8938bffcbd5bf46795ef5f2b5751dc9c1bd6cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T18:04:37.019 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:36 smithi042 podman[142729]: 2024-09-21 18:04:36.710484402 +0000 UTC m=+0.376053015 container init e4d152816f1818bb8ac5667e6c8938bffcbd5bf46795ef5f2b5751dc9c1bd6cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T18:04:37.020 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:36 smithi042 podman[142729]: 2024-09-21 18:04:36.714771953 +0000 UTC m=+0.380340563 container start e4d152816f1818bb8ac5667e6c8938bffcbd5bf46795ef5f2b5751dc9c1bd6cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T18:04:37.020 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:36 smithi042 podman[142729]: 2024-09-21 18:04:36.793549088 +0000 UTC m=+0.459117709 container attach e4d152816f1818bb8ac5667e6c8938bffcbd5bf46795ef5f2b5751dc9c1bd6cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T18:04:37.020 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:36 smithi042 podman[142729]: 2024-09-21 18:04:36.91370309 +0000 UTC m=+0.579271694 container died e4d152816f1818bb8ac5667e6c8938bffcbd5bf46795ef5f2b5751dc9c1bd6cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43) 2024-09-21T18:04:37.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:04:37 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:04:37.017Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused" 2024-09-21T18:04:37.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:04:37 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:04:37.018Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T18:04:37.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.0.service' 2024-09-21T18:04:37.670 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:37 smithi042 podman[142752]: 2024-09-21 18:04:37.622932819 +0000 UTC m=+0.700033091 container remove e4d152816f1818bb8ac5667e6c8938bffcbd5bf46795ef5f2b5751dc9c1bd6cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43) 2024-09-21T18:04:37.670 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:37 smithi042 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-21T18:04:37.670 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:37 smithi042 systemd[1]: Stopped Ceph osd.0 for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T18:04:37.670 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 21 18:04:37 smithi042 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.0.service: Consumed 40.420s CPU time. 2024-09-21T18:04:37.686 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:04:37.686 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T18:04:37.686 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T18:04:37.686 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.1 2024-09-21T18:04:38.011 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:37 smithi042 systemd[1]: Stopping Ceph osd.1 for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:04:38.414 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1[46957]: 2024-09-21T18:04:38.008+0000 7fe4a9cb4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:04:38.414 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1[46957]: 2024-09-21T18:04:38.008+0000 7fe4a9cb4640 -1 osd.1 763 *** Got signal Terminated *** 2024-09-21T18:04:38.414 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:38 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1[46957]: 2024-09-21T18:04:38.008+0000 7fe4a9cb4640 -1 osd.1 763 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T18:04:43.662 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:43 smithi042 podman[142833]: 2024-09-21 18:04:43.401868309 +0000 UTC m=+5.493091965 container died 2ca2759f1a9d301a6dc1c4cfc8a26843dd84ccf477e367a7e9accf2ada23d3ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, io.buildah.version=1.37.2) 2024-09-21T18:04:43.914 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:43 smithi042 podman[142833]: 2024-09-21 18:04:43.717579947 +0000 UTC m=+5.808803603 container cleanup 2ca2759f1a9d301a6dc1c4cfc8a26843dd84ccf477e367a7e9accf2ada23d3ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T18:04:43.914 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:43 smithi042 bash[142833]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1 2024-09-21T18:04:44.343 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:43 smithi042 podman[142848]: 2024-09-21 18:04:43.935719814 +0000 UTC m=+0.531700659 container remove 2ca2759f1a9d301a6dc1c4cfc8a26843dd84ccf477e367a7e9accf2ada23d3ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T18:04:44.641 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:44 smithi042 podman[142937]: 2024-09-21 18:04:44.244523001 +0000 UTC m=+0.016320627 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5 2024-09-21T18:04:44.641 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:44 smithi042 podman[142937]: 2024-09-21 18:04:44.345126596 +0000 UTC m=+0.116924212 container create 87800a535634072672f6b6bb2915a0d803f19384ef048dcc6c3187fff82ebab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T18:04:44.641 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:44 smithi042 podman[142937]: 2024-09-21 18:04:44.564334286 +0000 UTC m=+0.336131912 container init 87800a535634072672f6b6bb2915a0d803f19384ef048dcc6c3187fff82ebab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43) 2024-09-21T18:04:44.641 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:44 smithi042 podman[142937]: 2024-09-21 18:04:44.567662268 +0000 UTC m=+0.339459890 container start 87800a535634072672f6b6bb2915a0d803f19384ef048dcc6c3187fff82ebab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.build-date=20240731) 2024-09-21T18:04:44.641 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:44 smithi042 podman[142937]: 2024-09-21 18:04:44.639349535 +0000 UTC m=+0.411147171 container attach 87800a535634072672f6b6bb2915a0d803f19384ef048dcc6c3187fff82ebab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43) 2024-09-21T18:04:44.914 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:44 smithi042 podman[142937]: 2024-09-21 18:04:44.761930928 +0000 UTC m=+0.533728545 container died 87800a535634072672f6b6bb2915a0d803f19384ef048dcc6c3187fff82ebab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T18:04:45.282 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 18:04:45 smithi042 podman[142960]: 2024-09-21 18:04:45.268081952 +0000 UTC m=+0.499665895 container remove 87800a535634072672f6b6bb2915a0d803f19384ef048dcc6c3187fff82ebab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T18:04:45.288 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.1.service' 2024-09-21T18:04:45.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:04:45.331 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T18:04:45.331 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T18:04:45.331 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.2 2024-09-21T18:04:45.657 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:45 smithi042 systemd[1]: Stopping Ceph osd.2 for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:04:45.914 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2[52272]: 2024-09-21T18:04:45.654+0000 7f7ccaaf4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:04:45.914 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2[52272]: 2024-09-21T18:04:45.654+0000 7f7ccaaf4640 -1 osd.2 763 *** Got signal Terminated *** 2024-09-21T18:04:45.914 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:45 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2[52272]: 2024-09-21T18:04:45.654+0000 7f7ccaaf4640 -1 osd.2 763 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T18:04:47.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:04:47 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:04:47.017Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T18:04:47.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:04:47 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:04:47.018Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused" 2024-09-21T18:04:47.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:04:47 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:04:47.018Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T18:04:51.432 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:51 smithi042 podman[143039]: 2024-09-21 18:04:51.176418601 +0000 UTC m=+5.612406228 container died 85006f41d525afc6f7577652795e59d66f01a4b013fdc708a9707a88d65b141e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T18:04:51.699 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:51 smithi042 podman[143039]: 2024-09-21 18:04:51.521370049 +0000 UTC m=+5.957357668 container cleanup 85006f41d525afc6f7577652795e59d66f01a4b013fdc708a9707a88d65b141e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T18:04:51.699 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:51 smithi042 bash[143039]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2 2024-09-21T18:04:52.142 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:51 smithi042 podman[143057]: 2024-09-21 18:04:51.697593377 +0000 UTC m=+0.514351929 container remove 85006f41d525afc6f7577652795e59d66f01a4b013fdc708a9707a88d65b141e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T18:04:52.415 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:52 smithi042 podman[143147]: 2024-09-21 18:04:52.043547711 +0000 UTC m=+0.016366057 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5 2024-09-21T18:04:52.415 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:52 smithi042 podman[143147]: 2024-09-21 18:04:52.148254265 +0000 UTC m=+0.121072594 container create 9567a982ee64d802bf88da3594c3bd37dcc1f7e6933f8bb9bd69c0da5ca15051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43) 2024-09-21T18:04:52.415 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:52 smithi042 podman[143147]: 2024-09-21 18:04:52.325897213 +0000 UTC m=+0.298715557 container init 9567a982ee64d802bf88da3594c3bd37dcc1f7e6933f8bb9bd69c0da5ca15051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2-deactivate, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T18:04:52.415 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:52 smithi042 podman[143147]: 2024-09-21 18:04:52.329186491 +0000 UTC m=+0.302004822 container start 9567a982ee64d802bf88da3594c3bd37dcc1f7e6933f8bb9bd69c0da5ca15051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T18:04:52.805 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:52 smithi042 podman[143147]: 2024-09-21 18:04:52.434044146 +0000 UTC m=+0.406862489 container attach 9567a982ee64d802bf88da3594c3bd37dcc1f7e6933f8bb9bd69c0da5ca15051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43) 2024-09-21T18:04:52.805 INFO:journalctl@ceph.osd.2.smithi042.stdout:Sep 21 18:04:52 smithi042 podman[143147]: 2024-09-21 18:04:52.523817573 +0000 UTC m=+0.496635909 container died 9567a982ee64d802bf88da3594c3bd37dcc1f7e6933f8bb9bd69c0da5ca15051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T18:04:53.094 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.2.service' 2024-09-21T18:04:53.140 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:04:53.140 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T18:04:53.140 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T18:04:53.140 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.3 2024-09-21T18:04:53.414 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:53 smithi042 systemd[1]: Stopping Ceph osd.3 for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:04:53.914 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3[58121]: 2024-09-21T18:04:53.424+0000 7fb17e301640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:04:53.915 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3[58121]: 2024-09-21T18:04:53.424+0000 7fb17e301640 -1 osd.3 763 *** Got signal Terminated *** 2024-09-21T18:04:53.915 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:53 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3[58121]: 2024-09-21T18:04:53.424+0000 7fb17e301640 -1 osd.3 763 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T18:04:56.664 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:56 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3[58121]: 2024-09-21T18:04:56.387+0000 7fb17a916640 -1 osd.3 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:30.972995+0000 front 2024-09-21T18:04:30.973058+0000 (oldest deadline 2024-09-21T18:04:56.273056+0000) 2024-09-21T18:04:57.383 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:04:57 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:04:57.018Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T18:04:57.383 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:04:57 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:04:57.019Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused" 2024-09-21T18:04:57.383 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:04:57 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:04:57.019Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T18:04:57.664 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:57 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3[58121]: 2024-09-21T18:04:57.380+0000 7fb17a916640 -1 osd.3 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:30.972995+0000 front 2024-09-21T18:04:30.973058+0000 (oldest deadline 2024-09-21T18:04:56.273056+0000) 2024-09-21T18:04:58.664 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:58 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3[58121]: 2024-09-21T18:04:58.410+0000 7fb17a916640 -1 osd.3 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:30.972995+0000 front 2024-09-21T18:04:30.973058+0000 (oldest deadline 2024-09-21T18:04:56.273056+0000) 2024-09-21T18:04:58.816 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:04:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:04:58.454+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:04:58.817 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:04:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:04:58.333Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.42:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.42:8765: connect: connection refused" 2024-09-21T18:04:58.817 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:04:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:04:58.334Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.42:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.42:8765: connect: connection refused" 2024-09-21T18:04:58.817 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:04:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:04:58.340Z caller=refresh.go:90 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.42:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.42:8765: connect: connection refused" 2024-09-21T18:04:58.817 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:04:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:04:58.340Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.42:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.42:8765: connect: connection refused" 2024-09-21T18:04:58.817 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:04:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:04:58.340Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nfs msg="Unable to refresh target groups" err="Get \"http://172.21.15.42:8765/sd/prometheus/sd-config?service=nfs\": dial tcp 172.21.15.42:8765: connect: connection refused" 2024-09-21T18:04:58.817 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:04:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:04:58.340Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=smb msg="Unable to refresh target groups" err="Get \"http://172.21.15.42:8765/sd/prometheus/sd-config?service=smb\": dial tcp 172.21.15.42:8765: connect: connection refused" 2024-09-21T18:04:58.817 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:04:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:04:58.340Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.42:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.42:8765: connect: connection refused" 2024-09-21T18:04:59.075 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:04:58 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:04:58.867+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:04:59.165 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:58 smithi042 podman[143248]: 2024-09-21 18:04:58.894434097 +0000 UTC m=+5.561640434 container died 5364e6db23001ec15042f2828ac6304e080910bad57757c86c4a62a4b737a71d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43) 2024-09-21T18:04:59.435 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:59 smithi042 podman[143248]: 2024-09-21 18:04:59.232516906 +0000 UTC m=+5.899723235 container cleanup 5364e6db23001ec15042f2828ac6304e080910bad57757c86c4a62a4b737a71d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T18:04:59.435 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:59 smithi042 bash[143248]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3 2024-09-21T18:04:59.497 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:04:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T18:04:59.230+0000 7fdd639de640 -1 osd.4 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:32.459096+0000 front 2024-09-21T18:04:32.459007+0000 (oldest deadline 2024-09-21T18:04:58.358863+0000) 2024-09-21T18:04:59.796 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:04:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:04:59.495+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:04:59.852 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:59 smithi042 podman[143275]: 2024-09-21 18:04:59.433896253 +0000 UTC m=+0.532166544 container remove 5364e6db23001ec15042f2828ac6304e080910bad57757c86c4a62a4b737a71d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-21T18:05:00.075 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:04:59 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:04:59.898+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:00.155 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:59 smithi042 podman[143362]: 2024-09-21 18:04:59.85139055 +0000 UTC m=+0.110615239 container create f37f813a833d7ce19138c866fb6e4a7ac316fe60ac4c0e37551a7f63a6bfab58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T18:05:00.155 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:04:59 smithi042 podman[143362]: 2024-09-21 18:04:59.756906977 +0000 UTC m=+0.016131677 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5 2024-09-21T18:05:00.156 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:05:00 smithi042 podman[143362]: 2024-09-21 18:05:00.07078528 +0000 UTC m=+0.330009978 container init f37f813a833d7ce19138c866fb6e4a7ac316fe60ac4c0e37551a7f63a6bfab58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T18:05:00.156 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:05:00 smithi042 podman[143362]: 2024-09-21 18:05:00.074102158 +0000 UTC m=+0.333326847 container start f37f813a833d7ce19138c866fb6e4a7ac316fe60ac4c0e37551a7f63a6bfab58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T18:05:00.156 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:05:00 smithi042 podman[143362]: 2024-09-21 18:05:00.154073824 +0000 UTC m=+0.413298516 container attach f37f813a833d7ce19138c866fb6e4a7ac316fe60ac4c0e37551a7f63a6bfab58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T18:05:00.414 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:05:00 smithi042 podman[143362]: 2024-09-21 18:05:00.26509382 +0000 UTC m=+0.524318515 container died f37f813a833d7ce19138c866fb6e4a7ac316fe60ac4c0e37551a7f63a6bfab58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T18:05:00.467 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:00 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T18:05:00.183+0000 7fdd639de640 -1 osd.4 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:32.459096+0000 front 2024-09-21T18:04:32.459007+0000 (oldest deadline 2024-09-21T18:04:58.358863+0000) 2024-09-21T18:05:00.815 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.3.service' 2024-09-21T18:05:00.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:00 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:00.465+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:00.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:00 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:00.560+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:00.840 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:05:00 smithi042 podman[143386]: 2024-09-21 18:05:00.790904728 +0000 UTC m=+0.515042395 container remove f37f813a833d7ce19138c866fb6e4a7ac316fe60ac4c0e37551a7f63a6bfab58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, io.buildah.version=1.37.2) 2024-09-21T18:05:00.840 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:05:00 smithi042 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.3.service: Deactivated successfully. 2024-09-21T18:05:00.840 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:05:00 smithi042 systemd[1]: Stopped Ceph osd.3 for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T18:05:00.840 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 21 18:05:00 smithi042 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.3.service: Consumed 40.682s CPU time. 2024-09-21T18:05:00.857 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:05:00.857 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T18:05:00.857 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T18:05:00.857 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.4 2024-09-21T18:05:01.160 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:00 smithi162 systemd[1]: Stopping Ceph osd.4 for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:05:01.160 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:00 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:00.935+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:01.421 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:01 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T18:05:01.158+0000 7fdd6b3d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:05:01.421 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:01 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T18:05:01.158+0000 7fdd6b3d1640 -1 osd.4 763 *** Got signal Terminated *** 2024-09-21T18:05:01.421 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:01 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T18:05:01.158+0000 7fdd6b3d1640 -1 osd.4 763 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T18:05:01.421 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:01 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T18:05:01.199+0000 7fdd639de640 -1 osd.4 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:32.459096+0000 front 2024-09-21T18:04:32.459007+0000 (oldest deadline 2024-09-21T18:04:58.358863+0000) 2024-09-21T18:05:01.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:01 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:01.418+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:01.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:01 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:01.591+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:02.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:02 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T18:05:02.170+0000 7fdd639de640 -1 osd.4 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:32.459096+0000 front 2024-09-21T18:04:32.459007+0000 (oldest deadline 2024-09-21T18:04:58.358863+0000) 2024-09-21T18:05:02.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:01 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:01.981+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:02.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:02 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:02.624+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:02.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:02 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:02.462+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:03.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:03 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T18:05:03.208+0000 7fdd639de640 -1 osd.4 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:32.459096+0000 front 2024-09-21T18:04:32.459007+0000 (oldest deadline 2024-09-21T18:04:58.358863+0000) 2024-09-21T18:05:03.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:03 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:03.015+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:03.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:03 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:03.488+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:03.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:03 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:03.667+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:04.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:04 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T18:05:04.159+0000 7fdd639de640 -1 osd.4 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:32.459096+0000 front 2024-09-21T18:04:32.459007+0000 (oldest deadline 2024-09-21T18:04:58.358863+0000) 2024-09-21T18:05:04.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:04 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:04.032+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:04.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:04 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:04.632+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:04.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:04 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:04.487+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:04.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:04 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:04.487+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:38.430777+0000 front 2024-09-21T18:04:38.430803+0000 (oldest deadline 2024-09-21T18:05:03.730690+0000) 2024-09-21T18:05:05.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:05 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T18:05:05.151+0000 7fdd639de640 -1 osd.4 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:32.459096+0000 front 2024-09-21T18:04:32.459007+0000 (oldest deadline 2024-09-21T18:04:58.358863+0000) 2024-09-21T18:05:05.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:05 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:05.043+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:05.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:05 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:05.618+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:05.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:05 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:05.505+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:05.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:05 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:05.505+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:38.430777+0000 front 2024-09-21T18:04:38.430803+0000 (oldest deadline 2024-09-21T18:05:03.730690+0000) 2024-09-21T18:05:06.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:06 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4[36197]: 2024-09-21T18:05:06.133+0000 7fdd639de640 -1 osd.4 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:32.459096+0000 front 2024-09-21T18:04:32.459007+0000 (oldest deadline 2024-09-21T18:04:58.358863+0000) 2024-09-21T18:05:06.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:06 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:06.069+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:06.825 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:06 smithi162 podman[64170]: 2024-09-21 18:05:06.546842989 +0000 UTC m=+5.489425935 container died 0ab575b7a26467630fa356e5dd5f399f5165d758730a0c9d546b6b3b2264993a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T18:05:06.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:06 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:06.552+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:06.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:06 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:06.552+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:38.430777+0000 front 2024-09-21T18:04:38.430803+0000 (oldest deadline 2024-09-21T18:05:03.730690+0000) 2024-09-21T18:05:06.826 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:06 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:06.646+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:06.826 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:06 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:06.646+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:07.112 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:06 smithi162 podman[64170]: 2024-09-21 18:05:06.916369966 +0000 UTC m=+5.858952911 container cleanup 0ab575b7a26467630fa356e5dd5f399f5165d758730a0c9d546b6b3b2264993a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4, GIT_CLEAN=True, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T18:05:07.112 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:06 smithi162 bash[64170]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4 2024-09-21T18:05:07.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:07 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:07.019Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused" 2024-09-21T18:05:07.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:07 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:07.019Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused" 2024-09-21T18:05:07.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:07 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:07.020Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T18:05:07.523 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:07 smithi162 podman[64186]: 2024-09-21 18:05:07.217773732 +0000 UTC m=+0.670252052 container remove 0ab575b7a26467630fa356e5dd5f399f5165d758730a0c9d546b6b3b2264993a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4, GIT_CLEAN=True, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T18:05:07.523 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:07 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:07.109+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:07.776 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:07 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:07.647+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:07.776 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:07 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:07.647+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:07.776 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:07 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:07.520+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:07.776 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:07 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:07.520+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:38.430777+0000 front 2024-09-21T18:04:38.430803+0000 (oldest deadline 2024-09-21T18:05:03.730690+0000) 2024-09-21T18:05:07.777 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:07 smithi162 podman[64275]: 2024-09-21 18:05:07.442294148 +0000 UTC m=+0.016071183 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5 2024-09-21T18:05:07.777 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:07 smithi162 podman[64275]: 2024-09-21 18:05:07.543480061 +0000 UTC m=+0.117257096 container create 5f7d5742bf18eb9c51a49e119fc0a03adb2cd5e1d7dc263a3e55adf663ba65a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.schema-version=1.0) 2024-09-21T18:05:07.777 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:07 smithi162 podman[64275]: 2024-09-21 18:05:07.771388017 +0000 UTC m=+0.345165062 container init 5f7d5742bf18eb9c51a49e119fc0a03adb2cd5e1d7dc263a3e55adf663ba65a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T18:05:07.777 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:07 smithi162 podman[64275]: 2024-09-21 18:05:07.7747221 +0000 UTC m=+0.348499136 container start 5f7d5742bf18eb9c51a49e119fc0a03adb2cd5e1d7dc263a3e55adf663ba65a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T18:05:08.075 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:07 smithi162 podman[64275]: 2024-09-21 18:05:07.871696812 +0000 UTC m=+0.445473850 container attach 5f7d5742bf18eb9c51a49e119fc0a03adb2cd5e1d7dc263a3e55adf663ba65a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43) 2024-09-21T18:05:08.075 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 18:05:07 smithi162 podman[64275]: 2024-09-21 18:05:07.972844161 +0000 UTC m=+0.546621196 container died 5f7d5742bf18eb9c51a49e119fc0a03adb2cd5e1d7dc263a3e55adf663ba65a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T18:05:08.487 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:08.080+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:08.487 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:08.080+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:08.664 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.4.service' 2024-09-21T18:05:08.707 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:05:08.708 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T18:05:08.708 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T18:05:08.708 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.5 2024-09-21T18:05:08.769 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:08.484+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:08.769 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:08.484+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:38.430777+0000 front 2024-09-21T18:04:38.430803+0000 (oldest deadline 2024-09-21T18:05:03.730690+0000) 2024-09-21T18:05:08.769 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:08.691+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:08.769 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:08 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:08.691+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:09.044 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:08 smithi162 systemd[1]: Stopping Ceph osd.5 for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:05:09.325 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:09.042+0000 7f4ec6b23640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:05:09.325 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:09.042+0000 7f4ec6b23640 -1 osd.5 763 *** Got signal Terminated *** 2024-09-21T18:05:09.325 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:09.042+0000 7f4ec6b23640 -1 osd.5 763 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T18:05:09.326 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:09.074+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:09.326 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:09.074+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:09.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:09.500+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:09.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:09.500+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:38.430777+0000 front 2024-09-21T18:04:38.430803+0000 (oldest deadline 2024-09-21T18:05:03.730690+0000) 2024-09-21T18:05:09.826 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:09.711+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:09.826 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:09 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:09.711+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:10.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:10 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:10.043+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:10.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:10 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:10.043+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:10.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:10 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:10.665+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:10.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:10 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:10.665+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:10.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:10 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:10.458+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:10.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:10 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:10.458+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:38.430777+0000 front 2024-09-21T18:04:38.430803+0000 (oldest deadline 2024-09-21T18:05:03.730690+0000) 2024-09-21T18:05:11.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:11 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:11.059+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:11.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:11 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:11.059+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:11.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:11 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:11.639+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:11.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:11 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:11.639+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:11.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:11 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:11.484+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:11.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:11 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:11.484+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:38.430777+0000 front 2024-09-21T18:04:38.430803+0000 (oldest deadline 2024-09-21T18:05:03.730690+0000) 2024-09-21T18:05:12.469 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:12 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:12.102+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:12.469 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:12 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:12.102+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:12.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:12 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:12.613+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:12.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:12 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:12.613+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:12.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:12 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:12.467+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:12.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:12 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:12.467+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:38.430777+0000 front 2024-09-21T18:04:38.430803+0000 (oldest deadline 2024-09-21T18:05:03.730690+0000) 2024-09-21T18:05:13.488 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:13 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:13.074+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:13.489 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:13 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:13.074+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:13.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:13 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:13.486+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:33.130148+0000 front 2024-09-21T18:04:33.130296+0000 (oldest deadline 2024-09-21T18:04:58.430202+0000) 2024-09-21T18:05:13.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:13 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5[41879]: 2024-09-21T18:05:13.486+0000 7f4ebf130640 -1 osd.5 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:38.430777+0000 front 2024-09-21T18:04:38.430803+0000 (oldest deadline 2024-09-21T18:05:03.730690+0000) 2024-09-21T18:05:13.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:13 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:13.628+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:13.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:13 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:13.628+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:14.409 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:14 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:14.115+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:14.409 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:14 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:14.115+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:14.670 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:14 smithi162 podman[64378]: 2024-09-21 18:05:14.407454465 +0000 UTC m=+5.470921494 container died 894f1ea800adbe07665d2cd60dc05d18ab434c2d916bc4b7aa8c7d9ce0e1c140 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T18:05:14.670 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:14 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:14.584+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:14.671 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:14 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:14.584+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:15.028 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:14 smithi162 podman[64378]: 2024-09-21 18:05:14.758897392 +0000 UTC m=+5.822364410 container cleanup 894f1ea800adbe07665d2cd60dc05d18ab434c2d916bc4b7aa8c7d9ce0e1c140 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T18:05:15.028 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:14 smithi162 bash[64378]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5 2024-09-21T18:05:15.325 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:15 smithi162 podman[64392]: 2024-09-21 18:05:15.026643386 +0000 UTC m=+0.616495796 container remove 894f1ea800adbe07665d2cd60dc05d18ab434c2d916bc4b7aa8c7d9ce0e1c140 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T18:05:15.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:15 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:15.148+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:15.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:15 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:15.148+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:15.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:15 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:15.148+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:15.657 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:15 smithi162 podman[64482]: 2024-09-21 18:05:15.27898299 +0000 UTC m=+0.015998799 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5 2024-09-21T18:05:15.657 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:15 smithi162 podman[64482]: 2024-09-21 18:05:15.419383258 +0000 UTC m=+0.156399049 container create 7fba7af17e8161272ed0a4b728b51fab8b8ee10385c9c7d43511fe1304a06d4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T18:05:15.657 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:15 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:15.554+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:15.657 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:15 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:15.554+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:15.657 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:15 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:15.554+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:50.415230+0000 front 2024-09-21T18:04:50.415202+0000 (oldest deadline 2024-09-21T18:05:15.115132+0000) 2024-09-21T18:05:16.075 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:15 smithi162 podman[64482]: 2024-09-21 18:05:15.655548317 +0000 UTC m=+0.392564116 container init 7fba7af17e8161272ed0a4b728b51fab8b8ee10385c9c7d43511fe1304a06d4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T18:05:16.075 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:15 smithi162 podman[64482]: 2024-09-21 18:05:15.658916775 +0000 UTC m=+0.395932559 container start 7fba7af17e8161272ed0a4b728b51fab8b8ee10385c9c7d43511fe1304a06d4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T18:05:16.075 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:15 smithi162 podman[64482]: 2024-09-21 18:05:15.738828985 +0000 UTC m=+0.475844778 container attach 7fba7af17e8161272ed0a4b728b51fab8b8ee10385c9c7d43511fe1304a06d4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T18:05:16.075 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 18:05:15 smithi162 podman[64482]: 2024-09-21 18:05:15.843432576 +0000 UTC m=+0.580448373 container died 7fba7af17e8161272ed0a4b728b51fab8b8ee10385c9c7d43511fe1304a06d4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T18:05:16.444 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:16 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:16.147+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:16.444 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:16 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:16.147+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:16.444 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:16 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:16.147+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:16.466 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.5.service' 2024-09-21T18:05:16.549 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:05:16.549 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T18:05:16.549 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T18:05:16.549 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.6 2024-09-21T18:05:16.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:16 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:16.603+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:16.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:16 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:16.603+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:16.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:16 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:16.603+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:50.415230+0000 front 2024-09-21T18:04:50.415202+0000 (oldest deadline 2024-09-21T18:05:15.115132+0000) 2024-09-21T18:05:16.825 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:16 smithi162 systemd[1]: Stopping Ceph osd.6 for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:05:17.180 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:16 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:16.886+0000 7f30d5f4f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:05:17.180 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:16 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:16.886+0000 7f30d5f4f640 -1 osd.6 763 *** Got signal Terminated *** 2024-09-21T18:05:17.180 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:16 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:16.886+0000 7f30d5f4f640 -1 osd.6 763 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T18:05:17.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:17 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:17.020Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T18:05:17.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:17 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:17.021Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused" 2024-09-21T18:05:17.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:17 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:17.021Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T18:05:17.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:17 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:17.178+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:17.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:17 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:17.178+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:17.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:17 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:17.178+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:18.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:17 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:17.625+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:18.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:17 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:17.625+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:18.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:17 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:17.625+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:50.415230+0000 front 2024-09-21T18:04:50.415202+0000 (oldest deadline 2024-09-21T18:05:15.115132+0000) 2024-09-21T18:05:18.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:18.189+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:18.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:18.189+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:18.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:18.189+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:18.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:18.189+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:19.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:18.657+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:19.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:18.657+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:19.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:18 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:18.657+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:50.415230+0000 front 2024-09-21T18:04:50.415202+0000 (oldest deadline 2024-09-21T18:05:15.115132+0000) 2024-09-21T18:05:19.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:19.156+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:19.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:19.156+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:19.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:19.156+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:19.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:19.156+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:20.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:19.667+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:20.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:19.667+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:20.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:19 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:19.667+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:50.415230+0000 front 2024-09-21T18:04:50.415202+0000 (oldest deadline 2024-09-21T18:05:15.115132+0000) 2024-09-21T18:05:20.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:20 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:20.181+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:20.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:20 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:20.181+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:20.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:20 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:20.181+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:20.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:20 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:20.181+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:21.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:20 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:20.641+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:21.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:20 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:20.641+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:21.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:20 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:20.641+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:50.415230+0000 front 2024-09-21T18:04:50.415202+0000 (oldest deadline 2024-09-21T18:05:15.115132+0000) 2024-09-21T18:05:21.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:21 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:21.207+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:21.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:21 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:21.207+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:21.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:21 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:21.207+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:21.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:21 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:21.207+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:22.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:21 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:21.638+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:34.713015+0000 front 2024-09-21T18:04:34.713149+0000 (oldest deadline 2024-09-21T18:05:00.012968+0000) 2024-09-21T18:05:22.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:21 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:21.638+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.013511+0000 front 2024-09-21T18:04:40.013691+0000 (oldest deadline 2024-09-21T18:05:05.913498+0000) 2024-09-21T18:05:22.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:21 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6[47135]: 2024-09-21T18:05:21.638+0000 7f30d2564640 -1 osd.6 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:50.415230+0000 front 2024-09-21T18:04:50.415202+0000 (oldest deadline 2024-09-21T18:05:15.115132+0000) 2024-09-21T18:05:22.575 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:22 smithi162 podman[64588]: 2024-09-21 18:05:22.355470042 +0000 UTC m=+5.582530306 container died 8e937cae6b58d8f5613eaabfdd593328938f9f7f94fd9bfb5a900857fa4e6339 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T18:05:22.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:22 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:22.187+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:22.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:22 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:22.187+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:22.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:22 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:22.187+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:22.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:22 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:22.187+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6815 osd.3 since back 2024-09-21T18:04:57.711112+0000 front 2024-09-21T18:04:57.711063+0000 (oldest deadline 2024-09-21T18:05:21.811090+0000) 2024-09-21T18:05:22.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:22 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:22.187+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:22.898 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:22 smithi162 podman[64588]: 2024-09-21 18:05:22.67003585 +0000 UTC m=+5.897096112 container cleanup 8e937cae6b58d8f5613eaabfdd593328938f9f7f94fd9bfb5a900857fa4e6339 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43) 2024-09-21T18:05:22.898 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:22 smithi162 bash[64588]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6 2024-09-21T18:05:23.191 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:22 smithi162 podman[64604]: 2024-09-21 18:05:22.896258403 +0000 UTC m=+0.539789462 container remove 8e937cae6b58d8f5613eaabfdd593328938f9f7f94fd9bfb5a900857fa4e6339 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T18:05:23.473 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:23 smithi162 podman[64692]: 2024-09-21 18:05:23.243627434 +0000 UTC m=+0.015538969 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5 2024-09-21T18:05:23.474 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:23 smithi162 podman[64692]: 2024-09-21 18:05:23.355574089 +0000 UTC m=+0.127485663 container create 00f57b01b55446c634671a71f7a160bbf39806312a8af40e74eec150722b6711 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T18:05:23.474 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:23 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:23.188+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:23.474 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:23 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:23.188+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:23.474 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:23 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:23.188+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:23.474 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:23 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:23.188+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6815 osd.3 since back 2024-09-21T18:04:57.711112+0000 front 2024-09-21T18:04:57.711063+0000 (oldest deadline 2024-09-21T18:05:21.811090+0000) 2024-09-21T18:05:23.474 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:23 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:23.188+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:23.789 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:23 smithi162 podman[64692]: 2024-09-21 18:05:23.584145829 +0000 UTC m=+0.356057366 container init 00f57b01b55446c634671a71f7a160bbf39806312a8af40e74eec150722b6711 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T18:05:23.789 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:23 smithi162 podman[64692]: 2024-09-21 18:05:23.587519172 +0000 UTC m=+0.359430715 container start 00f57b01b55446c634671a71f7a160bbf39806312a8af40e74eec150722b6711 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43) 2024-09-21T18:05:23.789 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:23 smithi162 podman[64692]: 2024-09-21 18:05:23.66619828 +0000 UTC m=+0.438109826 container attach 00f57b01b55446c634671a71f7a160bbf39806312a8af40e74eec150722b6711 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_CLEAN=True) 2024-09-21T18:05:24.075 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 18:05:23 smithi162 podman[64692]: 2024-09-21 18:05:23.787518138 +0000 UTC m=+0.559429679 container died 00f57b01b55446c634671a71f7a160bbf39806312a8af40e74eec150722b6711 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T18:05:24.355 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:24 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:24.181+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:24.451 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:24 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:24.181+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:24.451 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:24 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:24.181+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:24.451 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:24 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:24.181+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6815 osd.3 since back 2024-09-21T18:04:57.711112+0000 front 2024-09-21T18:04:57.711063+0000 (oldest deadline 2024-09-21T18:05:21.811090+0000) 2024-09-21T18:05:24.452 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:24 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:24.181+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:24.453 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.6.service' 2024-09-21T18:05:24.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:05:24.494 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T18:05:24.494 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T18:05:24.495 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.7 2024-09-21T18:05:24.825 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:24 smithi162 systemd[1]: Stopping Ceph osd.7 for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:05:25.205 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:24 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:24.914+0000 7fc3f2594640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:05:25.205 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:24 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:24.914+0000 7fc3f2594640 -1 osd.7 763 *** Got signal Terminated *** 2024-09-21T18:05:25.205 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:24 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:24.914+0000 7fc3f2594640 -1 osd.7 763 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T18:05:25.205 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:25 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:25.203+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:25.205 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:25 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:25.203+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:25.205 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:25 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:25.203+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:25.205 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:25 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:25.203+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6815 osd.3 since back 2024-09-21T18:04:57.711112+0000 front 2024-09-21T18:04:57.711063+0000 (oldest deadline 2024-09-21T18:05:21.811090+0000) 2024-09-21T18:05:25.205 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:25 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:25.203+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:26.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:26 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:26.178+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:26.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:26 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:26.178+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:26.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:26 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:26.178+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:26.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:26 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:26.178+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6815 osd.3 since back 2024-09-21T18:04:57.711112+0000 front 2024-09-21T18:04:57.711063+0000 (oldest deadline 2024-09-21T18:05:21.811090+0000) 2024-09-21T18:05:26.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:26 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:26.178+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:27.324 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:27 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:27.021Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused" 2024-09-21T18:05:27.324 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:27 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:27.021Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused" 2024-09-21T18:05:27.324 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:27 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:27.022Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T18:05:27.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:27 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:27.182+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:27.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:27 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:27.182+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:27.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:27 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:27.182+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:27.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:27 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:27.182+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6815 osd.3 since back 2024-09-21T18:04:57.711112+0000 front 2024-09-21T18:04:57.711063+0000 (oldest deadline 2024-09-21T18:05:21.811090+0000) 2024-09-21T18:05:27.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:27 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:27.182+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:28.477 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:28.156+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:28.477 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:28.156+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:28.477 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:28.156+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:28.477 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:28.156+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6815 osd.3 since back 2024-09-21T18:04:57.711112+0000 front 2024-09-21T18:04:57.711063+0000 (oldest deadline 2024-09-21T18:05:21.811090+0000) 2024-09-21T18:05:28.477 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:28 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:28.156+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:29.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:29.171+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6803 osd.0 since back 2024-09-21T18:04:29.807448+0000 front 2024-09-21T18:04:29.807349+0000 (oldest deadline 2024-09-21T18:04:58.607780+0000) 2024-09-21T18:05:29.576 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:29.171+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6807 osd.1 since back 2024-09-21T18:04:40.809156+0000 front 2024-09-21T18:04:40.809105+0000 (oldest deadline 2024-09-21T18:05:07.209345+0000) 2024-09-21T18:05:29.576 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:29.171+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6811 osd.2 since back 2024-09-21T18:04:49.510374+0000 front 2024-09-21T18:04:49.510352+0000 (oldest deadline 2024-09-21T18:05:14.210224+0000) 2024-09-21T18:05:29.576 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:29.171+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.42:6815 osd.3 since back 2024-09-21T18:04:57.711112+0000 front 2024-09-21T18:04:57.711063+0000 (oldest deadline 2024-09-21T18:05:21.811090+0000) 2024-09-21T18:05:29.576 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:29.171+0000 7fc3eeba9640 -1 osd.7 763 heartbeat_check: no reply from 172.21.15.162:6802 osd.4 since back 2024-09-21T18:05:02.912016+0000 front 2024-09-21T18:05:02.911923+0000 (oldest deadline 2024-09-21T18:05:28.811947+0000) 2024-09-21T18:05:29.576 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:29 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7[52830]: 2024-09-21T18:05:29.171+0000 7fc3eeba9640 -1 osd.7 763 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24451.0:1147 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e763) 2024-09-21T18:05:30.707 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:30 smithi162 podman[64797]: 2024-09-21 18:05:30.377188301 +0000 UTC m=+5.662803690 container died f086d6355d9a9d67c01c7c9942e5d9550b9f939abc5c805a1d28af0726d2442a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T18:05:31.075 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:30 smithi162 podman[64797]: 2024-09-21 18:05:30.705772062 +0000 UTC m=+5.991387451 container cleanup f086d6355d9a9d67c01c7c9942e5d9550b9f939abc5c805a1d28af0726d2442a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T18:05:31.075 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:30 smithi162 bash[64797]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7 2024-09-21T18:05:31.075 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:30 smithi162 podman[64827]: 2024-09-21 18:05:30.898529909 +0000 UTC m=+0.520224302 container remove f086d6355d9a9d67c01c7c9942e5d9550b9f939abc5c805a1d28af0726d2442a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-21T18:05:31.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:31 smithi162 podman[64912]: 2024-09-21 18:05:31.217478177 +0000 UTC m=+0.015813480 image pull 3fa9090ef91d4e87f14d21d1361976a766f2908d39879e744bc3fd80d5762a25 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5 2024-09-21T18:05:31.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:31 smithi162 podman[64912]: 2024-09-21 18:05:31.324358977 +0000 UTC m=+0.122694275 container create 0d811c93e69f3b7daae90370e52261a85d1afe1a5afbd7a981ad3f35dd2aad08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T18:05:31.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:31 smithi162 podman[64912]: 2024-09-21 18:05:31.560463075 +0000 UTC m=+0.358798370 container init 0d811c93e69f3b7daae90370e52261a85d1afe1a5afbd7a981ad3f35dd2aad08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T18:05:31.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:31 smithi162 podman[64912]: 2024-09-21 18:05:31.563803573 +0000 UTC m=+0.362138875 container start 0d811c93e69f3b7daae90370e52261a85d1afe1a5afbd7a981ad3f35dd2aad08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T18:05:32.048 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:31 smithi162 podman[64912]: 2024-09-21 18:05:31.660612568 +0000 UTC m=+0.458947871 container attach 0d811c93e69f3b7daae90370e52261a85d1afe1a5afbd7a981ad3f35dd2aad08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T18:05:32.048 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:31 smithi162 podman[64912]: 2024-09-21 18:05:31.757304559 +0000 UTC m=+0.555639856 container died 0d811c93e69f3b7daae90370e52261a85d1afe1a5afbd7a981ad3f35dd2aad08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, io.buildah.version=1.37.2) 2024-09-21T18:05:32.293 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.7.service' 2024-09-21T18:05:32.317 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:32 smithi162 podman[64935]: 2024-09-21 18:05:32.272178316 +0000 UTC m=+0.509308844 container remove 0d811c93e69f3b7daae90370e52261a85d1afe1a5afbd7a981ad3f35dd2aad08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T18:05:32.317 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:32 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.7.service: Deactivated successfully. 2024-09-21T18:05:32.317 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:32 smithi162 systemd[1]: Stopped Ceph osd.7 for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T18:05:32.317 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 18:05:32 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@osd.7.service: Consumed 39.612s CPU time. 2024-09-21T18:05:32.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:05:32.333 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T18:05:32.333 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-09-21T18:05:32.334 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@rgw.foo.a 2024-09-21T18:05:32.644 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 18:05:32 smithi042 systemd[1]: Stopping Ceph rgw.foo.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:05:32.914 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 18:05:32 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-rgw-foo-a[62658]: 2024-09-21T18:05:32.642+0000 7f46a27db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T18:05:32.914 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 18:05:32 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-rgw-foo-a[62658]: 2024-09-21T18:05:32.642+0000 7f46a6047880 -1 shutting down 2024-09-21T18:05:37.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:37 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:37.022Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T18:05:37.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:37 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:37.022Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.42:8443: connect: connection refused" 2024-09-21T18:05:37.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:37 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:37.022Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T18:05:42.914 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 18:05:42 smithi042 bash[143482]: time="2024-09-21T18:05:42Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-rgw-foo-a in 10 seconds, resorting to SIGKILL" 2024-09-21T18:05:42.915 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 18:05:42 smithi042 podman[143482]: 2024-09-21 18:05:42.666006836 +0000 UTC m=+10.136128169 container died c0eca6926a819da0f0ca1305c0eadcd4149156dc389691053bda8315bcf1d8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-rgw-foo-a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T18:05:43.252 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 18:05:43 smithi042 podman[143482]: 2024-09-21 18:05:43.073585405 +0000 UTC m=+10.543706749 container cleanup c0eca6926a819da0f0ca1305c0eadcd4149156dc389691053bda8315bcf1d8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-rgw-foo-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T18:05:43.252 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 21 18:05:43 smithi042 bash[143482]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-rgw-foo-a 2024-09-21T18:05:43.376 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@rgw.foo.a.service' 2024-09-21T18:05:43.412 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:05:43.413 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-09-21T18:05:43.413 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-09-21T18:05:43.413 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@prometheus.a 2024-09-21T18:05:43.725 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 systemd[1]: Stopping Ceph prometheus.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:05:44.075 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.723Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-21T18:05:44.075 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.723Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..." 2024-09-21T18:05:44.075 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.723Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..." 2024-09-21T18:05:44.076 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.723Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-21T18:05:44.076 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.723Z caller=main.go:984 level=info msg="Scrape discovery manager stopped" 2024-09-21T18:05:44.076 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.723Z caller=main.go:998 level=info msg="Notify discovery manager stopped" 2024-09-21T18:05:44.076 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.724Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped" 2024-09-21T18:05:44.076 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.724Z caller=main.go:1039 level=info msg="Stopping scrape manager..." 2024-09-21T18:05:44.076 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.724Z caller=main.go:1031 level=info msg="Scrape manager stopped" 2024-09-21T18:05:44.076 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.725Z caller=notifier.go:618 level=info component=notifier msg="Stopping notification manager..." 2024-09-21T18:05:44.076 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.725Z caller=main.go:1261 level=info msg="Notifier manager stopped" 2024-09-21T18:05:44.076 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a[60785]: ts=2024-09-21T18:05:43.725Z caller=main.go:1273 level=info msg="See you next time!" 2024-09-21T18:05:44.076 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:43 smithi162 podman[65014]: 2024-09-21 18:05:43.73370762 +0000 UTC m=+0.124504648 container died cffd8c5825007d6e49af952c03e04bc3f6729d188ce7644aa4e53b31fca608e9 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T18:05:44.384 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:44 smithi162 podman[65014]: 2024-09-21 18:05:44.173456359 +0000 UTC m=+0.564253429 container cleanup cffd8c5825007d6e49af952c03e04bc3f6729d188ce7644aa4e53b31fca608e9 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T18:05:44.384 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 18:05:44 smithi162 bash[65014]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-prometheus-a 2024-09-21T18:05:44.602 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@prometheus.a.service' 2024-09-21T18:05:44.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T18:05:44.636 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-09-21T18:05:44.636 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm rm-cluster --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T18:05:44.846 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T18:05:46.823 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:46 smithi042 systemd[1]: Stopping Ceph alertmanager.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:05:46.823 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:46 smithi042 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a[70642]: ts=2024-09-21T18:05:46.780Z caller=main.go:542 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-21T18:05:47.116 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:46 smithi042 podman[143972]: 2024-09-21 18:05:46.821446585 +0000 UTC m=+0.145145893 container died 08a5abaa1a372d06509721ce4dd9be7714b17ae3beec1012065715c4cc97e08f (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T18:05:47.414 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:47 smithi042 podman[143972]: 2024-09-21 18:05:47.214177257 +0000 UTC m=+0.537876564 container cleanup 08a5abaa1a372d06509721ce4dd9be7714b17ae3beec1012065715c4cc97e08f (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T18:05:47.415 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:47 smithi042 bash[143972]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a 2024-09-21T18:05:47.788 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:47 smithi042 podman[143984]: 2024-09-21 18:05:47.482277773 +0000 UTC m=+0.653365779 container remove 08a5abaa1a372d06509721ce4dd9be7714b17ae3beec1012065715c4cc97e08f (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T18:05:47.788 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:47 smithi042 podman[143984]: 2024-09-21 18:05:47.582748224 +0000 UTC m=+0.753836230 volume remove 32c2cf8c0e08f90f870dc6d8b40f059fa50e0d061772fb740943498332534a2d 2024-09-21T18:05:48.164 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 18:05:48 smithi042 systemd[1]: Stopping Ceph node-exporter.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:05:48.165 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:47 smithi042 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@alertmanager.a.service: Deactivated successfully. 2024-09-21T18:05:48.165 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:47 smithi042 systemd[1]: Stopped Ceph alertmanager.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T18:05:48.165 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 21 18:05:47 smithi042 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@alertmanager.a.service: Consumed 1.850s CPU time. 2024-09-21T18:05:48.561 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 18:05:48 smithi042 podman[144103]: 2024-09-21 18:05:48.271596232 +0000 UTC m=+0.118127607 container died cd634aec6e319a5e71ecfc74266a27df1219033b30f2333f60a878fefa75de0a (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T18:05:48.561 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 18:05:48 smithi042 podman[144103]: 2024-09-21 18:05:48.560364629 +0000 UTC m=+0.406895985 container cleanup cd634aec6e319a5e71ecfc74266a27df1219033b30f2333f60a878fefa75de0a (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T18:05:48.910 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 18:05:48 smithi042 bash[144103]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a 2024-09-21T18:05:48.910 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 18:05:48 smithi042 podman[144114]: 2024-09-21 18:05:48.794740241 +0000 UTC m=+0.526954683 container remove cd634aec6e319a5e71ecfc74266a27df1219033b30f2333f60a878fefa75de0a (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T18:05:48.910 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 18:05:48 smithi042 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-21T18:05:49.394 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 18:05:48 smithi042 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-21T18:05:49.394 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 18:05:48 smithi042 systemd[1]: Stopped Ceph node-exporter.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T18:05:49.394 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 21 18:05:48 smithi042 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@node-exporter.a.service: Consumed 3.764s CPU time. 2024-09-21T18:05:49.600 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm rm-cluster --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T18:05:49.804 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T18:05:51.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:05:51 smithi162 systemd[1]: Stopping Ceph iscsi.iscsi.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:05:51.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:05:51 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a[57247]: debug Shutdown received 2024-09-21T18:06:01.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:06:01 smithi162 bash[65418]: time="2024-09-21T18:06:01Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a in 10 seconds, resorting to SIGKILL" 2024-09-21T18:06:01.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:06:01 smithi162 podman[65418]: 2024-09-21 18:06:01.335947217 +0000 UTC m=+10.102940690 container died 61c2ae96780141ffbf94ff8d036fbf6eadac7e082a0737a79379dff84a7af42e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T18:06:01.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:06:01 smithi162 podman[65418]: 2024-09-21 18:06:01.667442964 +0000 UTC m=+10.434436440 container cleanup 61c2ae96780141ffbf94ff8d036fbf6eadac7e082a0737a79379dff84a7af42e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T18:06:01.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:06:01 smithi162 bash[65418]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a 2024-09-21T18:06:01.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:06:01 smithi162 podman[65432]: 2024-09-21 18:06:01.8020159 +0000 UTC m=+0.465978954 container remove 61c2ae96780141ffbf94ff8d036fbf6eadac7e082a0737a79379dff84a7af42e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7e696d4014dc129bd30a3126ccae3c43a4a3060f7a811b44f457f7ec9f7f5d5, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-iscsi-iscsi-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-adk-testing-2024-09-21-1014-0ecbb43, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T18:06:01.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:06:01 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-09-21T18:06:02.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:06:02 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-09-21T18:06:02.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:06:02 smithi162 systemd[1]: Stopped Ceph iscsi.iscsi.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T18:06:02.325 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 18:06:02 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@iscsi.iscsi.a.service: Consumed 2.713s CPU time. 2024-09-21T18:06:03.825 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:03 smithi162 systemd[1]: Stopping Ceph grafana.a for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:06:04.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:03 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=server t=2024-09-21T18:06:03.84714433Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-09-21T18:06:04.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:03 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=tracing t=2024-09-21T18:06:03.847488552Z level=info msg="Closing tracing" 2024-09-21T18:06:04.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:03 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=ticker t=2024-09-21T18:06:03.847508281Z level=info msg=stopped last_tick=2024-09-21T18:06:00Z 2024-09-21T18:06:04.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:03 smithi162 ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a[59660]: logger=grafana-apiserver t=2024-09-21T18:06:03.847590241Z level=info msg="StorageObjectCountTracker pruner is exiting" 2024-09-21T18:06:04.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:03 smithi162 podman[65706]: 2024-09-21 18:06:03.857415342 +0000 UTC m=+0.168819856 container died 071d550bb132596bf7ef8acb676cb91a672047bd804e54c4306ef7dc7928d8c2 (image=quay.io/ceph/grafana:10.4.8, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T18:06:04.555 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:04 smithi162 podman[65706]: 2024-09-21 18:06:04.192670405 +0000 UTC m=+0.504074916 container cleanup 071d550bb132596bf7ef8acb676cb91a672047bd804e54c4306ef7dc7928d8c2 (image=quay.io/ceph/grafana:10.4.8, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T18:06:04.555 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:04 smithi162 bash[65706]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a 2024-09-21T18:06:04.555 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:04 smithi162 podman[65718]: 2024-09-21 18:06:04.362939196 +0000 UTC m=+0.506478011 container remove 071d550bb132596bf7ef8acb676cb91a672047bd804e54c4306ef7dc7928d8c2 (image=quay.io/ceph/grafana:10.4.8, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T18:06:04.825 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 18:06:04 smithi162 systemd[1]: Stopping Ceph node-exporter.b for 6e3cf65a-7840-11ef-baf6-efdc52797490... 2024-09-21T18:06:04.825 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:04 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@grafana.a.service: Deactivated successfully. 2024-09-21T18:06:04.825 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:04 smithi162 systemd[1]: Stopped Ceph grafana.a for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T18:06:04.825 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 18:06:04 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@grafana.a.service: Consumed 13.023s CPU time. 2024-09-21T18:06:05.293 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 18:06:05 smithi162 podman[65831]: 2024-09-21 18:06:05.026666591 +0000 UTC m=+0.117246912 container died 045d33617a4c742eb0ea3c1399d9415d640ccf6b2710afbdfe9618f45344a3e3 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T18:06:05.575 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 18:06:05 smithi162 podman[65831]: 2024-09-21 18:06:05.390985542 +0000 UTC m=+0.481565849 container cleanup 045d33617a4c742eb0ea3c1399d9415d640ccf6b2710afbdfe9618f45344a3e3 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T18:06:05.575 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 18:06:05 smithi162 bash[65831]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b 2024-09-21T18:06:05.941 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 18:06:05 smithi162 podman[65844]: 2024-09-21 18:06:05.667023225 +0000 UTC m=+0.640445601 container remove 045d33617a4c742eb0ea3c1399d9415d640ccf6b2710afbdfe9618f45344a3e3 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-6e3cf65a-7840-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T18:06:05.941 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 18:06:05 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-21T18:06:05.941 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 18:06:05 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-21T18:06:05.941 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 18:06:05 smithi162 systemd[1]: Stopped Ceph node-exporter.b for 6e3cf65a-7840-11ef-baf6-efdc52797490. 2024-09-21T18:06:05.941 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 18:06:05 smithi162 systemd[1]: ceph-6e3cf65a-7840-11ef-baf6-efdc52797490@node-exporter.b.service: Consumed 3.481s CPU time. 2024-09-21T18:06:06.470 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T18:06:06.505 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T18:06:06.532 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T18:06:06.533 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/adking-2024-09-21_16:57:11-orch:cephadm-wip-adk-testing-2024-09-21-1014-distro-default-smithi/7914066/remote/smithi042/crash 2024-09-21T18:06:06.534 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/crash -- . 2024-09-21T18:06:06.586 INFO:teuthology.orchestra.run.smithi042.stderr:tar: /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T18:06:06.587 INFO:teuthology.orchestra.run.smithi042.stderr:tar: Error is not recoverable: exiting now 2024-09-21T18:06:06.589 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/adking-2024-09-21_16:57:11-orch:cephadm-wip-adk-testing-2024-09-21-1014-distro-default-smithi/7914066/remote/smithi162/crash 2024-09-21T18:06:06.590 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/crash -- . 2024-09-21T18:06:06.627 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T18:06:06.627 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2024-09-21T18:06:06.628 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T18:06:06.628 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v CEPHADM_STRAY_DAEMON | head -n 1 2024-09-21T18:06:06.660 INFO:tasks.cephadm:Compressing logs... 2024-09-21T18:06:06.661 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T18:06:06.704 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T18:06:06.727 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/tcmu-runner.log 2024-09-21T18:06:06.728 INFO:teuthology.orchestra.run.smithi162.stderr:: No such file or directory 2024-09-21T18:06:06.728 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.7.log 2024-09-21T18:06:06.731 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/tcmu-runner.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T18:06:06.732 INFO:teuthology.orchestra.run.smithi162.stderr: 63.3% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/tcmu-runner.log.gz 2024-09-21T18:06:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.4.log 2024-09-21T18:06:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T18:06:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T18:06:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.6.log 2024-09-21T18:06:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.5.log 2024-09-21T18:06:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.log 2024-09-21T18:06:06.732 INFO:teuthology.orchestra.run.smithi162.stderr: 79.9% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T18:06:06.732 INFO:teuthology.orchestra.run.smithi042.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.0.log 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.1.log 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.0.log: -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mon.c.log 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mon.a.log 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.2.log 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mgr.y.log 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi042.stderr: 89.2% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.log 2024-09-21T18:06:06.733 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mgr.x.log 2024-09-21T18:06:06.734 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mon.b.log 2024-09-21T18:06:06.735 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mgr.x.log: 87.0% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T18:06:06.739 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T18:06:06.739 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mon.b.log: 92.5% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T18:06:06.742 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/cephadm.log: 91.4% 91.0% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T18:06:06.742 INFO:teuthology.orchestra.run.smithi162.stderr: -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T18:06:06.745 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mgr.y.log: 90.9% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T18:06:06.745 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-client.rgw.foo.a.log 2024-09-21T18:06:06.745 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.log: -5 --verbose -- /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.3.log 2024-09-21T18:06:06.749 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-client.rgw.foo.a.log: 95.3% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T18:06:06.752 INFO:teuthology.orchestra.run.smithi042.stderr: 92.8% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T18:06:06.753 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T18:06:06.754 INFO:teuthology.orchestra.run.smithi162.stderr: 91.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T18:06:06.783 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T18:06:06.787 INFO:teuthology.orchestra.run.smithi042.stderr: 93.9% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-client.rgw.foo.a.log.gz 2024-09-21T18:06:07.040 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T18:06:07.604 INFO:teuthology.orchestra.run.smithi162.stderr: 92.9% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mon.b.log.gz 2024-09-21T18:06:07.794 INFO:teuthology.orchestra.run.smithi042.stderr: 92.7% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mon.c.log.gz 2024-09-21T18:06:09.060 INFO:teuthology.orchestra.run.smithi042.stderr: 92.1% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-mon.a.log.gz 2024-09-21T18:06:12.849 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.5.log.gz 2024-09-21T18:06:12.900 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.6.log.gz 2024-09-21T18:06:13.266 INFO:teuthology.orchestra.run.smithi162.stderr: 94.0% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.4.log.gz 2024-09-21T18:06:13.707 INFO:teuthology.orchestra.run.smithi042.stderr: 94.0% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.1.log.gz 2024-09-21T18:06:13.814 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.7.log.gz 2024-09-21T18:06:13.816 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-21T18:06:13.816 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m7.098s 2024-09-21T18:06:13.816 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m25.834s 2024-09-21T18:06:13.816 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.970s 2024-09-21T18:06:13.989 INFO:teuthology.orchestra.run.smithi042.stderr: 93.9% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.2.log.gz 2024-09-21T18:06:14.205 INFO:teuthology.orchestra.run.smithi042.stderr: 94.0% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.0.log.gz 2024-09-21T18:06:14.478 INFO:teuthology.orchestra.run.smithi042.stderr: 94.0% -- replaced with /var/log/ceph/6e3cf65a-7840-11ef-baf6-efdc52797490/ceph-osd.3.log.gz 2024-09-21T18:06:14.479 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-21T18:06:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m7.761s 2024-09-21T18:06:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m32.172s 2024-09-21T18:06:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m1.001s 2024-09-21T18:06:14.479 INFO:tasks.cephadm:Archiving logs... 2024-09-21T18:06:14.479 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/adking-2024-09-21_16:57:11-orch:cephadm-wip-adk-testing-2024-09-21-1014-distro-default-smithi/7914066/remote/smithi042/log 2024-09-21T18:06:14.480 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T18:06:18.291 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/adking-2024-09-21_16:57:11-orch:cephadm-wip-adk-testing-2024-09-21-1014-distro-default-smithi/7914066/remote/smithi162/log 2024-09-21T18:06:18.291 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T18:06:21.791 INFO:tasks.cephadm:Removing cluster... 2024-09-21T18:06:21.792 DEBUG:teuthology.orchestra.run.smithi042:> sudo cephadm rm-cluster --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 --force 2024-09-21T18:06:22.006 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T18:06:22.302 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm rm-cluster --fsid 6e3cf65a-7840-11ef-baf6-efdc52797490 --force 2024-09-21T18:06:22.504 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: 6e3cf65a-7840-11ef-baf6-efdc52797490 2024-09-21T18:06:22.792 INFO:tasks.cephadm:Teardown complete 2024-09-21T18:06:22.793 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T18:06:22.808 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T18:06:22.808 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T18:06:22.811 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T18:06:22.884 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T18:06:22.892 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T18:06:22.892 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T18:06:22.895 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T18:06:22.909 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-21T18:06:22.909 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-21T18:06:22.913 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T18:06:22.913 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-21T18:06:22.914 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 -325us[ -298us] +/- 59ms 2024-09-21T18:06:22.914 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 +799us[ +826us] +/- 70ms 2024-09-21T18:06:22.914 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 -548us[ -521us] +/- 89ms 2024-09-21T18:06:22.915 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T18:06:22.916 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T18:06:22.916 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-21T18:06:22.916 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv01.front.sepia.ceph.com 3 6 377 32 -320us[ -316us] +/- 59ms 2024-09-21T18:06:22.916 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 32 +835us[ +839us] +/- 70ms 2024-09-21T18:06:22.916 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -515us[ -511us] +/- 89ms 2024-09-21T18:06:22.917 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T18:06:22.917 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T18:06:22.926 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T18:06:22.926 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T18:06:22.934 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T18:06:23.031 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T18:06:23.098 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T18:06:23.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T18:06:23.128 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T18:06:23.155 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T18:06:23.155 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T18:06:23.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T18:06:23.174 INFO:teuthology.task.internal:Duration was 2013.455265 seconds 2024-09-21T18:06:23.174 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T18:06:23.183 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T18:06:23.184 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T18:06:23.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T18:06:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T18:06:23.233 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T18:06:23.448 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T18:06:23.449 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-09-21T18:06:23.449 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T18:06:23.511 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T18:06:23.511 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T18:06:23.536 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T18:06:23.537 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T18:06:23.553 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T18:06:23.604 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T18:06:23.604 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T18:06:23.623 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T18:06:24.052 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T18:06:24.063 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T18:06:24.063 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T18:06:24.089 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T18:06:24.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T18:06:24.125 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T18:06:24.131 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T18:06:24.153 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-09-21T18:06:24.178 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-21T18:06:24.213 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T18:06:24.228 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T18:06:24.228 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T18:06:24.268 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T18:06:24.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T18:06:24.278 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T18:06:24.279 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2024-09-21_16:57:11-orch:cephadm-wip-adk-testing-2024-09-21-1014-distro-default-smithi/7914066/remote/smithi042 2024-09-21T18:06:24.279 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T18:06:24.341 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2024-09-21_16:57:11-orch:cephadm-wip-adk-testing-2024-09-21-1014-distro-default-smithi/7914066/remote/smithi162 2024-09-21T18:06:24.341 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T18:06:24.377 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T18:06:24.377 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T18:06:24.379 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T18:06:24.426 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T18:06:24.436 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T18:06:24.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T18:06:24.449 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T18:06:24.449 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T18:06:24.451 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T18:06:24.464 INFO:teuthology.orchestra.run.smithi042.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 18:06 /home/ubuntu/cephtest 2024-09-21T18:06:24.480 INFO:teuthology.orchestra.run.smithi162.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 18:06 /home/ubuntu/cephtest 2024-09-21T18:06:24.481 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T18:06:24.491 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T18:06:24.523 INFO:teuthology.run:Summary data: description: orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} duration: 2013.4552652835846 flavor: default owner: scheduled_adking@teuthology success: true 2024-09-21T18:06:24.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T18:06:25.921 INFO:teuthology.run:pass